Lead AWS Data Architect

Cynet Systems•Atlanta, GA

About The Position

The Lead AWS Data Architect will own the design, quality, and performance of the client’s AWS-based data platform. This hands-on role defines end-to-end architecture, writes and reviews production code, and mentors the data engineering team. The role requires financial-domain knowledge to translate business needs into reliable, compliant data solutions. The architect designs data ingestion, transformation, storage, and consumption layers; establishes data modeling standards; and makes and documents technology and design decisions. The role also develops and optimizes data pipelines and AWS services, establishes reusable engineering frameworks and practices, and supports production operations. In collaboration with business, risk, finance, and compliance stakeholders, the architect delivers governed financial-data pipelines with accuracy, lineage, auditability, reconciliation, security, and appropriate controls.

Requirements

  • At least 9 years of experience in the data domain, such as data engineering, warehousing, or big data.
  • At least 3–4 years in an architect or technical lead role.
  • Proven experience designing and delivering large-scale data platforms on AWS.
  • Strong Python and PySpark skills and advanced SQL.
  • Deep Apache Spark expertise, including internals and performance tuning.
  • Experience with AWS Glue, including ETL, Data Catalog, and Crawlers; S3; Lambda; IAM; and CloudWatch.
  • Experience with Apache Airflow, including DAG design, dependencies, retries, SLAs, and monitoring.
  • Knowledge of data lake, data warehouse, and dimensional modeling.
  • Experience with partitioning, file sizing, compression, and cost/performance trade-offs.
  • Experience with Git, CI/CD, unit and integration testing, code quality tools, and Infrastructure as Code using Terraform or CloudFormation.
  • Solid understanding of a financial domain such as banking, capital markets, insurance, payments, or lending.
  • Familiarity with financial data concepts including reconciliation, regulatory reporting, audit trails, data retention, and data privacy.
  • Strong communication skills with technical and business stakeholders.
  • Mentoring and team leadership skills.
  • Ownership mindset and ability to make sound decisions under ambiguity.

Nice To Haves

  • Experience with Redshift, Athena, EMR, Lake Formation, Step Functions, or Kinesis/Kafka.
  • Experience with open table formats such as Apache Iceberg, Hudi, or Delta Lake.
  • AWS certification in Solutions Architecture, Data Analytics, or Data Engineering.

Responsibilities

  • Design end-to-end AWS data architecture for ingestion, transformation, storage, and consumption.
  • Define data modeling standards, including dimensional modeling, data lake and lakehouse approaches, partitioning, and file formats.
  • Make technology and design decisions and document them through architecture decision records and design reviews.
  • Ensure the data platform is scalable, secure, cost-efficient, and resilient.
  • Write high-quality Python and PySpark code for complex pipelines and critical components.
  • Tune and optimize Spark jobs, including shuffle, skew, partitioning, broadcast joins, memory and executor configuration, and caching.
  • Build and optimize AWS Glue jobs, Lambda functions, and Airflow DAGs.
  • Optimize S3 data layout, file formats, and file sizing for performance and cost.
  • Monitor and control AWS compute and storage costs.
  • Build reusable frameworks and libraries for logging, error handling, data quality checks, reconciliation, and related processes.
  • Review code, pull requests, and designs, and enforce engineering best practices.
  • Guide, mentor, and upskill data engineers.
  • Set coding standards, CI/CD practices, and testing strategies for data pipelines.
  • Act as the technical escalation point for production issues and root-cause analysis.
  • Work with business, risk, finance, and compliance stakeholders to understand requirements.
  • Design pipelines for financial data, including transactions, ledgers, payments, positions, and regulatory reporting.
  • Ensure data accuracy, lineage, auditability, reconciliation, and controls.
  • Apply data security practices, including encryption, IAM, masking or tokenization of sensitive data, and access control.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service