Lead Data Engineer

Lincoln Financial•Radnor, PA
•$120,375 - $192,600•Hybrid

About The Position

The Lead Data Engineer provides technical leadership for Lincoln’s Data & Analytics platform on AWS. The role designs, builds, and maintains scalable data pipelines and optimizes data systems, with a focus on Aurora PostgreSQL and Amazon Redshift and working knowledge of AWS services. The position leads ETL development within an Agile team and partners with business, IT, and analytics stakeholders to deliver secure, governed, high-quality data for advanced analytics and reporting. The Lead Data Engineer owns end-to-end data flows from source to consumption, helps shape AWS data infrastructure strategy, and sets team standards. The role includes code review, mentoring engineers, production support, and continuous process improvement. The employee works hybrid, in a Lincoln office three days per week. Relocation assistance is not available.

Requirements

  • Bachelor’s degree or equivalent in Computer Science, Information Systems, Engineering, or a related field.
  • 7+ years in AWS data engineering or a similar role.
  • Strong expertise in Aurora PostgreSQL and Amazon Redshift, including database analysis, query optimization, advanced SQL, execution plans, indexing, distribution and sort keys, and workload tuning.
  • Holistic understanding of end-to-end data processing from source to consumption, including dependencies, bottlenecks, and downstream impact.
  • Experience integrating data and applications with upstream source systems and downstream consumers, including APIs, files, messaging, and reporting layers.
  • Hands-on AWS experience with Glue, Lambda, S3, Athena, EC2, and IAM.
  • Python/PySpark and SQL development for ETL and data integration in Agile, SDLC-based environments.
  • Knowledge of data modeling, data governance, data quality, and data security practices.
  • DevOps and scheduling experience with Git, CI/CD pipelines, automated testing, CloudFormation or similar, and Stonebranch or a similar scheduler such as Autosys.
  • Hands-on use of approved AI-assisted development tools such as GitHub Copilot or Claude Code, including validation of AI output and adherence to data privacy and responsible AI requirements.
  • Proven ability to mentor engineers and lead delivery of complex projects.

Nice To Haves

  • AWS Certified Data Engineer – Associate, Solutions Architect, or an AWS specialty certification.
  • Experience with EMR, Kinesis, Lake Formation, DynamoDB, and Apache Iceberg.
  • Microsoft 365 Copilot and Claude Cowork experience, including coaching teams on safe AI use.
  • Experience with RAG data preparation, embeddings, vector stores, and AWS AI services such as Bedrock, SageMaker, and Amazon Q.
  • Salesforce CRM and MuleSoft (API-led integration) experience as upstream or downstream systems; MicroStrategy and Tableau reporting and BI background.
  • Financial data experience, especially investment products such as Mutual Funds, Alternative Funds, and Fund Data management.

Responsibilities

  • Design, build, and maintain batch and streaming data pipelines, including change data capture, to support business intelligence and analytics.
  • Integrate structured and unstructured data from internal and external sources.
  • Develop ETL workflows using AWS Glue, Lambda, custom Python, PySpark, and SQL-based scripts.
  • Analyze database workloads and optimize queries, indexing, partitioning, and storage in Aurora PostgreSQL and Amazon Redshift for integrity, performance, and cost.
  • Build S3-based data lake and warehouse layers using Glue Data Catalog, Athena, and Parquet, with fine-grained access controls.
  • Own end-to-end data flows from source to consumption and trace and resolve issues across the full chain.
  • Apply data modeling standards, including normal form, star, and snowflake, and create technical designs from business requirements.
  • Orchestrate and schedule workflows using Stonebranch, Step Functions, or Airflow; monitor them with CloudWatch and automated data quality checks.
  • Ensure data security, governance, and compliance; monitor, troubleshoot, and optimize data workflows.
  • Integrate with upstream and downstream applications and collaborate with data scientists, analysts, and business stakeholders to deliver high-quality datasets.
  • Help shape data infrastructure strategy on AWS.
  • Set team standards, review code, mentor engineers, and own production support and process improvement.
  • Use approved AI-assisted development tools responsibly, validate AI output, and follow Lincoln data privacy and responsible AI requirements.

Benefits

  • PTO and parental leave.
  • Competitive 401(k) and employee benefits.
  • Free financial counseling, health coaching, and employee assistance program.
  • Tuition assistance program.
  • Clearly defined career tracks and job levels.
  • Leadership development and virtual training opportunities.
  • Flexible work arrangements.
  • Productivity and technology tools and training.
  • The role may be eligible for the discretionary Annual Incentive Program; other rewards may include long-term incentives and sales incentives.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service