AWS Tech Lead

Polar IT Services • Elkridge, VA

7d • Remote

About The Position

Capital One is seeking 6 Tech Leads for a 6-month contracting opportunity with strong potential for extension. This role is 100% remote, but candidates must meet specific client requirements, including living near a Capital One hub (Chicago, Boston, NYC, Virginia, Texas, etc.). The position involves leading separate Data Engineering teams responsible for picking up Discover's historical credit card data from OneStream's OneLake location, transforming it, and loading it into target states like Snowflake or AWS S3. This is part of a large-scale project related to Capital One's acquisition of Discover, specifically the DFS data migration effort to ingest all historical Discover Card data into Capital One's internal systems. This migration is an enterprise imperative to enable downstream analytics, compliance, and operational continuity.

Requirements

• Previous leadership experience.
• Experience in the financial/Fintech sector.
• Currently working in the AWS space.
• Experience in Airflow, Databricks, Snowflake, and PySpark.
• AWS (EMR/Glue, S3, Lambda, Cloudwatch).
• Python/Java.
• Spark.
• Databricks.
• SQL.
• Bash.
• Python use: scripting, building new data pipelines (not app dev).
• Data warehousing experience (Snowflake).
• APIs.
• Agile engineering practices & JIRA usage.

Nice To Haves

• Kafka
• Airflow
• Open Table formats (Delta, Hudi, Iceberg)
• Splunk
• NewRelic
• Github
• Jenkins
• Prior Capital One experience highly preferred.

Responsibilities

• Lead 6 separate Data Engineering teams.
• Ensure team's work is delivered on time.
• Lead sprint ceremonies for the team.
• Accountable for problem-solving with senior managers.
• Pivot and adapt quickly based on requirements.
• Pick up, transform, and load Discover's historical credit card data into target states (Snowflake or AWS S3).
• Build new data pipelines.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed