Senior Data Engineer (AWS & Databricks)

LED FastStart•Louisiana, MO
•$111,155 - $150,385•Remote

About The Position

The Senior Data Engineer supports GDIT’s Case Management Modernization (CMM) Program for the Administrative Office of the U.S. Courts. The role uses AWS Cloud and Databricks to deliver data governance, engineering, platform, reporting, analytics, and AI/ML capabilities that support operational decision-making and the AOUSC’s data and analytics objectives. The position designs, builds, tests, and maintains secure, scalable, high-performing data engineering components and platform services. This includes data pipelines, transformations, ETL/ELT solutions, data management, and system integrations aligned with federal standards and CMM modernization objectives. The engineer works with Data Architecture, Data Governance, and Migration teams, following the program’s cloud-based CI/CD standards. The role is remote and requires U.S. Person status. The employee must obtain and maintain a Public Trust and complete onsite fingerprinting at a designated facility. Travel is less than 10%.

Requirements

  • Bachelor’s degree in Data Science or a closely related discipline.
  • At least 5 years of specialized experience with AWS Cloud and Databricks.
  • Deep hands-on experience with core AWS data storage, compute, and serverless tools.
  • Deep hands-on experience with Databricks, Apache Spark, and Delta Lake.
  • Advanced proficiency in Python, PySpark, SQL, and data transformation techniques.
  • Proficiency with ETL/ELT frameworks.
  • Familiarity with Git, containerization, CI/CD, and data governance frameworks such as Unity Catalog.
  • Hands-on experience building enterprise-scale data pipelines.
  • Experience with streaming or near-real-time data ingestion.
  • Familiarity with data governance, metadata, and classification standards.
  • Experience and understanding of system security best practices.
  • Experience building and migrating software and IT services to align with strategic business needs and goals.
  • Experience researching advanced technologies and determining how IT can support business needs through software, hardware, or infrastructure.
  • Experience identifying and applying industry tools, solutions, methods, best practices, and emerging technologies.
  • Familiarity with Agile/Scrum delivery environments.
  • Experience working in regulated or compliance-driven environments.
  • Excellent presentation and communication skills.
  • Consultative approach and ability to work with senior customer stakeholders and build customer relationships.
  • Strong analytical and problem-solving skills, including the ability to formulate and communicate improvement recommendations.
  • Ability to work effectively independently and as part of a team.
  • Experience mentoring junior data engineers.
  • Must be a U.S. Person as defined in the posting.
  • Must obtain and maintain a Public Trust and provide onsite fingerprinting at a designated facility.

Nice To Haves

  • Bachelor’s degree and at least 7 years of specialized experience with AWS Cloud and Databricks, or a Master’s degree and at least 5 years of specialized experience with AWS Cloud and Databricks.
  • Databricks Certified Data Professional certification.
  • AWS Certified Data Analytics – Specialty certification.
  • AWS Certified Solutions Architect – Professional certification.
  • AWS Certified Data Engineer certification.

Responsibilities

  • Develop and implement a scalable, secure, cloud-based data platform for operational data, reporting, and analytics, including a data lake, lakehouse, or data warehouse.
  • Ensure engineering work aligns with federal security requirements, judiciary architecture standards, data governance policies, and application modernization initiatives.
  • Engineer multi-tenant cloud environments that support hybrid and on-premises systems, SQL and NoSQL databases, IaaS, PaaS, distributed SQL, multimodal databases, and event-driven or streaming databases.
  • Produce and maintain dimensional data models for data marts and data products.
  • Develop and maintain downstream data marts or consumable data, associated ETL/ELT processes, and reports and dashboards for near-real-time or overnight batch use cases.
  • Maintain documentation, including source-to-target mappings, logical and physical data models, design and testing documents, and related artifacts.
  • Develop, deploy, and maintain data presentation and reporting for data products using customer-selected tools.
  • Support development of the Data and Technology Enabler Roadmap for data engineering, reporting and analytics, and AI/ML use cases.
  • Design and develop ingestion and ETL/ELT pipelines that integrate enterprise sources and support near-real-time and batch workloads.
  • Implement reusable data services for analytics, reporting, downstream data marts, and gold layers.
  • Collaborate with architects to implement logical and physical data models in cloud platforms such as Databricks.
  • Develop high-quality, testable code using secure coding standards and best practices.
  • Support implementation of CMM Data Classification Standards, including workshops, security controls, metadata requirements, and integration into system design, procurement, and training.
  • Configure metadata structures, workflows, automation, and security settings; develop ingestion processes and attribute definitions for catalog entries.
  • Create training materials, job aids, and communications to support user adoption.
  • Integrate data pipelines with cloud services, messaging, and storage components.
  • Implement data quality checks, validations, and error-handling mechanisms.
  • Optimize pipeline performance, scalability, and cost efficiency.
  • Support CI/CD deployments, automated testing, and promotion across environments.
  • Participate in code reviews, design reviews, and sprint ceremonies.
  • Support incident resolution and root-cause analysis for data pipeline failures.
  • Produce and maintain technical documentation, runbooks, and workflows, keeping technical artifacts audit-ready.
  • Ensure deliverables meet federal security, governance, and audit requirements.
  • Work in an Agile federal delivery environment across multiple scrum teams and collaborate with architects, DBAs, business analysts, and QA personnel.
  • Take accountability for code quality, performance, and delivery timelines.
  • Partner with Data Architecture, Data Governance, and Migration teams to execute data migration, archival, and disaster recovery strategies.
  • Deliver migration documentation for scripts, transformations, and validation results.
  • Support failover testing and disaster recovery drills.
  • Implement operational databases for migration, archival, disaster recovery, document storage, and indexing services, including schemas and secure data APIs; use infrastructure as code for provisioning and configuration.

Benefits

  • Comprehensive benefits and wellness packages.
  • 401(k) with company match.
  • Competitive pay and paid time off.
  • Medical plan options, including plans with Health Savings Accounts.
  • Dental and vision plan options.
  • Full flexible work weeks where possible.
  • Paid time off plans, including vacation, sick and personal time, holidays, paid parental, military, bereavement, and jury duty leave.
  • Typically 15 days of paid leave per calendar year for new employees, prorated based on hire date.
  • 10 paid holidays per year, prorated based on hire date.
  • Paid Family Leave of up to 160 hours in a rolling 12-month period for eligible employees.
  • Short- and long-term disability benefits.
  • Life, accidental death and dismemberment, personal accident, critical illness, and business travel and accident insurance, provided or available.
  • AI-powered career tool identifying career steps and learning opportunities.
  • Internal mobility team focused on career goals.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service