AWS Databricks Developer

TalentOla • Austin, TX

3d • Hybrid

About The Position

As an AWS Databricks Developer, you will be part of an Agile team to build healthcare applications and implement new features while adhering to the best coding development standards. You will drive end-to-end data engineering initiatives in an Agile environment. Collaborate with business and technical stakeholders to understand requirements and translate them into scalable data solutions. Design, document, and implement cloud-native data architectures and engineering solutions. Develop high-performance ETL/ELT pipelines using Spark and PySpark. Build and optimize data ingestion, transformation, and loading processes for enterprise-scale data platforms.

Requirements

• Strong expertise in Databricks, Spark/PySpark, Teradata, AWS, and DevOps practices
• Databricks (Delta Lake, Notebooks, Pipelines, Cluster Management)
• Teradata SQL Development (Teradata SQL, Hive SQL, Spark SQL)
• Shell Scripting (Unix/Linux, KSH)
• AWS Cloud Services (S3, EC2, Lambda, Glue, SNS, SQS, ECS, IAM, CloudWatch)
• Data Warehouse & Data Lake Implementation
• CI/CD & DevOps Tools (Git, Jenkins, Artifactory)
• Agile Methodologies
• Databricks
• PySpark
• Ab Initio
• Teradata
• AWS
• Healthcare

Nice To Haves

• Jira & Confluence
• Healthcare Domain Experience
• Enterprise Scheduling Tools (CA7)
• Cloud Data Migration & Modernization
• Azure/AWS Integration Experience
• Technical certification in multiple technologies is desirable.

Responsibilities

• Drive end-to-end data engineering initiatives in an Agile environment.
• Collaborate with business and technical stakeholders to understand requirements and translate them into scalable data solutions.
• Design, document, and implement cloud-native data architectures and engineering solutions.
• Develop high-performance ETL/ELT pipelines using Spark and PySpark.
• Build and optimize data ingestion, transformation, and loading processes for enterprise-scale data platforms.
• Production Support & Monitoring

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: Associate degree