Software Engineer III - Python, Databricks and AWS

JPMorgan Chase & Co. • Jersey City, NJ

1d • $137,750 - $185,000

About The Position

As a Software Engineer within JPMorgan Chase’s Corporate Technology – Global Finance Technology, you will be a seasoned member of an agile team enhancing, building, and delivering secure, stable, and scalable data collection, storage, access, and analytics solutions. As a core technical contributor, you will maintain critical data pipelines and architectures across technical areas and business functions in support of the firm’s objectives.

The role focuses on AWS-hosted Databricks Lakehouse engineering, including resilient batch and streaming ingestion, maintainable and tested pipelines, production operations, data governance, performance and cost management, and CI/CD and infrastructure as code. You will also use enterprise-authorized AI-assisted development tools responsibly, validate generated outputs, and share effective practices with the team.

Requirements

• Formal training or certification in software engineering concepts.
• At least 3 years of hands-on Software Development Life Cycle experience.
• Data engineering experience building and maintaining data pipelines.
• Hands-on experience building and operating an AWS-hosted Databricks Lakehouse.
• Experience with Delta Lake, including ACID tables, partitioning, and schema evolution.
• Proven experience with Spark on Databricks, including performance tuning, cluster sizing, skew mitigation, joins, caching, and file sizing.
• Experience with streaming and batch pipelines, including Structured Streaming, incremental processing, backfills, and late-arriving data.
• Strong AWS data-platform fundamentals, including S3, IAM, KMS, VPC and security-group basics, logging, and auditing.
• Experience implementing data governance and security controls in Databricks, such as Unity Catalog, table and column permissions, and credential passthrough patterns as applicable.
• Experience with reliability practices, including monitoring and alerting, incident response, root cause analysis, and SLO/SLA management.
• Understanding of responsible AI use in engineering workflows, including data sensitivity, secure handling of inputs and outputs, and resilience and security expectations; ability to guide peers on safe usage.
• Hands-on experience with enterprise-authorized AI-assisted software development tools, with the ability to evaluate, validate, and refine AI-generated outputs for correctness, performance, and security.

Nice To Haves

• Familiarity with modern front-end technologies.
• Exposure to cloud technologies.

Responsibilities

• Implement resilient, large-scale batch and streaming ingestion from AWS sources into Databricks, including change data capture where needed.
• Build modular, maintainable data pipelines using Delta Live Tables and/or standard Databricks Jobs, with testing and documentation.
• Productionize workloads using Databricks Workflows or Jobs, retries, checkpointing, idempotency, and safe reruns.
• Apply governance and security controls, including least privilege, PII classification, auditing, lineage and metadata, and controlled data sharing and consumption.
• Tune Spark and Delta workloads, right-size clusters, optimize storage layouts, and manage job and warehouse costs.
• Use Terraform where appropriate for Databricks and AWS infrastructure, and promote changes across environments.
• Create and maintain unit and integration tests, data quality checks, contract tests, and replay and backfill procedures.
• Follow version control and code review practices and maintain clear documentation and runbooks.
• Use enterprise-authorized AI coding-assistance tools to improve code quality, delivery speed, and productivity, while validating outputs through peer review, automated testing, and secure coding standards.
• Contribute learnings and reusable AI-assisted development patterns to improve team effectiveness.
• Apply knowledge of SDLC toolchain capabilities, including authorized AI-assisted development and automation tools, to improve the value of automation.

Benefits

• Competitive total rewards package, including base salary determined by role, experience, skill set, and location.
• Eligible roles may receive commission-based pay and/or discretionary incentive compensation in cash and/or forfeitable equity.
• Comprehensive health care coverage.
• On-site health and wellness centers.
• Retirement savings plan.
• Backup childcare.
• Tuition reimbursement.
• Mental health support.
• Financial coaching.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed