Sr. Data Engineer w/Datbricks and Salesforce experince - Hybrid - Philly, PA

TekCommands•Philadelphia, PA

5d•Hybrid

About The Position

The Senior Data Engineer will focus on high-impact activities to drive the Salesforce Phase 2 forward and support long-term success of the project. Primary responsibilities and areas of work includes: Development of ETL jobs bringing Data into Databricks, Data Migration and Integration between Salesforce and Databricks and Pipeline development (Mulesoft work), Documentation, Testing and Quality Assurance, Post-Delivery Support, Risk Mitigation/ address SPOF. Work with the team to understand requirements and turn them into working data pipelines. Build, test, and maintain pipelines on AWS + Databricks. Use Terraform to spin up and manage infrastructure. Set up and run CI/CD pipelines (Concourse or GitHub Actions) so our deployments are smooth and repeatable. Troubleshoot issues, fix things quickly, and keep pipelines running reliably. Collaborate with other engineers to share knowledge and improve best practices.

Requirements

Databricks experience
Salesforce experience
AWS + Databricks pipeline experience
Terraform experience
CI/CD pipeline experience (Concourse or GitHub Actions)

Responsibilities

Development of ETL jobs bringing Data into Databricks
Data Migration and Integration between Salesforce and Databricks
Pipeline development (Mulesoft work)
Documentation
Testing and Quality Assurance
Post-Delivery Support
Risk Mitigation/ address SPOF
Work with the team to understand requirements and turn them into working data pipelines
Build, test, and maintain pipelines on AWS + Databricks
Use Terraform to spin up and manage infrastructure
Set up and run CI/CD pipelines (Concourse or GitHub Actions)
Troubleshoot issues, fix things quickly, and keep pipelines running reliably
Collaborate with other engineers to share knowledge and improve best practices