Senior Databricks Data Engineer

Growth Acceleration Partners • Colorado Springs, CO

1d

About The Position

Growth Acceleration Partners is seeking a Senior Databricks Data Engineer to design, build, and maintain scalable data pipelines and integrations within an Azure and Databricks ecosystem. The engineer will join a dedicated team delivering large, defined projects and integrating Databricks with modern application stacks. The role includes technical ownership of data modeling, pipeline orchestration, and data quality, with close collaboration across application development and business teams. The position operates with a high level of autonomy and uses PySpark, SQL, and Unity Catalog to deliver secure, performant, and governed data for enterprise applications.

Growth Acceleration Partners is a consulting and technology services company founded in 2007, headquartered in Austin, Texas, and described as woman-owned. It has more than 600 English-speaking engineers based in Latin America and approximately 20 engineers based in the United States. The company describes itself as values-based and focused on customer and employee success, investing in education, onsite English classes, and training in technologies including AI, data analytics, and machine learning.

The position requires a bachelor’s degree in a relevant technical field and at least five years of professional data engineering experience. The successful candidate will have hands-on Databricks, PySpark, SQL, and Delta Lake expertise, as well as experience with Azure databases, Unity Catalog, and GitHub-based CI/CD practices.

Requirements

• Bachelor’s degree in Computer Science, Data Engineering, Software Engineering, Information Systems, or a related technical field.
• At least 5 years of professional experience in Data Engineering, specializing in modern cloud data architectures.
• Hands-on experience building and maintaining complex Databricks data pipelines using PySpark and SQL.
• Deep expertise with Delta Lake architectures and implementing governance through Unity Catalog.
• Experience integrating Databricks workflows with Azure SQL or Azure Cosmos DB.
• Experience working in Git-based CI/CD environments, managing work in GitHub, and linking every pull request to a GitHub Issue.
• Strong experience in Databricks, PySpark, advanced SQL, and Delta Lake.
• Experience with Unity Catalog, including grants, lineage, and access control, and with Lakeflow Jobs.
• Experience with Databricks Asset Bundles, Git/GitHub workflows, and automated deployment strategies.
• Proven methods for data quality assurance, automated testing, and pipeline monitoring.
• Advanced English proficiency, written and verbal.
• Strong communication skills to work directly with business users and translate business needs into technical solutions.
• Ability to ramp up quickly on existing codebases and shared enterprise packages.
• Highly collaborative approach and ability to integrate with established development teams and processes.

Nice To Haves

• Experience with Databricks AI services such as Model Serving, Mosaic AI Agents, Vector Search, or Genie Spaces.
• Familiarity with Python API development using FastAPI and Pydantic.
• Exposure to financial-domain data, such as Concur expense data, 73Strings data, or fund accounting analytics.
• Experience with observability tools, including OpenTelemetry logs, spans, and metrics.

Responsibilities

• Architect, build, and maintain scalable Databricks data pipelines for existing systems and new application integrations.
• Design data models that integrate Databricks with transactional databases such as Azure SQL or Azure Cosmos DB.
• Orchestrate data pipelines and schedule workflows using Lakeflow Jobs.
• Apply data quality, testing, and monitoring standards across data engineering processes.
• Manage deployment lifecycles using Databricks Asset Bundles and Git-based CI/CD workflows.
• Collaborate with frontend and backend application developers, including React and C# .NET developers, and Product Owners to ensure data infrastructure meets application requirements.
• Operate within organizational security and governance models, using Microsoft Entra ID for access and Unity Catalog for data governance.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior