Lead Databricks Application Architect/Full Stack Developer

CGI•Dallas, TX

1d•Onsite

About The Position

We are seeking a highly experienced Lead Databricks Application Architect / Full Stack Developer to lead the design, development, and implementation of a new enterprise application built on the Databricks Lakehouse Platform. This role combines deep expertise in Databricks, data engineering, database architecture, application development, and technical leadership. The successful candidate will serve as the technical lead for a team responsible for delivering a modern, scalable business application that leverages Databricks as its core data and analytics platform while providing intuitive user experiences through modern front end technologies and robust APIs. The ideal candidate possesses strong hands on experience across the entire application stack, including Databricks, Spark, data modeling, API development, cloud native architecture, and front end frameworks. This individual will establish technical direction, mentor development team members, and work closely with business stakeholders to translate requirements into scalable, production ready solutions. This position is located in our Dallas, Texas office with work performed at client site in Dallas, Texas. You will be expected to be onsite 5 days/week.

Requirements

10+ years of software engineering, application development, data engineering, or solution architecture experience.
5+ years of hands on Databricks development experience in enterprise production environments.
Proven experience leading development teams and delivering large scale enterprise applications.
Expert level experience with Databricks, Apache Spark, PySpark, SQL, and Delta Lake.
Strong experience designing and developing modern application architectures.
Experience developing REST APIs, microservices, and backend services using Python, .NET, Java, or equivalent technologies.
Experience building front end applications using React, Angular, Vue.js, or similar frameworks.
Strong understanding of relational and non relational database design, data modeling, and application integration patterns.
Experience implementing security, authentication, and access controls within enterprise applications.
Experience with Azure cloud services and Azure Databricks.
Strong communication skills with the ability to interact effectively with technical and non technical stakeholders.
Bachelor's degree in Computer Science, Engineering, Information Systems, or related field.
Databricks
Delta Lake
Unity Catalog
Apache Spark
PySpark
SQL
Delta Live Tables
Databricks Workflows
Python (required)
REST API Development
Microservices Architecture
FastAPI, Flask, .NET, Java Spring Boot, or similar frameworks
Enterprise application integration
React (preferred) or Angular
TypeScript
JavaScript
HTML/CSS
Modern UI component frameworks
Azure Databricks
Azure Cloud Services
CI/CD Pipelines
Terraform
GitHub Actions or Azure DevOps
Docker and Kubernetes

Nice To Haves

Databricks Certified Data Engineer Professional certification.
Databricks Certified Developer certification.
Microsoft Azure Solutions Architect Expert certification.
Experience developing custom applications that leverage Databricks as an operational data platform.
Experience integrating Databricks with Power BI, Azure AI services, and enterprise applications.
Experience with MLflow, model serving, and AI/ML enabled applications.
Experience with Terraform, Azure DevOps, GitHub Actions, or similar DevOps platforms.
Experience with containerization technologies such as Docker and Kubernetes.
Experience with event driven architectures leveraging Azure Event Hubs, Service Bus, or Kafka.
Advanced degree in Computer Science, Engineering, Data Science, or a related field.

Responsibilities

Lead the end to end architecture, design, and implementation of a Databricks based enterprise application.
Define technical strategy, architecture standards, coding practices, and development methodologies for the project team.
Provide technical leadership for a multidisciplinary team of front end, back end, and data engineers.
Establish reusable application frameworks, design patterns, and development accelerators.
Conduct architecture reviews, code reviews, and technical quality assessments.
Collaborate with business stakeholders, product owners, and executive leadership to define solution roadmaps and priorities.
Design and implement scalable Databricks Lakehouse solutions utilizing Delta Lake, Unity Catalog, and medallion architecture patterns.
Lead development of data pipelines using Databricks, Apache Spark, PySpark, SQL, Delta Live Tables, and Databricks Workflows.
Design and optimize data models, schemas, and storage structures to support application performance and scalability.
Define and implement data governance, security, lineage, and access control standards.
Ensure high performance data processing, query optimization, and operational scalability.
Architect and develop RESTful APIs, microservices, and backend application components.
Design integration patterns connecting Databricks to enterprise applications, third party systems, and cloud services.
Develop secure, scalable backend services using Python, .NET, Java, or similar technologies.
Implement authentication, authorization, auditing, and enterprise security controls.
Design event driven and service oriented architectures where appropriate.
Lead development of modern user facing applications using technologies such as React, Angular, Vue.js, or similar frameworks.
Design responsive and intuitive user interfaces enabling business users to interact with Databricks powered data and analytics.
Work closely with UX/UI stakeholders to develop scalable and user friendly application experiences.
Implement dashboards, workflow management screens, administrative interfaces, and data visualization capabilities.
Establish front end development standards and component libraries.
Design cloud native architectures leveraging Azure Databricks and related Azure services.
Establish CI/CD pipelines, automated testing frameworks, and deployment processes.
Implement Infrastructure as Code using Terraform, Bicep, or similar tools.
Define monitoring, logging, observability, and production support processes.
Ensure application reliability, performance, and operational readiness.
Lead and mentor developers, engineers, and technical contributors.
Provide technical oversight throughout the software development lifecycle.
Facilitate technical workshops, solution reviews, and stakeholder presentations.
Collaborate with project managers and business leaders to manage delivery risks and dependencies.
Serve as the primary technical point of contact for the application development initiative.

Benefits

Competitive compensation including profit participation program
Comprehensive medical, dental, and vision benefits
Basic life and accidental death & dismemberment insurance
Matching contributions through 401(k) plan, and CGI share purchase plan
Flexibility and paid accrued vacation leave, ranging from 10 to 20 days per year, based on job level, years of relevant prior experience, and years of service
10 paid holidays per year
At least 80 consecutive hours of paid sick/safe leave (except where applicable state/local law requires more)
Paid parental leave, ranging from 20 to 70 consecutive business days based on circumstances of leave and applicable laws
Bereavement leave, ranging from 1 to 7 days per year based on relationship.
Paid jury duty leave, up to time summoned
Learning opportunities and tuition assistance
Wellness and Well being programs