Databricks Engineer - Data Engineer II
About The Position
As a Data Engineer II on Deloitte’s AI & Engineering team, you will develop and optimize data pipelines using Python, PySpark, and SQL within the Databricks Lakehouse platform. You will apply Medallion architecture patterns to organize, transform, and manage data across layers; tune Databricks workloads and SQL queries; configure security and manage data lineage and sharing in Unity Catalog; and implement CI/CD and testing processes for Databricks workflows. The role is part of Deloitte’s Government & Public Services practice, serving federal, state, and local government clients and public higher education institutions. Deloitte’s AI & Data offering designs, develops, and operates data and AI platforms, products, insights, and services. The position is available in Baltimore, Maryland; Rosslyn, Virginia; and Washington, District of Columbia. Average travel is 10–15%, depending on the work and clients served. The estimated wage range is $97,700 to $162,800, and the role may also be eligible for a discretionary annual incentive program.
Requirements
- Bachelor’s degree.
- Ability to obtain and maintain the required clearance for the role.
- At least 2 years of Databricks engineering experience.
- At least 2 years of experience with Python, PySpark, and SQL.
- Ability to travel 10–15%, on average, based on the work and clients served.
- Must be legally authorized to work in the United States without employer sponsorship now or in the future.
- Ability to work independently and collaboratively.
- Effective written and verbal communication skills.
- Meticulous attention to detail and quality of work product.
- Ability to build and sustain professional relationships.
- Strong interpersonal skills and professional demeanor.
- Ability to manage and prioritize multiple tasks in a fast-paced and dynamic environment.
- Ability to meet deadlines and provide clear guidance to others.
Nice To Haves
- Experience using Medallion architecture in the Databricks Lakehouse platform.
- Experience configuring row-level and column-level security, data lineage, and data sharing in Unity Catalog.
- Experience implementing CI/CD and testing processes for Databricks.
- Experience with performance tuning in Databricks.
Responsibilities
- Develop and optimize data pipelines using Python, PySpark, and SQL within the Databricks Lakehouse platform.
- Apply Medallion architecture patterns to organize, transform, and manage data across data layers.
- Perform performance tuning for Databricks workloads and SQL queries.
- Configure row-level and column-level security and manage data lineage and sharing in Unity Catalog.
- Implement CI/CD and testing processes for Databricks workflows.
- Lead projects or workstreams and provide clear guidance to others.
- Manage and prioritize multiple tasks and meet deadlines in a fast-paced, dynamic environment.
Benefits
- Broad range of employee benefits; specific benefits are not listed in the posting.
- Opportunities for professional development, including on-the-job learning, formal development programs, leadership opportunities, and mentorship.
- Potential eligibility to participate in a discretionary annual incentive program, subject to program rules and applicable factors.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
