Databricks Platform Architect

Guidehouse•Arlington, VA

7d•$113,000 - $188,000

About The Position

Architect and manage Databricks clusters, workspaces, and integrations with cloud services (Azure/AWS/GCP). Implement CI/CD pipelines for Databricks notebooks and jobs. Optimize cluster configurations for cost and performance. Ensure compliance with security and governance standards. Collaborate with data engineers and scientists to support data pipelines and ML workflows. Conduct ETL and data quality analysis using various technologies (i.e., Python, Databricks). Maintain good working relationships with accounts/clients to enhance customer satisfaction. Ensure data governance and quality assurance standards are met. Organize and lead meetings, including scheduling meetings; drafting and delivering agendas and meeting minutes; providing and archiving required documentation; and documenting, tracking, and following up on action items. Summarize and present information and reports to the team and make recommendations (both oral and written).

Requirements

Bachelor’s degree from an accredited college/university.
Must be able to OBTAIN and MAINTAIN a Federal or DoD "PUBLIC TRUST"; candidates must obtain approved adjudication of their PUBLIC TRUST prior to onboarding with Guidehouse.
Based on our contractual obligations, candidate must be located within the United States and US Citizen.
Minimum SEVEN (7) years of total experience in cloud-based data platforms.
Minimum FIVE (5) years experience with Databricks.
Strong knowledge of Spark architecture and distributed computing.
Hands-on experience with Terraform or other IaC tools.
Experience with Unity Catalog and Delta Lake.
Familiarity with Kubernetes and container orchestration.
Strong scripting skills (Python, Bash).
Excellent problem-solving skills and attention to detail.
Strong communication and collaboration skills, with the ability to work effectively in a team environment.

Nice To Haves

Master’s degree.
Databricks Certified Data Engineer Professional.
Azure/AWS/GCP Cloud Architect or Administrator.
Terraform Associate.
Experience working with system and application logs.
Experience with the design and build of ETL programs, interfaces, and data reconciliation processes, preferably in Databricks.
Candidates with an ACTIVE PUBLIC TRUST or SUITABILITY are preferred.

Responsibilities

Architect and manage Databricks clusters, workspaces, and integrations with cloud services (Azure/AWS/GCP).
Implement CI/CD pipelines for Databricks notebooks and jobs.
Optimize cluster configurations for cost and performance.
Ensure compliance with security and governance standards.
Collaborate with data engineers and scientists to support data pipelines and ML workflows.
Conduct ETL and data quality analysis using various technologies (i.e., Python, Databricks).
Maintain good working relationships with accounts/clients to enhance customer satisfaction.
Ensure data governance and quality assurance standards are met.
Organize and lead meetings, including scheduling meetings; drafting and delivering agendas and meeting minutes; providing and archiving required documentation; and documenting, tracking, and following up on action items.
Summarize and present information and reports to the team and make recommendations (both oral and written).

Benefits

Medical, Rx, Dental & Vision Insurance
Personal and Family Sick Time & Company Paid Holidays
Position may be eligible for a discretionary variable incentive bonus
Parental Leave and Adoption Assistance
401(k) Retirement Plan
Basic Life & Supplemental Life
Health Savings Account, Dental/Vision & Dependent Care Flexible Spending Accounts
Short-Term & Long-Term Disability
Student Loan PayDown
Tuition Reimbursement, Personal Development & Learning Opportunities
Skills Development & Certifications
Employee Referral Program
Corporate Sponsored Events & Community Outreach
Emergency Back-Up Childcare Program
Mobility Stipend