Databricks Platform Engineer

Chenega CorporationAtlanta, GA
5h$105,000 - $115,000Hybrid

About The Position

All information below subject to change based on final contract award and available funding. Come join a company that strives for Extraordinary People and Exceptional Performance! Chenega Services & Federal Solutions, LLC, a Chenega Professional Services’ company, is looking for a Databricks Platform Engineer to join our team supporting the Centers for Disease Control and Prevention (CDC). Our company offers employees the opportunity to join a team where there is a robust employee benefits program, management engagement, quality leadership, an atmosphere of teamwork, recognition for performance, and promotion opportunities. We actively strive to channel our highly engaged employee’s knowledge, critical thinking, innovative solutions for our clients. In this position, you’ll drive the next generation of our analytics products by architecting and delivering end-to-end cloud analytics solutions. In a fully cloud-native environment, you’ll partner with product managers, data scientists, software engineers, ML engineers and business analysts to enable and support a platform that powers personalized experiences and operational efficiency. You’ll leverage automated model CI/CD, containerized deployments (Docker/Kubernetes), and real-time monitoring to ensure our ML systems are reliable, secure, and scalable. You will be responsible for the design, implementation, and maintenance of the Databricks workspaces and its associated Azure infrastructure. You will manage and optimize data and machine learning workloads, ensuring a reliable, secure, and scalable platform for business analysts, data engineering and data science teams. Lead the administration and governance framework of the platform regarding the security posture of the enterprise and its key stakeholders. Design and implement automated solutions to streamline accounts and workspace administration. Collaborate with cross-functional teams to understand business needs and translate them into ML solutions. Mentor junior engineers and provide technical leadership in Databricks best practices and techniques. Conduct cost and performance analysis of the various computes and data assets within the platform. Stay current with the latest advancements in Databricks SQL, Machine Learning and AI, and integrate new technologies and methods as applicable. Engage in knowledge sharing and contribute to building a strong, collaborative team environment. Other duties as assigned

Requirements

  • 5+ years of experience with Databricks Account and Workspace Administration, including governance, configuration, and security management
  • Experience with optimizing Databricks environments for cost efficiency, performance, and reliability
  • Experience with developing and maintaining Databricks data pipelines using Autoloader, Delta Live Tables, and Databricks Workflows
  • Experience with implementing MLOps solutions using MLflow 2.0/3.0, Serving Endpoints, and Model Registry in production environments
  • Experience with Databricks SQL tools such as Queries and AI/BI Dashboards
  • Experience with large datasets and distributed computing across cloud platforms (AWS, GCP, Azure), including Azure services like Entra ID, Data Factory, Key Vault, and Purview
  • Knowledge of Unity Catalog Governance Architecture and enterprise data security best practices
  • Possession of strong communication and documentation skills with the ability to clearly convey complex technical concepts to both technical and non-technical audiences
  • Ability to obtain and maintain a Public Trust or Suitability/Fitness determination based on client requirements
  • Ability to work on-site in Atlanta, Georgia
  • Master’s degree

Nice To Haves

  • Knowledge of Azure Cloud Networking concepts like VNET Injection
  • Databricks Platform Administrator Certification
  • Microsoft Certified: Azure Administrator Associate

Responsibilities

  • Design, implementation, and maintenance of the Databricks workspaces and its associated Azure infrastructure.
  • Manage and optimize data and machine learning workloads, ensuring a reliable, secure, and scalable platform for business analysts, data engineering and data science teams.
  • Lead the administration and governance framework of the platform regarding the security posture of the enterprise and its key stakeholders.
  • Design and implement automated solutions to streamline accounts and workspace administration.
  • Collaborate with cross-functional teams to understand business needs and translate them into ML solutions.
  • Mentor junior engineers and provide technical leadership in Databricks best practices and techniques.
  • Conduct cost and performance analysis of the various computes and data assets within the platform.
  • Stay current with the latest advancements in Databricks SQL, Machine Learning and AI, and integrate new technologies and methods as applicable.
  • Engage in knowledge sharing and contribute to building a strong, collaborative team environment.
  • Other duties as assigned
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service