Databricks Developer

Sloan•Franklin Park, IL

2d•Hybrid

About The Position

The Databricks Developer is located at our Franklin Park, IL office and reports to the Director of Enterprise Applications and Data Analytics in Information Technology. The Databricks Developer will build and modernize cloud-based data platforms using Databricks. This role requires strong expertise in data migration, ELT processes, data security, SQL, and Apache Spark, with experience across AWS, Azure, and GCP. The position supports data integration, analytics, and visualization initiatives, partnering with technical and business stakeholders to deliver scalable, value-driven solutions. The ideal candidate is highly analytical, detail-oriented, and an effective communicator who can lead initiatives, prioritize tasks, and contribute to high-performing teams.

Requirements

Bachelor's Degree in Engineering, Information Technology, Computer Science, or a related field from an accredited college or university.
4+ Years Focused on the Databricks platform
Strong proficiency in Apache Spark (PySpark and/or Spark SQL)
5+ Years Data engineering experience
Ability to prioritize tasks, delegate responsibilities, and develop high-performing teams in a customer-focused, collaborative environment.
Excellent verbal and written communication skills, with the ability to collaborate effectively across multiple levels of responsibility and leadership.
Experience designing and implementing solutions on AWS, Azure, or GCP, along with strong hands-on skills in SQL and Apache Spark.
Hands-on expertise in data security, messaging patterns, ELT processes, data wrangling, and cloud computing.
Proficiency in data integration/EAI, database technologies, advanced analytics tools, programming languages, and visualization platforms.
Highly analytical, detail-oriented, and self-motivated, with a strong sense of urgency.
Quick learner who continuously builds technical expertise to support the deployment and integration of Databricks-based solutions for customer projects.
Proven experience leading cloud modernization, data migration, and data warehousing initiatives using cloud-based platforms such as Databricks.

Nice To Haves

Experience facilitating technical workshops with both technical and business stakeholders to identify opportunities and deliver value-driven solutions is highly desirable.
Databricks certification preferred
Expertise in Business Analytics design and development, along with familiarity with best-in-class systems and tools used for platform solutions.
Solid, practical, hands-on understanding of a business area as well as an overall understanding of company systems and business processes.
Strong skills in effective communications, change enablement, and business process redesign.

Responsibilities

Design, develop, and maintain scalable data pipelines and ELT/ETL workflows using Databricks and Apache Spark (PySpark/Spark SQL)
Build and optimize lakehouse architectures using Delta Lake and related data formats (e.g., Parquet, Iceberg)
Develop production-grade data workflows using Databricks Workflows and/or Declarative Pipelines
Implement data governance, security, and access controls using Unity Catalog and related frameworks
Support data migration and modernization initiatives from legacy data warehouse systems to cloud-based architectures
Apply medallion architecture principles (bronze, silver, gold layers) in solution design
Implement CI/CD pipelines and infrastructure-as-code for Databricks environments (e.g., Terraform, Databricks Asset Bundles, GitHub Actions)
Monitor, troubleshoot, and resolve production data pipeline issues to ensure reliability and performance
Collaborate with stakeholders to gather requirements and translate them into scalable data solutions
Participate in code reviews, testing, documentation, and deployment activities
Contribute to continuous improvement of data engineering standards, tools, and best practices
Provide technical support during solution implementation and stabilization phases
Other duties and responsibilities as required.