Information Technology_USA - USA_Senior Data Scientist
About The Position
We are seeking a Senior Data Scientist with over 15 years of hands-on experience in data engineering, specifically focusing on Databricks. This role involves independently designing, building, and maintaining complex, production-grade data pipelines on Databricks. You will develop efficient ETL/ELT processes with a strong emphasis on data quality, consistency, and scalability, and build reusable frameworks for ingestion, transformation, and reconciliation across enterprise source systems. The position requires applying and improving engineering standards, including pipeline architecture, coding standards, and ETL/ELT best practices. You will work within an Agile delivery/Kanban methodology, collaborating with product and business partners to define roadmaps, communication strategies, architecture, adoption plans, and support models. Experience with real-time data and streaming applications, data modeling for data warehousing, and cloud platforms like AWS or Azure is essential.
Requirements
- 15+ years of hands-on experience in data engineering with a focus on Databricks.
- Strong hands-on background in Databricks, Python (PySpark), and SQL for large-scale data processing, incremental data loads, and metadata-driven ingestion and data quality frameworks using PySpark.
- Working knowledge of CI/CD pipelines, Git-based branching strategies, and DevOps practices.
- Experience working on real-time data and streaming applications.
- Experience with data modeling for data warehousing.
- Experience in AWS or Azure cloud.
Nice To Haves
- Databricks Data engineering certification
Responsibilities
- Independently design, build, and maintain complex, production-grade data pipelines on Databricks.
- Develop efficient ETL/ELT processes with a strong focus on data quality, consistency, and scalability.
- Build reusable frameworks for ingestion, transformation, and reconciliation across enterprise source systems.
- Apply and help improve engineering standards — pipeline architecture, coding standards, and ETL/ELT best practices.
- Work within an Agile delivery / Kanban methodology to deliver product increments in iterative cycles.
- Work with product and business partners to define roadmap, communication, architecture, adoption plans, and support models.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
