Sr. Data Engineer
About The Position
We are seeking an experienced and passionate Senior Data Engineer to join our Data Platform team. You will be joining a small team responsible for architecting, building, and maintaining the scalable, enterprise-grade data systems that power our data products and capabilities. You’ll straddle the worlds of DataOps, MLOps, and Infrastructure, enabling both the next generation of analytics functionality and an AI Platform to fuel our AI-driven product innovation. Since data engineers are responsible for their pipelines at Over-haul, this role requires engineers to take ownership of the operational excellence in their domain. In addition, the ideal candidate will have excellent data intuition and share our passion for continuously improving how we handle streaming data at Over-haul. This position is based in Austin, Texas, but remote work is available.
Requirements
- Mastery over Python programming language and SQL.
- Strong background in at least one of the following: distributed data processing or software engineering of data services.
- Familiar with big data technologies like Spark and comfortable working with web-scale datasets.
- Passionate about the end-to-end software development lifecycle, focusing on automation, testing, CI/CD, and documentation.
- Eye for detail, good data intuition, and a passion for data quality.
- Comfortable working in a rapidly changing environment with ambiguous requirements. Nimble and take intelligent risks.
- Experience with Cloud based Data Lake Tools
- Experience with designing and implementing data pipelines
- Python and SparkSQL/Spark experience
Nice To Haves
- Azure Data Tools, such as Data Lake, Synapse, or Fabric
- Power BI Experience
Responsibilities
- Design and maintain streaming data pipelines using Databricks, and Spark
- Create ML Pipelines to feed data and update a variety of models.
- Develop ML models to enhance predictive analytics capabilities and support decision-making processes across various departments.
Benefits
- Top employee health and well- being benefits
- Care giver/adoption/family leave
- Flexible Time Off Policy
- Casual dress
- Perks and discounts through employee assistance program
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
Associate degree
