ETL/Data Engineer
About The Position
Orion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity. We work with a wide range of clients across many industries including financial services, professional services, telecommunications and media, consumer products, automotive, industrial automation, professional sports and entertainment, life sciences, ecommerce, and education. Role Summary: We are seeking a Technical ETL Lead to design, build, and manage scalable data pipelines and modern data platforms using Databricks and cloud-based data lakes. This role will play a critical part in delivering data solutions that support analytics, reporting, and AI initiatives.
Requirements
- 8+ years in Data Engineering / ETL development
- 2–3+ years in a lead or senior technical role
- Strong experience with Azure Databricks (Spark, PySpark)
- Strong experience with Data Lakes (Azure Data Lake Storage)
- Strong experience with ETL/ELT frameworks and distributed data processing
- Strong experience with SQL, Python (preferred), and data modeling
- Strong experience with Azure ecosystem (ADF, Synapse, Databricks)
- Strong experience with CI/CD pipelines for data workflows
- Strong experience with Data governance and monitoring tools
- Strong problem-solving and communication skills
- Ability to translate business needs into technical solutions
Nice To Haves
- Large-scale enterprise data platform implementation
- Experience with real-time streaming (Kafka/Event Hub)
- Familiarity with AI/ML pipelines and advanced analytics
- Experience in regulated/audit environments
Responsibilities
- Lead design and implementation of ETL/ELT pipelines on cloud platforms
- Drive best practices for scalable, reliable, and high-performance data solutions
- Provide technical leadership and mentoring to data engineers
- Build and optimize data pipelines using Azure Databricks
- Design and manage Data Lake architectures (Lakehouse preferred)
- Develop reusable frameworks for ingestion, transformation, and orchestration
- Define data models, integration patterns, and storage strategies
- Ensure data quality, governance, and security across pipelines
- Optimize performance and cost across large-scale data processing systems
- Work with business, analytics, and application teams to define data requirements
- Partner with cloud, DevOps, and architecture teams for platform integration
- Incorporate automation, AI/ML pipelines, and agentic workflows
- Build intelligent data pipelines with monitoring and self-healing capabilities
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
