Analytics Data science and IOT Engineer
About The Position
Your key responsibilities • Design, build, and maintain efficient, reusable, and scalable ETL/ELT pipelines for structured and unstructured data. • Develop and optimize data workflows to support advanced analytics, machine learning models, and reporting tools. • Collaborate with data scientists, analysts, and business stakeholders to gather requirements and ensure data quality and availability • Work with cloud and on-prem data platforms (e.g., AWS, Azure, GCP, Hadoop, or on-prem SQL/NoSQL systems). • Develop and maintain LLM- and RAG-based AI agents using Azure OpenAI, LangChain/Semantic Kernel, and Azure ML. • Design, build, and maintain data and AI pipelines in production. • Ensure data integrity, governance, and security best practices across pipelines and data lakes/warehouses. • Troubleshoot and resolve data issues and performance bottlenecks in real-time and batch pipelines. • Monitor job performance and implement automation and alerting for data operations. • Contribute to documentation, code reviews, and development best practices
Responsibilities
- Design, build, and maintain efficient, reusable, and scalable ETL/ELT pipelines for structured and unstructured data.
- Develop and optimize data workflows to support advanced analytics, machine learning models, and reporting tools.
- Collaborate with data scientists, analysts, and business stakeholders to gather requirements and ensure data quality and availability
- Work with cloud and on-prem data platforms (e.g., AWS, Azure, GCP, Hadoop, or on-prem SQL/NoSQL systems).
- Develop and maintain LLM- and RAG-based AI agents using Azure OpenAI, LangChain/Semantic Kernel, and Azure ML.
- Design, build, and maintain data and AI pipelines in production.
- Ensure data integrity, governance, and security best practices across pipelines and data lakes/warehouses.
- Troubleshoot and resolve data issues and performance bottlenecks in real-time and batch pipelines.
- Monitor job performance and implement automation and alerting for data operations.
- Contribute to documentation, code reviews, and development best practices
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Education Level
No Education Listed
