Information Technology_USA - USA_Developer
About The Position
We are seeking a Senior Data Engineer / AI Engineer to design, develop, and optimize scalable data processing solutions and AI-driven applications. This role requires strong expertise in PySpark, Python, Databricks, SQL, Agentic AI frameworks, and relational databases including Oracle and SQL Server. The ideal candidate will be responsible for designing, developing, and maintaining large-scale data pipelines, building efficient ETL/ELT solutions, and optimizing Spark jobs for performance, scalability, and cost efficiency. Additionally, the role involves developing reusable data engineering frameworks, creating and maintaining data models, implementing data quality checks, and designing and developing Agentic AI solutions using LLM-based frameworks to build autonomous AI agents capable of reasoning, planning, and task execution.
Requirements
- PySpark
- Python
- Databricks
- SQL
- Agentic AI frameworks
- Relational databases including Oracle and SQL Server
- 8-10 years of experience
Nice To Haves
- Playwright
- QE Automation
- TDM
- Data Analyst
- AI and Automation
Responsibilities
- Design, develop, and maintain large-scale data pipelines using PySpark and Databricks.
- Build efficient ETL/ELT solutions to ingest, transform, and process structured and semi-structured data.
- Optimize Spark jobs for performance, scalability, and cost efficiency.
- Develop reusable data engineering frameworks and best practices.
- Create and maintain data models, data marts, and analytical datasets.
- Implement data quality checks, monitoring, and governance controls.
- Design and develop Agentic AI solutions using LLM-based frameworks.
- Build autonomous AI agents capable of reasoning, planning, and task execution.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
