Data Operations Engineer / DataOps Specialist (AI + LLM)
TCS•Philadelphia, PA
About The Position
We are seeking a Data Operations Engineer / DataOps Specialist with expertise in AI and LLMs to build, manage, and monitor ETL/ELT pipelines. This role involves ensuring smooth data flow, automating workflows, and implementing data quality and governance standards. You will be responsible for monitoring systems, resolving issues, optimizing infrastructure, and supporting CI/CD for data systems using DataOps practices.
Requirements
- Python
- LangChain
- LangGraph
- VectorDB
- LLM's
- Pl-SQL with ETL tools
- Big Data tools (Spark, Hadoop)
- Cloud Platforms (AWS / Azure / GCP)
- Data Modeling & Data Architecture
- APIs & Data Integration
- CI/CD & Automation tools
- DataOps Core Skills
- Pipeline orchestration & automation
- Data quality frameworks
- Monitoring & observability (logs, alerts)
- Data governance & lineage
- Batch & real-time processing
- Analytics & BI Tableau / Power BI
- Data visualization & reporting
- KPI and dashboard development
Responsibilities
- Build, manage, and monitor ETL/ELT pipelines for data ingestion and transformation
- Ensure smooth data flow across systems, warehouses, and applications
- Automate workflows and reduce manual data handling
- Implement data validation, cleansing, and reconciliation processes
- Maintain data integrity, consistency, and accuracy across systems
- Define and enforce data governance standards and policies
- Monitor pipelines and data systems for failures and anomalies
- Perform root cause analysis and corrective actions
- Ensure SLA adherence for data availability
- Manage data platforms (AWS/Azure/GCP, Data Lakes, Warehouses)
- Optimize performance, scalability, and cost efficiency
- Support CI/CD for data systems (DataOps practices)
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Upload and Match Resume
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
