About The Position
The Senior Data Engineer will design and build scalable AI-powered document-processing solutions, vector-search pipelines, and intelligent AI agents on AWS. The role focuses on Generative AI, Python, and Retrieval-Augmented Generation (RAG), including document processing, knowledge bases, and agent development. This is a C2C role lasting 3+ months, with a possible extension. The position is remote or hybrid in Los Angeles, California, and limited to candidates local to California. AWS certification is required.
Requirements
- 12+ years of data engineering experience.
- Python and SQL skills.
- Experience with AWS Step Functions, Lambda, and S3.
- Experience with Amazon Textract and Comprehend.
- Document AI/OCR experience.
- Experience with vector databases and embeddings.
- Experience with document chunking and indexing.
- Experience with advanced retrieval and reranking.
- Experience with RAG and knowledge-base integration.
- Experience with Amazon Bedrock, Claude Agent SDK, and AgentCore Runtime.
- Experience with GitHub Actions CI/CD.
- Experience with AWS IAM and API integrations.
- AWS certification is required.
- Must be local to California.
Nice To Haves
- TypeScript.
- AWS Glue.
- OpenSearch, Pinecone, or pgvector.
- LangChain or LlamaIndex.
- Terraform or AWS CDK.
Responsibilities
- Design and develop scalable data pipelines using AWS Step Functions, Lambda, S3, Textract, and Comprehend.
- Build automated document-processing workflows for structured and unstructured data.
- Implement document chunking, embeddings, vector indexing, semantic search, and RAG solutions.
- Develop and maintain vector databases and knowledge bases.
- Integrate knowledge bases with AI agents for contextual information retrieval.
- Build and deploy AI agents using Claude Agent SDK on Amazon Bedrock AgentCore Runtime.
- Develop and maintain CI/CD pipelines using GitHub Actions.
- Optimize data pipelines for scalability, security, reliability, and performance.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Upload and Match Resume
What This Job Offers
Career Level
Senior
Education Level
No Education Listed
