Sr. Data Engineer (GenAI & AWS) Remote/Hybrid with Travel

Simple Solutions • Jacksonville, FL

3d

About The Position

The Senior Data Engineer will design and develop AWS data pipelines and automated document-processing workflows for structured and unstructured data. The role includes implementing document chunking, embeddings, vector indexing, and semantic search; developing vector databases and knowledge bases to support Retrieval-Augmented Generation (RAG); and integrating knowledge bases with AI agents for contextual information retrieval. The engineer will build AI agents using the Claude Agent SDK and deploy them on Amazon Bedrock AgentCore Runtime, and develop GitHub Actions CI/CD pipelines for builds, testing, and deployments. Pipelines must be optimized for scalability, reliability, security, and performance.

The position is remote or hybrid, with the employee located in a western U.S. time zone and comfortable traveling to client sites for workshops and meetings. The posting lists 12–20+ years of overall experience. It identifies Python, SQL, AWS services, document AI, vector databases, RAG, Amazon Bedrock, GitHub Actions, and related technologies among the role’s must-have and good-to-have skills. The posting notes that Claude Agent SDK and AgentCore Runtime should be considered must-haves if the person is expected to personally build and deploy the Claude agents.

Requirements

• 12–20+ years of overall experience.
• Python and SQL.
• AWS Step Functions, Lambda, and S3.
• Amazon Textract and Comprehend.
• Document AI / OCR.
• Vector databases and embeddings.
• Document chunking and indexing.
• RAG and knowledge-base integration.
• Amazon Bedrock.
• GitHub Actions CI/CD.
• AWS IAM and API integrations.
• Located in a western U.S. time zone.
• Comfortable traveling to client sites for workshops and meetings.

Nice To Haves

• TypeScript.
• AWS Glue.
• OpenSearch, Pinecone, or pgvector.
• Advanced retrieval and reranking.
• LangChain or LlamaIndex.
• Terraform or AWS CDK.
• Claude Agent SDK and AgentCore Runtime, unless the person must personally build and deploy the Claude agents, in which case the posting says to treat these as must-haves.

Responsibilities

• Design and develop data pipelines using AWS Step Functions, Lambda, S3, Textract, and Comprehend.
• Build automated document-processing workflows to extract, transform, and process structured and unstructured data.
• Implement document chunking, embeddings, vector indexing, and semantic search.
• Develop and maintain vector databases and knowledge bases to support RAG.
• Integrate knowledge bases with AI agents for contextual information retrieval.
• Build AI agents using the Claude Agent SDK and deploy them on Amazon Bedrock AgentCore Runtime.
• Develop CI/CD pipelines using GitHub Actions to automate builds, testing, and deployments.
• Optimize data pipelines for scalability, reliability, security, and performance.
• Travel to client sites for workshops and meetings.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed