Sr. Data Platform Engineer

FERRY INTERNATIONAL LLC • Dallas, TX

15h • $130,000 - $145,000

About The Position

Ferry International is seeking a Sr. Data Platform Engineer to own the systems that support their AI applications. This role involves building and maintaining the data pipelines, retrieval systems, AWS infrastructure, and memory/evaluation systems necessary for AI products. It's a hands-on builder role focused on transforming validated ideas into reliable, scalable production systems, offering significant ownership and the chance to shape the technical foundation of next-generation AI products.

Requirements

• 5 to 8 years of relevant engineering, data engineering, infrastructure, or related experience.
• Strong Python and SQL skills with hands-on experience building data pipelines using PostgreSQL.
• Experience with vector databases or vector search technologies such as pgvector.
• Strong AWS experience, including services such as ECS, Fargate, RDS, and S3.
• Experience with containers, CI/CD, infrastructure as code, and cloud operations.
• Experience building data infrastructure supporting machine learning or LLM applications.
• Hands-on experience with embeddings and retrieval systems.
• Working familiarity with LangGraph or the LangChain ecosystem.
• Experience building observability, monitoring, dashboards, and alerting for production systems.
• Strong understanding of system reliability, scalability, security, and cost management.
• Ability to take validated modeling and transform it into production-grade systems.
• Strong communication and collaboration skills.

Nice To Haves

• Experience with Model Context Protocol (MCP) or similar tool calling interfaces.
• Experience with LLM evaluation and observability tools, including LLM as judge systems, tracing, and regression suites.
• Experience with TypeScript and React for internal dashboards or administrative tools.
• Experience working with AI products or agent-based applications.

Responsibilities

• Build and maintain production-ready data and machine learning pipelines that transform validated modeling into reliable systems.
• Own ingestion, cleaning, embeddings, scoring, and processing across coaching transcript data.
• Solve real-world data problems including mixed storage formats, missing records, historical data, and backfill requirements.
• Own the data corpus and retrieval layer from end to end.
• Modernize embedding infrastructure and consolidate vector storage to improve performance and reliability.
• Ensure retrieval is properly scoped and isolated for each client.
• Own how AI systems are deployed, operated, monitored, and scaled.
• Build and maintain containerized deployments, CI/CD pipelines, infrastructure as code, environments, observability, alerting, and cost monitoring across AWS.
• Create infrastructure that is reliable, secure, scalable, and cost-effective.
• Build dashboards and monitoring systems to understand system performance and identify issues.
• Build durable state, client memory, and retrieval layers that support AI agent applications.
• Create systems that allow client profiles, commitments, history, and other important information to persist across interactions and over time.
• Make AI memory systems fast, reliable, observable, and scalable.
• Turn established evaluation criteria and benchmark data into automated systems that measure AI performance at scale.
• Build automated evaluations that can run through CI and help determine whether new releases are ready for production.
• Develop regression testing and monitoring processes to identify performance issues and maintain quality.
• Build and maintain appropriate systems for retention, access control, encryption, and data security.
• Develop a clean and reliable process for removing client information when requested.
• Help ensure AI infrastructure is built with security, privacy, and responsible data management in mind.

Benefits

• Joining a fast-moving, high-accountability team that values ownership, collaboration, and building things that matter.
• An environment where good ideas can come from anywhere.
• Technical challenges are encouraged.
• Opportunity to make a meaningful impact on the systems behind next-generation products.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed