Application Developer

TOS • Cupertino, CA

1d • Remote

About The Position

We are seeking a Senior Backend Software Developer to join the AI team. The system uses LLMs, Python FastAPI, and document extraction for unstructured document processing in NER applications. The developer will contribute to backend development by building new features, improving system reliability, and collaborating with a small agile team. The role is a 3-month contract and is remote.

Requirements

• At least 5 years of professional software development experience.
• Strong proficiency in Python 3.10, FastAPI, and async/await patterns.
• Strong proficiency in PostgreSQL, including schema design, query optimization, and migrations.
• Experience integrating with LLM APIs such as OpenAI and Azure OpenAI, and building AI-powered features.
• Experience building test suites, golden data sets, and LLM evaluation.
• Some familiarity with LLM components such as tokenization and caching.
• Strong code quality practices, including type annotations, linting, and automated testing.
• Excellent communication skills and ability to work independently in a distributed team.

Nice To Haves

• Ability to build an agent harness from scratch.
• Ability to explain each component of an LLM and how it works.
• Familiarity with Pydantic, dependency injection patterns, and repository-pattern architectures.

Responsibilities

• Work with PostgreSQL for database operations, including schema design and query optimization.
• Integrate with Azure OpenAI and embedding models for LLM-powered features.
• Architect and design LLM evaluation, prompt optimization, and drift detection.
• Write clean, strongly typed, production-ready Python code.
• Write unit and integration tests using pytest, maintain high coverage, and participate in code reviews.

What This Job Offers

• Career Level: Senior
• Education Level: No Education Listed