Senior SWE - Python / TypeScript

Weekday AI

1d • $100 - $150 • Remote

About The Position

This is a 3-month contract role for a Senior Software Engineer supporting a client’s advanced AI development and evaluation initiatives. The engineer will use Python, TypeScript, JavaScript, or Go to build and maintain data-generation, collection, processing, and evaluation infrastructure; develop preference-data rubrics and quality criteria; review and assess data; and turn evaluation findings into clear, actionable documentation. The role involves collaborating with researchers and engineers, navigating complex software repositories, and improving the quality and consistency of evaluation processes.

The role is remote, with North America preferred and candidates in approved regions of the United States and Canada considered. Candidates must be available for at least 4 hours per day and 20 hours per week, including at least 4 hours of overlap with Pacific Standard Time. The stated start date is immediate. Compensation is $100–$150 per hour, depending on candidate quality and interview feedback.

Candidates will complete an application and screening questions, an AI-based interview, a coding challenge, an approximately 30-minute technical and cultural interview, and a final evaluation. A LinkedIn profile must be included in the resume. Candidates must not currently be employed by Microsoft and must be able to commit to the required hours and PST overlap for the full contract duration.

Requirements

• At least 5 years of professional software engineering experience with Python, particularly building and maintaining pipelines and infrastructure, or with TypeScript, JavaScript, or Go.
• Hands-on experience with preference data collection, rubric creation, or developing evaluation criteria.
• Strong understanding of software engineering principles, code quality, debugging, and maintainable system design.
• Excellent written and verbal communication skills, including the ability to explain complex technical concepts clearly and concisely.
• Strong analytical skills and the ability to make consistent, well-reasoned quality judgments.
• Ability to explain why a solution, example, or implementation meets a high quality standard.
• Ability to work independently in ambiguous environments while prioritizing execution and timely delivery.
• A LinkedIn profile included in the candidate's resume.
• Must not currently be employed by Microsoft.
• Ability to commit to at least 4 hours per day and 20 hours per week, with at least 4 hours of PST overlap, for the full contract duration.

Nice To Haves

• Experience contributing to or navigating large-scale, complex open-source codebases, such as VS Code.
• Experience building data pipelines, developer infrastructure, or automated evaluation systems.
• Background in AI model evaluation, preference data workflows, data annotation, or quality assessment.
• Experience collaborating with AI researchers, machine learning engineers, or multidisciplinary technical teams.
• Education from a leading university or professional experience at a highly regarded technology company.
• Candidates from leading technology companies and top-tier universities are strongly preferred.

Responsibilities

• Design, refine, and iterate on rubrics, evaluation frameworks, and quality criteria for preference data.
• Review, assess, and label data, identifying subtle inconsistencies, quality issues, and opportunities for improvement.
• Build, maintain, and optimize pipelines and infrastructure supporting data generation, collection, processing, and evaluation workflows.
• Synthesize findings from data analysis and evaluation activities into concise reports, updates, recommendations, and actionable summaries.
• Collaborate with researchers and engineers to translate qualitative judgments into structured, repeatable, and scalable processes.
• Understand, contribute to, and maintain complex software repositories while ensuring code quality, reliability, and performance.
• Identify workflow inefficiencies and implement practical improvements to data quality, evaluation consistency, and engineering processes.

What This Job Offers

• Career Level: Senior
• Education Level: No Education Listed