Senior Software Engineer

Consumer Edge•New York, NY

52d•Remote

About The Position

As a Senior Software Engineer (Infra) on the AI Products team, you’ll design and scale the infrastructure that supports AI model training, deployment, and monitoring. You’ll build pipelines, evaluation frameworks, and tooling that enable rapid iteration on AI features, ensuring reliability, cost efficiency, and security in production systems.

Requirements

7+ years of software engineering experience in ML infra or backend development.
Proficiency in Python and experience with ML/DS libraries (Pandas, TensorFlow, PyTorch).
Hands-on with Vertex AI, BigQuery, Dataflow, Dagster, and Terraform.
Familiarity with LLM tooling (Hugging Face, OpenAI SDKs).
Strong CI/CD and container skills (Docker, Kubernetes).
Effective collaboration skills and attention to system reliability.

Responsibilities

Build and operate training and inference pipelines for LLMs and ML models.
Develop and maintain evaluation and monitoring frameworks for AI performance.
Implement metrics and alerts for data drift, model quality, and latency.
Optimize infrastructure for throughput, cost, and observability.
Work closely with Data Scientists to productionize models and APIs.
Contribute to MLOps best practices for versioning, testing, and CI/CD of models.
Document architectural decisions and mentor engineers on ML system design.