Senior Software Development Engineer - LLMs, GenAI

CVS Health•New York, NY

23h•$101,970 - $203,940

About The Position

This Senior Software Development Engineer is a highly experienced technical leader responsible for designing, developing, and scaling AI-powered products, platforms, and services. This role combines software engineering expertise with foundational knowledge of artificial intelligence, machine learning and generative artificial intelligence. Develop and implement application solutions and systems by applying advanced technical expertise to architect and code software applications, conduct system testing and debugging, collaborate with cross-functional teams, and contribute to the overall technical direction and innovation of application engineering products. The engineer drives the technical direction of complex initiatives, influences engineering strategies across organizations, and delivers intelligent solutions that improve customer experience, operational efficiency, and business outcomes. Success in this role requires strong technical judgment, collaboration across disciplines, and the ability to translate emerging AI technologies into production-ready systems.

Requirements

5+ years’ work experience
Adept at problem solving and decision-making skills
Adept at collaboration and teamwork
Adept at growth mindset (agility and developing yourself and others) skills
Adept at execution and delivery (planning, delivering, and supporting) skills
Adept at design and delivery of large-scale engineering projects with significant organizational impact
Adept at technical reviews, design discussions, and strategic technology decisions
Adept at mentoring engineers and providing guidance on AI engineering, software architecture, and technical problem-solving
Adept at translating customer requirements and business objectives into scalable technical solutions
Python/Java: Deep fluency in Python; familiarity with secondary languages like TypeScript, JavaScript or Java
AI/ML Frameworks: Experience with PyTorch, TensorFlow, Hugging Face, and/or Pandas
APIs & Architecture: Building and consuming RESTful APIs, microservices and containerization tools like Docker and Kubernetes
Exposure to Cloud platforms and technologies such as Lambda, ECS, S3, RDS, and/or CloudWatch
Experience in source control such as GIThub, Azure Repo, etc…
SQL

Nice To Haves

Exposure to automation tools such as UiPath, Playwright, Selenium and/or Cypress
Exposure to data analytic tools such as Power BI
Exposure to Power Automate
Exposure to Generative AI
Exposure Large Language Models (GPT, Claude, Gemini, Llama, etc.)
Exposure to Machine Learning Fundamentals
Creates a culture of innovation, learning, and accountability

Responsibilities

Design and implement scalable AI and machine learning solutions that address complex business and customer challenges.
Integrate Large Language Models (LLMs), generative AI capabilities, and AI agents into enterprise products and platforms.
Designs and defines the technical architecture and infrastructure required for application solutions.
Develop and maintain AI platforms supporting model training, deployment, monitoring, governance, and lifecycle management.
Optimize inference performance, reliability, scalability, and operational costs.
Implement observability, telemetry, and performance measurement for AI systems.
Enable secure and responsible AI deployment through governance controls and compliance frameworks.
Writes code, develops software components, and implements complex functionalities according to project requirements.
Collaborates with other members of the development team and stakeholders to make high-level architectural decisions, proposes design patterns, and ensures scalability, performance, and maintainability of application solutions.
Integrates various software components or systems, ensuring seamless communication and interoperability between different parts of the application solution.
Conducts code reviews, performs debugging, and troubleshoots issues to ensure the reliability, stability, and high quality of application solutions.
Explores new tools, frameworks, and techniques to improve application solutions and drive innovation within the development team.
Creates and maintains technical documentation, including system designs, architecture diagrams, code documentation, and other relevant documentation while sharing their knowledge and expertise with team members, ensuring effective knowledge transfer and collaboration.