Senior Software Engineer II (AI Specialist)

Emumba • San Jose, CA

8d

About The Position

We are looking for an experienced AI Specialist to design and build intelligent systems powered by Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), and agentic workflows. In this role, you will develop scalable AI-driven applications, build robust data and document pipelines, and create reusable frameworks that enhance AI-assisted development across teams.

The ideal candidate brings 6+ years of software development experience, including 2+ years in AI/ML engineering, with a strong foundation in Python, API development, and real-world deployment of AI systems. You should be comfortable working with modern AI tools, designing multi-step agent-based systems, and driving best practices that improve reliability, consistency, and team productivity.

This is a client-facing role, requiring strong communication skills and the ability to clearly articulate technical concepts to customers and stakeholders.

This role is initially structured as a 6-month engagement, with a strong likelihood of extension based on performance and project needs.

Requirements

• Strong hands-on experience with Python in real-world or production systems, including building or integrating API services (REST APIs, AI services, or microservices).
• Strong client-facing communication skills, with the ability to engage directly with customers and clearly articulate technical concepts
• Solid understanding of machine learning workflows, including training, evaluation, and basic deployment concepts.
• Hands-on experience working with LLMs and/or VLMs in real-world projects or production environments.
• Experience building or working with OCR pipelines (e.g., Tesseract, EasyOCR, or similar).
• Hands-on experience with AI-assisted coding tools (e.g., Cursor, AI-enabled VS Code, or similar).
• Experience building or working with agent-based systems or multi-step AI pipelines.
• Ability to design reusable workflows, guardrails, and systems that improve developer productivity and consistency.

Responsibilities

• Design and build AI-powered systems using LLMs, RAG architectures, and agent-based workflows.
• Develop and maintain document ingestion pipelines, including OCR, parsing, structuring, and metadata extraction.
• Build and integrate API-based AI services (REST APIs, microservices, AI integrations).
• Design and implement agentic workflows that orchestrate multiple steps such as retrieval, reasoning, generation, and validation.
• Define and maintain structured workflows within AI-assisted coding environments (e.g., Cursor, AI-enabled IDEs).
• Create and manage reusable rules, prompts, and task templates to standardize AI-assisted development across teams.
• Establish best practices and guardrails for AI-assisted development to ensure consistency, reliability, and quality.
• Enable team productivity by creating reusable workflows and systems that support less experienced developers.

What This Job Offers

• Career Level: Mid Level
• Education Level: No Education Listed
• Number of Employees: 101-250 employees