Gen AI Java Developer

Capgemini • Atlanta, GA

18h • Onsite

About The Position

GenAI Backend & Platform Development: Design, build, and maintain enterprise-grade GenAI-powered backend services using Java (Spring Boot) and cloud-native architectures. Develop RESTful and event-driven APIs using Spring Boot, Spring WebFlux, and Kafka/streaming platforms. Implement GenAI use cases such as: Conversational assistants and copilots integrated into enterprise systems, Retrieval-Augmented Generation (RAG) pipelines for knowledge-driven applications, and Agent-based automation for workflow execution and decision support. Integrate LLM services (Azure OpenAI, OpenAI, Anthropic, etc.) into Java-based microservices using secure, scalable patterns. LLM Orchestration & Workflow Engineering: Build and orchestrate multi-step GenAI workflows using LangChain (via Java/Python interoperability or service-based architecture) or custom Java-based orchestration layers and state machines. Design and manage: Tool calling and agent execution frameworks, Context, memory, and prompt lifecycle management, and Conditional routing, fallback logic, retries, and resilience mechanisms. Ensure workflows are robust, observable, and production-ready at scale. Cloud-Native & DevOps Engineering: Develop and deploy services on cloud platforms (Azure preferred) using Containers (Docker) and orchestration (Kubernetes / AKS), and managed cloud services for AI, messaging, storage, and security. Build and maintain CI/CD pipelines using tools such as GitHub Actions / Azure DevOps / Jenkins, including automated build, test, security scan, and deployment stages. Apply Infrastructure as Code principles using Terraform, Bicep, or ARM templates. Ensure high availability, scalability, and cost efficiency of GenAI services. Engineering Excellence & Governance: Write clean, maintainable, and testable Java code adhering to SOLID and clean architecture principles. Implement Unit, integration, and contract tests, and API and workflow-level automated testing. Monitor and enforce Code quality, security, and compliance standards, and Logging, metrics, and distributed tracing for GenAI services. Participate in code reviews, design discussions, and architecture governance.

Requirements

• 5 to 8 years of professional software engineering experience
• Strong expertise in Java, with hands-on experience in Spring Boot / Spring Cloud
• Experience building and operating cloud-native microservices
• Solid understanding of API design, asynchronous processing, and distributed systems

Nice To Haves

• Experience with Azure OpenAI, OpenAI, Anthropic, etc.
• Experience with LangChain (via Java/Python interoperability or service-based architecture)
• Experience with Azure cloud platform
• Experience with Docker and Kubernetes / AKS
• Experience with CI/CD tools such as GitHub Actions / Azure DevOps / Jenkins
• Experience with Infrastructure as Code tools such as Terraform, Bicep, or ARM templates
• Experience with SOLID and clean architecture principles
• Experience with unit, integration, and contract tests
• Experience with API and workflow-level automated testing
• Experience with logging, metrics, and distributed tracing for GenAI services

Responsibilities

• Design, build, and maintain enterprise-grade GenAI-powered backend services using Java (Spring Boot) and cloud-native architectures
• Develop RESTful and event-driven APIs using Spring Boot, Spring WebFlux, and Kafka/streaming platforms
• Implement GenAI use cases such as: Conversational assistants and copilots integrated into enterprise systems, Retrieval-Augmented Generation (RAG) pipelines for knowledge-driven applications, and Agent-based automation for workflow execution and decision support
• Integrate LLM services (Azure OpenAI, OpenAI, Anthropic, etc.) into Java-based microservices using secure, scalable patterns
• Build and orchestrate multi-step GenAI workflows using LangChain (via Java/Python interoperability or service-based architecture) or custom Java-based orchestration layers and state machines
• Design and manage Tool calling and agent execution frameworks, Context, memory, and prompt lifecycle management, and Conditional routing, fallback logic, retries, and resilience mechanisms
• Ensure workflows are robust, observable, and production-ready at scale
• Develop and deploy services on cloud platforms (Azure preferred) using Containers (Docker) and orchestration (Kubernetes / AKS), and managed cloud services for AI, messaging, storage, and security
• Build and maintain CI/CD pipelines using tools such as GitHub Actions / Azure DevOps / Jenkins, including automated build, test, security scan, and deployment stages
• Apply Infrastructure as Code principles using Terraform, Bicep, or ARM templates
• Ensure high availability, scalability, and cost efficiency of GenAI services
• Write clean, maintainable, and testable Java code adhering to SOLID and clean architecture principles
• Implement Unit, integration, and contract tests, and API and workflow-level automated testing
• Monitor and enforce Code quality, security, and compliance standards, and Logging, metrics, and distributed tracing for GenAI services
• Participate in code reviews, design discussions, and architecture governance

Benefits

• Paid time off based on employee grade (A-F), defined by policy: Vacation: 12-25 days, depending on grade
• Company paid holidays
• Personal Days
• Sick Leave
• Medical, dental, and vision coverage
• Retirement savings plans (e.g., 401(k) in the U.S., RRSP in Canada)
• Life and disability insurance
• Employee assistance programs

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed