AI Software Engineer - Operations
About The Position
The AI Software Engineer will design and build AI-driven applications powered by large language models (LLMs), focusing on integrating AI capabilities into user-facing products. The role emphasizes application development, orchestration, and user experience rather than model training. The engineer will develop scalable backend services, prototype intuitive user interfaces, and enable seamless interaction between users and LLM-based systems. This position combines software engineering, systems thinking, and practical AI implementation to deliver production-ready solutions using LLM APIs and frameworks. The role is part of KLA's Global Operations organization, which works across manufacturing, supply chain management, manufacturing engineering, installation, and quality.
Requirements
- Bachelor’s degree in Computer Science, Software Engineering, or a related field.
- At least three years of professional software development experience.
- Strong programming skills in Python, JavaScript, or similar languages.
- Experience building AI products using LLM frameworks such as LangChain, Semantic Kernel, or LlamaIndex.
- Knowledge of retrieval-augmented generation (RAG) and vector databases such as Pinecone, FAISS, or Azure Cognitive Search.
- Experience with Milvus for semantic search and Neo4j knowledge graphs.
- Experience orchestrating multi-step AI workflows or agent-based systems.
- Familiarity with enterprise data platforms and integrations, such as Snowflake, SAP, APIs, and knowledge graphs.
- Experience designing conversational interfaces or chat-based applications.
- Understanding of evaluation techniques for LLM outputs, including quality, grounding, and hallucination mitigation.
- Exposure to prompt optimization and fine-tuning concepts; hands-on model training is not necessarily required.
- Experience deploying scalable microservices architectures.
- Strong UI/UX sensibility for AI-driven applications.
- Experience working in cross-functional teams delivering production-grade AI solutions.
- Familiarity with prompt engineering and LLM interaction patterns.
- Experience developing web-based user interfaces using React, Angular, or similar frameworks.
- Experience working with or for a global manufacturing company.
Responsibilities
- Design and develop end-to-end AI applications that leverage LLMs for business use cases.
- Build and maintain backend services that orchestrate LLM interactions, prompts, and workflows.
- Prototype and develop intuitive user interfaces that enable effective human-AI interaction.
- Integrate LLM APIs such as OpenAI, Azure OpenAI, and Anthropic into scalable applications.
- Develop prompt engineering strategies and manage the prompt lifecycle for performance and reliability.
- Implement retrieval-augmented generation (RAG) architectures using internal and external data sources.
- Design data pipelines and connectors to enterprise systems, including databases, APIs, and knowledge bases.
- Monitor, evaluate, and improve AI application performance using metrics such as latency, cost, and response quality.
- Collaborate with product managers, data scientists, and business stakeholders to translate requirements into AI-enabled solutions.
- Ensure responsible AI practices, including privacy, security, and bias mitigation.
- Rapidly prototype AI tools and iterate based on user feedback.
Benefits
- Medical, dental, vision, life, and other voluntary benefits.
- 401(k) with company matching.
- Employee stock purchase program (ESPP).
- Student debt assistance.
- Tuition reimbursement program.
- Development and career growth opportunities and programs.
- Financial planning benefits.
- Wellness benefits, including an employee assistance program (EAP).
- Paid time off and paid company holidays.
- Family care and bonding leave.
- Performance incentive programs may be available.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
