Senior AI Software Engineer

HP IQ • San Francisco, CA

5d • $149,000 - $240,000

About The Position

HP IQ, HP’s AI innovation lab, is building intelligent technologies across HP’s portfolio to support creativity, productivity, and collaboration. The AI team develops solutions that bring AI capabilities to edge devices while integrating with cloud infrastructure. The Senior AI Software Engineer will design and develop high-performance, scalable services supporting AI workloads across edge and cloud environments, including systems for agent orchestration, tool use, memory management, and multi-step reasoning.

Requirements

• At least 5 years of backend software development experience.
• Strong proficiency in Java, C++, or Python.
• Proficiency integrating LLMs into multi-agent systems, including understanding of agent orchestration, tool use, and memory/context management.
• Comfort with prompting LLMs and experience with tool use, task decomposition, and structured outputs.
• Experience building distributed systems, microservices, and cloud-native applications.
• Strong knowledge of building secure, privacy-aware interfaces between models, devices, and external services.
• Familiarity with SQL and NoSQL database management systems and data streaming technologies.
• Strong problem-solving skills and ability to work in a fast-paced, agile environment.

Nice To Haves

• Experience deploying AI models and integrating them into backend services.
• Knowledge of edge computing, networking, and security best practices.
• Exposure to cloud-edge hybrid architectures and distributed AI workloads.
• Familiarity with on-device AI frameworks such as TensorFlow Lite, ONNX Runtime, or CoreML.

Responsibilities

• Design, build, and maintain scalable, high-performance services for AI-driven applications.
• Develop APIs and microservices connecting cloud-based AI models with edge devices.
• Optimize data pipelines and storage for real-time AI inference and processing.
• Implement security and privacy best practices for distributed AI systems.
• Collaborate with AI researchers, infrastructure engineers, and frontend developers to deliver end-to-end AI solutions.
• Build and optimize an agent orchestration runtime supporting tool use, memory management, and multi-step reasoning across LLMs, APIs, and edge-connected systems.
• Develop logging, monitoring, and alerting systems to support reliability.

Benefits

• Health insurance
• Dental insurance
• Vision insurance
• Long-term and short-term disability insurance
• Employee assistance program
• Flexible spending account
• Life insurance
• Four to twelve weeks of fully paid parental leave based on tenure
• 11 paid holidays
• Flexible paid vacation and sick leave
• Flexible work environment

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed