Senior AI Software Engineer - HP IQ

HP • San Francisco, CA

2d • $149,000 - $240,000

About The Position

The AI team is building cutting-edge solutions that bring the power of AI directly to edge devices while seamlessly integrating with cloud infrastructure. We are looking for a Senior Software Engineer to design and develop high-performance, scalable services to support AI workloads across edge and cloud environments.

Requirements

• 5+ years of experience in backend software development, with strong proficiency in Java, C++, or Python.
• Proficient in LLM integration into multi-agent systems with strong understanding of agent orchestration, tool use, and memory/context management.
• Comfortable tinkering with LLMs via prompting and experienced with tools use, task decomposition, and structured outputs.
• Experience building distributed systems, microservices, and cloud-native applications.
• Strong knowledge with building secure, privacy-aware interfaces between models, devices, and external services.
• Familiarity with database management systems (SQL and NoSQL) and data streaming technologies.
• Strong problem-solving skills and ability to work in a fast-paced, agile environment.

Nice To Haves

• Experience with AI model deployment and integration into backend services.
• Knowledge of edge computing, networking, and security best practices.
• Exposure to cloud-edge hybrid architectures and distributed AI workloads.
• Familiarity with on-device AI frameworks such as TensorFlow Lite, ONNX Runtime, or CoreML.

Responsibilities

• Design, build, and maintain services that power AI-driven applications, ensuring scalability and performance.
• Develop APIs and microservices that facilitate seamless integration between cloud-based AI models and edge devices.
• Optimize data pipelines and storage solutions for real-time AI inference and processing.
• Implement security and privacy best practices for distributed AI systems.
• Work closely with AI researchers, infrastructure engineers, and frontend developers to deliver end-to-end AI-driven solutions.
• Build and optimize an agent orchestration runtime that enables tool use, memory management, and multi-step reasoning across LLMs, APIs, and edge-connected systems.
• Develop robust logging, monitoring, and alerting systems to ensure system reliability.

Benefits

• Health insurance
• Dental insurance
• Vision insurance
• Long term/short term disability insurance
• Employee assistance program
• Flexible spending account
• Life insurance
• Generous time off policies, including; 4-12 weeks fully paid parental leave based on tenure
• 11 paid holidays
• Additional flexible paid vacation and sick leave

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed