AI Software Engineer

HP IQ • San Francisco, CA

4h

About The Position

The AI team is building cutting-edge solutions that bring the power of AI directly to edge devices while seamlessly integrating with cloud infrastructure. We are looking for a Software Engineer to design and develop high-performance, scalable services to support AI workloads across edge and cloud environments.

Requirements

• Requires at least Masters in Computer Science, Engineering, Data Science, Artificial Intelligence or related fields.
• 1+ years of experience in backend software development, with strong proficiency in Python, Java, and C++.
• Working knowledge in LLM integration into multi-agent systems with strong understanding of agent orchestration, tool use, and memory/context management.
• Comfortable tinkering with LLMs via prompting and experienced with tools use, task decomposition, and structured outputs.
• Familiarity with database management systems (SQL and NoSQL) and data streaming technologies.
• Strong problem-solving skills and ability to work in a fast-paced, agile environment.

Nice To Haves

• Experience with AI model deployment and integration into backend services.
• Exposure to cloud-edge hybrid architectures and distributed AI workloads.
• Familiarity with on-device AI frameworks such as PyTorch, TensorFlow Lite, ONNX Runtime, or CoreML.

Responsibilities

• Contribute to design, build, and maintain services that power AI-driven applications, ensuring scalability and performance.
• Develop APIs and microservices that facilitate seamless integration between cloud-based AI models and edge devices.
• Optimize data pipelines and storage solutions for real-time AI inference and processing.
• Work closely with AI researchers, infrastructure engineers, and frontend developers to deliver end-to-end AI-driven solutions.
• Build and optimize an agent orchestration runtime that enables tool use, memory management, and multi-step reasoning across LLMs, APIs, and edge-connected systems.
• Support the implementation of security and privacy best practices for distributed AI systems.

Benefits

• Health insurance
• Dental insurance
• Vision insurance
• Long term/short term disability insurance
• Employee assistance program
• Flexible spending account
• Life insurance
• Generous time off policies, including;
• 4-12 weeks fully paid parental leave based on tenure
• 11 paid holidays
• Additional flexible paid vacation and sick leave (US benefits overview)

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level