Software Engineer III, Generative AI, Search Prompt Engineering

Google • Mountain View, CA

5d

About The Position

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

As a Software Engineer on the Search Prompts team, you will be a core contributor ensuring that Google is able to scale the building of features and experiences via prompting. You will design prompts that balance engaging requirements and enable multiple teams to operate smoothly while sharing a single prompt. You have the opportunity to take ownership of projects that bring Large Language Models (LLMs) to billions of Google Search users.

In Google Search, we're reimagining what it means to search for information – any way and anywhere. To do that, we need to solve complex engineering challenges and expand our infrastructure, while maintaining a universally accessible and useful experience that people around the world rely on. In joining the Search team, you'll have an opportunity to make an impact on billions of people globally.

Requirements

• Bachelor’s degree or equivalent practical experience.
• 2 years of experience with software development in one or more programming languages, or 1 year of experience with an advanced degree.
• 1 year of experience designing and implementing evaluation methodologies for machine learning models.
• 1 year of experience with ML infrastructure (e.g., model deployment, model evaluation, optimization, data processing, debugging).
• Experience with GenAI techniques (e.g., LLMs, multi-modal, large vision models) or with GenAI-related concepts (e.g., language modeling, computer vision).
• Experience with search quality concepts, including relevance, recall, and precision.

Nice To Haves

• Master's degree or PhD in Computer Science or related technical fields.
• Experience with Natural Language Processing (NLP) or developing machine learning product applications.
• Experience designing, testing, or evaluating Large Language Models (LLMs) and advanced prompting strategies.
• Ability to operate with enthusiasm and flexibility in a fast-paced, constantly evolving team environment.
• Excellent product engineering intuition and ability to translate open-ended AI problems into scalable solutions.
• Ability to start in person in Mountain View within 3 weeks of offer accept.

Responsibilities

• Design and develop prompting techniques to enable scaling of prompts to a large number of use cases.
• Manage latency and capacity by optimizing the prompt.
• Design and develop prompting techniques to scale the prompt to multiple Search surfaces.
• Collaborate with product managers to launch new AI-driven Search features.
• Implement GenAI solutions, utilize ML infrastructure, and contribute to data preparation, optimization, and performance enhancements.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level