Mgr - Software Eng
About The Position
Ally Financial is seeking an experienced, hands-on GenAI Tech Lead to drive the end-to-end development of enterprise-grade generative and agentic AI solutions. The role bridges strategy and execution by architecting robust systems, leading software engineers, and turning complex business challenges into scalable AI products. The position involves designing and building production-ready GenAI applications and agentic workflows, rapidly prototyping emerging models and frameworks, and operating AI systems in production. The role also provides technical leadership and mentorship and works closely with product managers, data scientists, security teams, and business stakeholders to align technical solutions with organizational goals. Ally offers market-competitive base pay and performance-based incentives, along with benefits and programs supporting time away, financial planning, health and well-being, family support, and work-life integration. The role is eligible for the annual incentive plan.
Requirements
- At least 7 years of relevant experience or an equivalent combination of education and experience.
- Bachelor’s degree in a relevant field or equivalent.
- Advanced proficiency in Python and cloud-native development on AWS, Azure, or Google Cloud.
- Deep practical knowledge of RAG architectures, vector search, prompt engineering, and orchestration libraries such as LangChain, LlamaIndex, or LangGraph.
- Familiarity with CI/CD pipelines, containerization technologies such as Docker and Kubernetes, and API microservices.
- Proven technical leadership and mentoring experience.
- Strong analytical, written and oral communication, and interpersonal skills.
- Ability to prioritize workload, balance multiple initiatives, and respond quickly to a changing environment.
Nice To Haves
- Eight or more years of software engineering experience, including five or more years in machine learning engineering and at least two years of hands-on experience building and deploying enterprise GenAI/LLM applications.
- Experience fine-tuning open-weight foundation models.
- Background in highly regulated industries such as banking or finance, including experience navigating strict security protocols.
- Curiosity about emerging AI tooling, Model Context Protocol (MCP), and automated evaluation loops.
Responsibilities
- Design scalable, secure, production-ready GenAI applications using LLMs, open-source models, RAG pipelines, and vector databases.
- Fine-tune and deploy open-source models to meet business needs.
- Build and orchestrate multi-agent AI systems and tool-calling frameworks.
- Lead code reviews, establish engineering best practices, enforce coding standards, and mentor junior-to-mid-level software engineers.
- Rapidly build proofs of concept and minimum viable products to evaluate emerging AI models and frameworks.
- Implement production LLMOps capabilities, including monitoring, caching, prompt versioning, cost tracking, and model evaluation guardrails.
- Partner with product managers, data scientists, security teams, and business stakeholders to align technical deliverables with organizational goals.
- Translate complex technical concepts into clear business value and balance multiple initiatives as priorities or conditions change.
Benefits
- At least 20 paid time-off days, 11 paid holidays, and 8 hours of annual volunteer time off; time off is prorated based on start date and varies by employment status and management level.
- 401(k) retirement savings plan with matching and company contributions.
- Student loan pay-down and 529 educational savings assistance programs.
- Tuition reimbursement.
- Employee stock purchase plan.
- Financial learning center and access to financial coaches.
- Flexible medical, dental, and vision insurance options.
- Life insurance for employees, spouses, and children.
- Short- and long-term disability insurance.
- Health Savings Account with employer contributions and Healthcare FSA.
- Critical illness, accident, and hospital indemnity insurance.
- Total well-being program supporting physical, social, emotional, and financial health.
- Adoption, surrogacy, and fertility assistance.
- Paid parental and caregiver leave.
- Dependent Day Care FSA, backup child and adult/elder care days, and childcare discounts.
- Employee Assistance Program.
- Subsidized and discounted Weight Watchers program and other employee discount programs.
- Potential eligibility for travel allowances, relocation assistance, a signing bonus, and/or equity, depending on the role.
- Annual incentive plan eligibility.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
