Mgr - Software Eng

Ally Bank•Detroit, MI

About The Position

Ally Financial is seeking an experienced, hands-on GenAI Tech Lead to drive the end-to-end development of enterprise-grade generative and agentic AI solutions. The role bridges strategy and execution by architecting robust systems, leading software engineers, and transforming business challenges into scalable AI products. The position involves designing production-ready GenAI applications and agentic workflows, leading engineering practices and mentoring, prototyping emerging technologies, and operating models in production. The Tech Lead works with product managers, data scientists, security teams, and business stakeholders to align technical work with organizational goals. Ally’s work arrangement may be fully onsite, hybrid, or fully remote; the specific requirements will be discussed during hiring and may change based on business needs. The role offers a base pay range of $110,000 to $180,000 and eligibility to participate in an annual incentive plan. Ally describes its compensation and benefits as including paid time off and holidays, retirement savings, health and insurance options, family-building and caregiving support, and other incentives that may depend on the role.

Requirements

  • At least 7 years of relevant experience or an equivalent combination of education and experience.
  • Bachelor’s degree in a relevant field or equivalent.
  • At least 8 years of software engineering experience, including at least 5 years in machine learning engineering and 2 years of hands-on experience building and deploying enterprise GenAI/LLM applications.
  • Advanced proficiency in Python and cloud-native development using AWS, Azure, or Google Cloud.
  • Practical knowledge of RAG architectures, vector search, prompt engineering, and orchestration libraries such as LangChain, LlamaIndex, or LangGraph.
  • Familiarity with CI/CD pipelines, containerization with Docker or Kubernetes, and API microservices.
  • Demonstrated technical leadership and mentoring experience, and ability to explain complex technical concepts in terms of business value.
  • Strong analytical, written and verbal communication, and interpersonal skills.
  • Ability to prioritize workload, balance multiple initiatives, and respond quickly to a changing environment.

Nice To Haves

  • Experience fine-tuning open-weight foundation models.
  • Experience in highly regulated industries such as banking or finance, including navigating strict security protocols.
  • Curiosity about emerging AI tooling, Model Context Protocol (MCP), and automated evaluation loops.
  • Experience with agentic frameworks such as AutoGen.

Responsibilities

  • Design scalable, secure, production-ready GenAI applications using large language models, retrieval-augmented generation pipelines, and vector databases.
  • Fine-tune and deploy open-source models to meet business needs.
  • Build and orchestrate multi-agent AI systems and tool-calling frameworks.
  • Lead code reviews, establish engineering best practices, enforce coding standards, and mentor junior-to-mid-level software engineers.
  • Rapidly develop proofs of concept and minimum viable products to evaluate emerging AI models and frameworks.
  • Implement production LLMOps capabilities, including monitoring, caching, prompt versioning, cost tracking, and model evaluation guardrails.
  • Partner with product managers, data scientists, security teams, and business stakeholders to align technical deliverables with organizational goals.

Benefits

  • At least 20 paid time off days, 11 paid holidays, and 8 hours of annual volunteer time off; amounts may be prorated and programs vary by employment status and management level.
  • 401(k) retirement savings plan with matching and company contributions.
  • Student loan paydown and 529 educational savings assistance programs.
  • Tuition reimbursement.
  • Employee stock purchase plan.
  • Financial learning center and financial coach access.
  • Medical, dental, and vision insurance options.
  • Employee, spouse, and child life insurance.
  • Short- and long-term disability insurance.
  • Health Savings Account with employer contributions and Healthcare Flexible Spending Account.
  • Critical illness, accident, and hospital indemnity insurance.
  • Total well-being program.
  • Adoption, surrogacy, and fertility assistance.
  • Paid parental and caregiver leave.
  • Dependent Day Care Flexible Spending Account, backup child and adult/elder care days, and childcare discounts.
  • Employee assistance program.
  • Subsidized and discounted Weight Watchers program and other employee discount programs.
  • Potential travel allowances, relocation assistance, signing bonus, and/or equity, depending on the role.
  • Annual incentive plan eligibility.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service