AI Operations

Northern Trust•Chicago, IL
•$133,500 - $226,900

About The Position

Northern Trust is hiring for an AI Operations role supporting the development, evaluation, deployment, and maintenance of AI solutions, with generative AI and large language models as core areas. The role develops software—typically in Python—to acquire and combine data from databases, files, APIs, and other sources; analyze datasets with domain experts; and create trusted training, validation, and testing data. The position works across the full research lifecycle, from forming hypotheses and acquiring data through developing ETL-style software and presenting findings. It involves designing and evaluating machine learning and Retrieval-Augmented Generation (RAG) solutions, generally integrating them with Azure services. The role also contributes to standardized AI development tooling, production-ready frameworks, infrastructure automation, and guidance for other development teams. The successful candidate will work with internal and external customers and partners, communicate findings in both technical and business terms, and may plan and deliver data science training sessions and hackathons. A bachelor's degree in Computer Science or a related field is required. Required skills include Python and its common data science libraries, Linux-based operating systems, and basic development tools. Azure infrastructure and advanced distributed machine learning frameworks are preferred.

Requirements

  • Bachelor's degree in Computer Science or a related field.
  • Experience with Python and common Python libraries such as NumPy, Pandas, and scikit-learn.
  • Experience with Linux-based operating systems and basic development tools, including Python IDEs and source control.
  • Knowledge of infrastructure-as-code and automation concepts and tools.
  • Knowledge of full-stack Azure application development.
  • Knowledge of cloud security concepts and controls, including virtual networks, subnets, private endpoints, authentication, identities, and role-based access.
  • Knowledge of data protection and encryption techniques and tools, including Key Vaults, encryption keys, masking, and BYOK concepts.
  • Knowledge of DevOps, CI/CD techniques, Azure tools, and GitHub repositories.
  • Ability to work across the research lifecycle, analyze data, and communicate findings to technical and business audiences.

Nice To Haves

  • Experience with advanced distributed machine learning frameworks such as Keras or TensorFlow.
  • Experience with Azure cloud infrastructure.
  • Certifications in Azure Security, DevOps, or Azure AI Engineer Associate, or equivalent.
  • Experience developing open-source software in a collaborative environment.

Responsibilities

  • Develop software, typically in Python, to acquire data from disparate sources and combine it into training, validation, and testing datasets.
  • Analyze raw datasets using descriptive statistics and work with domain experts to understand data fields.
  • Develop and integrate Retrieval-Augmented Generation (RAG) systems, primarily on Azure, and recommend suitable technologies and techniques.
  • Use open-source AI tools and frameworks, including TensorFlow, PyTorch, HuggingFace, LangChain, AutoGen, LangGraph, and LlamaIndex, for solution development and evaluation.
  • Evaluate AI frameworks and services and recommend tools for standardized AI development.
  • Integrate AI tools and software with Azure services for development and deployment.
  • Use Terraform for infrastructure-as-code automation, cloud resource provisioning, and related infrastructure tasks.
  • Build unit tests, data-quality checks, and data pipelines to ensure algorithms use trusted data.
  • Implement CI/CD pipelines and automated deployment of AI solutions using tools such as Azure DevOps, GitHub Actions, Terraform, and MLOps practices.
  • Use Azure Kubernetes Service (AKS) to manage and scale containerized AI applications.
  • Maintain and update AI models and monitor their relevance and effectiveness using Azure monitoring tools.
  • Enforce Azure security controls, including network security, identity management, data encryption, and privacy measures.
  • Ensure AI solutions comply with industry standards, best practices, and regulations.
  • Work across multiple projects and the full research lifecycle, from hypothesis formation and data acquisition through ETL-style software development and presentation of findings.
  • Guide other software development teams as prototypes and frameworks are engineered for production environments.
  • Develop and maintain knowledge of supervised learning, unsupervised learning, and time-series algorithms.
  • Propose and develop machine learning ensemble methods and tune algorithms and feature subsets to improve out-of-sample performance.
  • Identify dataset bias or leakage and ensure train/test splits reflect realistic performance expectations.
  • Run large-scale parallel or distributed training and inference jobs on private or public cloud infrastructure.
  • Present findings to internal and external customers using data science terminology and business-domain language.
  • Plan and execute data science training sessions and hackathons.
  • Work with vendors, universities, and other external parties to incorporate techniques and tools into the data science lab.

Benefits

  • Retirement benefits, including a 401(k) and pension.
  • Medical, dental, and vision benefits.
  • Spending accounts and disability benefits.
  • Paid time off.
  • Parental and caregiver leave.
  • Life and accident insurance.
  • Other voluntary and well-being benefits.
  • Discretionary bonus program that may include an equity component.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service