Senior Software Engineer - Back End

Paradigm•Middleton, WI
•$95,000 - $139,000

About The Position

Paradigm is seeking a Senior Software Engineer – Back End to build and maintain backend APIs and services for cloud-based applications in the Azure ecosystem. The InfoThinks team develops intelligent applications that combine modern backend engineering with AI capabilities, helping users access, understand, and act on complex business and product information. The role focuses on production-quality Python services that integrate large language models, enterprise data sources, search and retrieval systems, external APIs, and other AI capabilities. The engineer will design RAG workflows and AI application architecture, monitor and improve application behavior, troubleshoot production issues, and collaborate with cross-functional teams to deliver robust backend solutions.

Requirements

  • Bachelor’s degree in Computer Science or a related technical field, or equivalent professional experience.
  • At least 4 years of professional software development experience, with significant experience developing backend applications, APIs, or distributed services.
  • Strong hands-on development experience with Python and modern Python application development practices.
  • Experience designing and implementing REST APIs and backend services, with a strong understanding of software architecture and object-oriented and/or functional design principles.
  • Practical experience with LangChain or comparable frameworks for developing LLM-powered applications and integrating applications and APIs with LLM providers and AI services.
  • Strong understanding of large language models and generative AI concepts, including prompts, tokens, context windows, embeddings, and model limitations.
  • Understanding of RAG architectures and how retrieval, context generation, and LLM responses relate.
  • Experience or working knowledge of semantic search, vector search, retrieval strategies, and AI application patterns such as tool/function calling, structured outputs, agents, and multi-step AI workflows.
  • Experience designing reliable production systems with appropriate authentication, authorization, error handling, logging, automated testing, and observability.
  • Strong problem-solving skills, including troubleshooting issues spanning application code, APIs, AI models, retrieval systems, and data sources, and evaluating whether new AI technologies are appropriate for production.
  • Teamwork, collaboration, and communication skills, with the ability to stay dependable and organized while adapting to changing requirements and priorities in an agile environment.

Nice To Haves

  • Experience with Azure AI services, Azure OpenAI, or similar managed AI platforms.
  • Experience with Databricks and integrating Databricks APIs or data services into applications.
  • Experience with vector databases or vector-enabled search platforms.
  • Experience with containerized applications and cloud deployment using Docker and Azure.
  • Familiarity with FastAPI or similar Python API frameworks.

Responsibilities

  • Design, develop, enhance, and maintain scalable, maintainable, production-quality backend APIs and services using Python.
  • Develop AI-enabled backend services using LangChain and related technologies to orchestrate LLMs, enterprise data, search and retrieval systems, and external APIs, maintaining appropriate abstractions between applications and underlying models, providers, and data platforms.
  • Design and implement retrieval-augmented generation (RAG) workflows, including retrieval, context construction, prompt orchestration, and response generation.
  • Implement observability, logging, error handling, testing, and performance monitoring for API operations and AI workflows, considering security, scalability, data privacy, and responsible AI use.
  • Evaluate and improve AI application behavior, including response and retrieval quality, latency, reliability, token consumption, and cost.
  • Investigate production issues and implement and test fixes across APIs, AI integrations, retrieval components, and supporting services.
  • Participate in peer code reviews, contribute to engineering standards and technical documentation, and recommend improvements to development processes and engineering tools.
  • Collaborate with front-end engineers, Product Owners, QA, data engineers, UX, and other engineering teams to translate product requirements into robust backend solutions.
  • Work independently on complex problems while collaborating on architecture and implementation decisions.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service