Sr Data Engineer - AI

HumanaLouisville, KY
3dHybrid

About The Position

Become a part of our caring community and help us put health first As a Senior Data Engineer, you will play a critical role in building the Agentic AI platform and delivering cutting-edge AI-powered solutions. You’ll work with large-scale datasets and state-of-the-art tools to address complex business problems. This role involves close collaboration with data scientists and fellow engineers across the entire AI development lifecycle—from data ingestion to deployment and monitoring. Explore and implement generative AI technologies using Large Language Models and other generative models to create innovative solutions. Build and maintain robust APIs for enabling Retrieval-Augmented Generation and generative AI agents within business use cases. Design, develop, and maintain robust data pipelines for ingestion, processing, and transformation of large datasets. Assist our data science team in the development and deployment of traditional machine learning models. Collaborate with data scientists to understand model requirements and translate them into scalable engineering solutions. Monitor and maintain performance and reliability of deployed APIs, models, and data pipelines. Stay up to date with the latest advancements in machine learning, generative AI, and related technologies. Use your skills to make an impact

Requirements

  • Bachelor's Degree in a quantitative discipline (e.g., Computer Science, Mathematics, Statistics, or a related field) with a minimum of 5 years of professional experience; OR 7+ years of Python application development and data manipulation libraries (e.g., Pandas, NumPy).
  • Familiarity with API frameworks (e.g., FastAPI, Flask) and RESTful API concepts.
  • 3+ years of experience with containerization (e.g., Docker, Kubernetes).
  • 3+ years of experience with CI/CD tools, pipelines
  • 3+ years of experience with PySpark.
  • 2+ years of experience working on any cloud platform. (Azure / GCP / AWS)
  • Strong understanding of machine learning frameworks (e.g., TensorFlow, PyTorch, Scikit-learn).
  • Knowledge of generative AI frameworks such as Langchain or Pydantic AI.
  • Experience working with Large Language Model (LLM) in application development

Nice To Haves

  • Master's Degree in a similar field with at least 5 years of relevant experience.
  • Experience with version control systems (e.g., Git) and software development best practices.
  • Excellent problem-solving skills and ability to work in a collaborative environment.
  • Experience deploying software using tools like Docker and Kubernetes.
  • Experience with deep learning techniques and frameworks.
  • Experience working with any nosql DBs.
  • Knowledge of natural language processing (NLP).
  • Familiarity with big data and data streaming technologies (e.g., Hadoop, Spark, kafka).

Responsibilities

  • Explore and implement generative AI technologies using Large Language Models and other generative models to create innovative solutions.
  • Build and maintain robust APIs for enabling Retrieval-Augmented Generation and generative AI agents within business use cases.
  • Design, develop, and maintain robust data pipelines for ingestion, processing, and transformation of large datasets.
  • Assist our data science team in the development and deployment of traditional machine learning models.
  • Collaborate with data scientists to understand model requirements and translate them into scalable engineering solutions.
  • Monitor and maintain performance and reliability of deployed APIs, models, and data pipelines.
  • Stay up to date with the latest advancements in machine learning, generative AI, and related technologies.

Benefits

  • Humana provides medical, dental and vision benefits, 401(k) retirement savings plan, time off (including paid time off, company and personal holidays, volunteer time off, paid parental and caregiver leave), short-term and long-term disability, life insurance and many other opportunities.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service