Software Engineering Advisor –Evernorth

Cigna Group • Bloomington, MN

3d • Remote

About The Position

Join a team that delivers end‑to‑end technology and lifecycle management for enterprise data platforms operating both on‑premises and in the AWS cloud. As a Software Engineering Advisor on the Data & Analytics Engineering (D&AE) Operational Effectiveness team, you will play a critical role in strengthening the reliability, scalability, and performance of our data platforms while helping the organization responsibly adopt GenAI‑enabled data solutions. In this role, you will partner closely with architects, analysts, platform, and security teams to design and operate modern data pipelines on AWS and Databricks , ensuring trusted, high‑quality data is available to power analytics and business decision‑making.

Requirements

• 8+ years of experience in a software engineering or data engineering role.
• 6+ years of hands‑on experience with Databricks Lakehouse , including Delta Lake fundamentals and performance optimization.
• Strong proficiency in Spark SQL / Databricks SQL , with a solid understanding of query execution and optimization techniques.
• Experience building and operating data platforms on AWS , including services such as S3, Glue, Lambda, Airflow, and EC2.
• Proficiency with Python for data engineering and pipeline development in Databricks.
• Hands‑on experience implementing GenAI patterns for analytics , including RAG, prompt engineering, embeddings, and vector search.
• Experience operationalizing GenAI solutions, including evaluation, monitoring, data privacy, security, and foundational LLMOps/MLOps practices.
• Strong understanding of data warehousing concepts and large‑scale ETL performance optimization.
• Experience with CI/CD practices and tools such as GitHub and Jenkins.
• Excellent problem‑solving skills, attention to detail, and the ability to collaborate effectively across teams.
• If you will be working at home occasionally or permanently, the internet connection must be obtained through a cable broadband or fiber optic internet service provider with speeds of at least 10Mbps download/5Mbps upload.

Nice To Haves

• Bachelor’s degree in a related field.
• Experience supporting enterprise‑scale data platforms with strict reliability, governance, and compliance requirements.
• Familiarity with cost optimization strategies for cloud‑based data platforms.

Responsibilities

• Design, build, and maintain resilient ETL and ELT pipelines that integrate data from diverse sources into Databricks on AWS, supporting both batch and streaming workloads.
• Develop and operate Databricks notebooks and workflows , including scheduling, retries, alerting, and failure recovery to ensure operational stability.
• Implement and optimize Delta Lake tables , applying schema evolution, partitioning, Z‑Ordering, OPTIMIZE, and VACUUM to improve performance and reliability.
• Tune Databricks clusters and Spark configurations , leveraging autoscaling, instance selection, and runtime optimization while enforcing cluster policies to balance cost, performance, and availability.
• Manage data governance and access controls using Unity Catalog , secrets management, and credential passthrough where applicable.
• Design and implement GenAI‑enabled data solutions (e.g., retrieval‑augmented generation), including curating trusted datasets, generating embeddings, and integrating vector search with enterprise data platforms.
• Establish GenAI governance and operational practices , including prompt and version management, evaluation metrics, monitoring, and guardrails for privacy, security, and hallucination risk.
• Optimize complex queries, data models, and ingestion strategies to support large‑scale analytics and high‑performance workloads.
• Collaborate with data architects, analysts, and data stewards to define data requirements and ensure accuracy, availability, and trustworthiness of enterprise data assets.
• Monitor, troubleshoot, and resolve pipeline issues related to data quality, performance, and job failures, driving continuous improvement.
• Develop data validation and quality checks to strengthen confidence in analytics and downstream reporting.
• Document technical designs, workflows, and operational standards to support knowledge sharing and long‑term maintainability.
• Support capacity planning and partner with platform and security teams to meet performance, reliability, and security expectations.
• Contribute in an agile environment, providing alternative solutions and technical guidance to support timely delivery.

Benefits

• Starting on day one of your employment, you’ll be offered several health-related benefits including medical, vision, dental, and well-being and behavioral health programs.
• We also offer 401(k), company paid life insurance, tuition reimbursement, a minimum of 18 days of paid time off per year and paid holidays.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level