Lead Software Engineer - Eden Prairie, MN - 2388089
About The Position
We are seeking a Lead Software Engineer to join our team. This role involves designing, developing, and optimizing scalable data pipelines and platforms that support advanced analytics and AI/ML initiatives. You will drive innovation across data ingestion, transformation, and consumption layers using modern cloud-native technologies. The position requires architecting and implementing robust, scalable data pipelines, and leading AI/ML data engineering initiatives including synthetic data generation, data mapping, profiling, and transformation using Generative AI techniques. You will collaborate with cross-functional teams to enable seamless data access, governance, and lineage across platforms. Additionally, you will oversee the adoption of best practices in CI/CD, data quality, and data security across engineering teams, mentor junior engineers, and contribute to the development of reusable frameworks and accelerators. You will also review and revise data modeling, metadata management, and data lifecycles, and build and optimize large-scale data platforms and AI/ML pipelines. This position reports to the Eden Prairie office and allows for partial telecommuting.
Requirements
- Bachelor’s degree in Computer Science, Engineering, or related field and 7 years of experience in the job offered or a computer-related position.
- 7 years of experience in Cloud Platforms such as Azure or AWS.
- 7 years of experience in Data Engineering tools such as Databricks, Snowflake, Spark, Hive, Airflow, and ADF.
- 7 years of experience in Programming languages including Python, SQL, and PySpark.
- 7 years of experience in AI/ML Integration tools including Azure ML, MLflow, LLM endpoints, and Copilot for code generation.
- 7 years of experience in Data Governance tools Privacera or Azure AD for access control.
- 7 years of experience in DevOps tools including Terraform and Git.
- 7 years of experience in CI/CD pipelines.
- 7 years of experience in DBMS Skills including Oracle or Postgres.
- 7 years of experience in Code or Peer Reviews prior to Prod deployments.
- 7 years of experience in Detailed Design and Strategy.
- 7 years of experience in Azure Vnet Integrations.
Responsibilities
- Design, develop, and optimize scalable data pipelines and platforms that support advanced analytics and AI/ML initiatives.
- Drive innovation across data ingestion, transformation, and consumption layers using modern cloud-native technologies.
- Architect and implement robust, scalable data pipelines.
- Lead AI/ML data engineering initiatives including synthetic data generation, data mapping, profiling, and transformation using Generative AI techniques.
- Collaborate with cross-functional teams to enable seamless data access, governance, and lineage across platforms.
- Oversee the adoption of best practices in CI/CD, data quality, and data security across engineering teams.
- Mentor junior engineers and contribute to the development of reusable frameworks and accelerators.
- Review and revise data modeling, metadata management, and data lifecycles.
- Build and optimize large-scale data platforms and AI/ML pipelines.
Benefits
- medical
- dental
- vision
- matching 401k
- employee stock purchase plan
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
