Manager, Data Engineering

BigCommerce • Austin, TX

2d • Hybrid

About The Position

Commerce is looking for an AI-first Data Engineering Manager to lead their Enterprise Data Engineering team. This role will own the roadmap for the Snowflake- and Airflow-based platforms that power reporting, analytics, AI, and data products across the business. The manager will build a team that treats AI agents as first-class teammates in the data engineering lifecycle. This is a hands-on leadership role for someone who has shipped production data pipelines, has led engineers before, and is energized by agentic workflows as a daily practice for how data gets built, tested, and monitored. The manager will coach their team on best practices in data engineering, including pairing with coding agents, building and governing autonomous pipeline and quality agents, and raising the team's bar for speed and craft.

Requirements

• 7+ years in data engineering, with 3+ years directly managing or leading a team of data engineers
• Deep, hands-on experience with Snowflake and Apache Airflow in production, including performance tuning, cost management, and workflow orchestration at scale
• Experience working with distributed teams across time zones
• Strong SQL and Python skills, and comfort reviewing or writing pipeline code alongside your team
• Experience with dbt, Fivetran/Airbyte, or similar modern ELT tooling alongside Snowflake and Airflow
• Real experience using AI coding assistants or agentic tools (e.g., Claude Code, GitHub Copilot, Cursor), Snowflake CoCo in a professional engineering workflow
• A track record of mentoring and developing engineers, including those more senior or specialized than you in a given area
• Working knowledge of data modeling, data governance, and data security/compliance practices
• Excellent communication skills — you can translate technical tradeoffs into business terms and back again
• Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent practical experience

Nice To Haves

• Experience designing or operating agentic workflows: LLM-driven pipeline monitoring, autonomous anomaly detection, RAG-based data catalogs/search, or agent frameworks such as LangGraph, AutoGen, or MCP-based tooling
• Background in ecommerce, SaaS, or marketplace data (order, catalog, or customer data at scale)
• Experience building internal platforms or self-service tooling that let analysts and other engineers move faster
• Familiarity with cost governance and FinOps practices for cloud data platforms

Responsibilities

• Lead, mentor, and grow a team of data engineers — hiring, onboarding, career development, and performance management
• Own the technical roadmap and architecture for Commerce’s Enterprise Data platform, built primarily on Snowflake and orchestrated with Airflow
• Champion an AI-first way of working by embedding agentic tools (e.g., Claude Code) into the team’s daily workflow for pipeline development, testing, documentation, and code review
• Coach and upskill engineers on agentic data engineering — designing agent-assisted or autonomous data quality checks, self-healing pipelines, and LLM-powered data products — with clear guardrails, evaluation, and human-in-the-loop review
• Partner with Analytics, Data Science, Product, and business stakeholders to translate data needs into reliable, well-governed data products
• Set and enforce standards for data quality, observability, lineage, and cost efficiency across the Snowflake/Airflow estate
• Drive modernization of data pipelines and evaluate new data and AI tooling to keep the platform on the cutting edge
• Establish design review, incident response, and documentation practices that scale the team’s impact without scaling headcount
• Report on team health, delivery, and platform reliability to engineering and business leadership

Benefits

• Compensation Transparency
• Details will be shared during the hiring process
• We are committed to equitable and transparent pay practices that align to market data, internal equity, and individual contribution
• Inclusion and Belonging
• We are an equal opportunity employer and the inclusive atmosphere we build together will make room for every person to contribute, grow and thrive
• We are committed to creating an inclusive and accessible hiring experience for all candidates
• If you require accommodations or adjustments at any stage of the recruitment process, please let us know and we will work with you to meet your needs
• Learn more about the Commerce team, culture and benefits at https://www.commerce.com/careers/
• Identity Verification
• Protect Yourself Against Hiring Scams

What This Job Offers

• Job Type: Full-time
• Career Level: Manager