Senior Data Engineer, Commerce Platform

Comcast • Philadelphia, PA

1d

About The Position

Make your mark at Comcast -- a Fortune 30 global media and technology company. From the connectivity and platforms we provide, to the content and experiences we create, we reach hundreds of millions of customers, viewers, and guests worldwide. Become part of our award-winning technology team that turns big ideas into cutting-edge products, platforms, and solutions that our customers love. We create space to innovate, and we recognize, reward, and invest in your ideas, while ensuring you can proudly bring your authentic self to the workplace. Join us. You’ll do the best work of your career right here at Comcast. (In most cases, Comcast prefers to have employees on-site collaborating unless the team has been designated as virtual due to the nature of their work. If a position is listed with both office locations and virtual offerings, Comcast may be willing to consider candidates who live greater than 100 miles from the office for the remote option.) Job Summary Commerce - Efficacy and Assurance (CE&A) The IT Sales & Ordering - Efficacy and Assurance (SOEA) team is a vital component of Comcast's Commerce Xperience Platform, operating alongside SalesTech and OrderTech. We ensure the efficacy, reliability, and seamless operation of commerce-related systems and processes that support Comcast's customer buyflow across Xfinity Mobile, Xfinity Internet, Xfinity TV, NOW Mobile, NOW Internet, NOW TV, and OTT services. The Engineer 4 - Data Engineering role is responsible for designing, building, and overseeing the deployment and operation of enterprise-scale data solutions that capture, manage, store, and utilize structured and unstructured data from internal and external sources. This role combines deep technical expertise in data engineering with strategic leadership in the Order Management, Provisioning, Sales, and Order Fulfillment domains. The position requires proficiency in modern data technologies, AI/ML tools, and a commitment to establishing best practices across the organization. As a recognized expert, this role provides technical leadership, mentoring, and guidance while participating in business strategy development. The engineer will leverage AI Workbench utilities for data solution design and development, ensuring compliance with organizational standards, Jira hygiene metrics, and data governance requirements. Job Description This position is ineligible for visa sponsorship. To be considered for this role, you must be legally authorized to work in the United States and not require sponsorship for employment now or in the future.

Requirements

• Expert-level proficiency in Python, Scala, and/or Java
• Strong experience with ETL/ELT processes and frameworks
• Hands-on experience with big data technologies: PySpark, Presto, Athena
• Proficiency with cloud platforms, particularly AWS (S3, Redshift, EMR)
• Experience with Databricks and modern data lakehouse architectures
• Strong SQL and database design skills
• Proven ability to lead technical initiatives and mentor junior engineers
• Strong communication skills with ability to present to senior leadership
• Experience working in Agile/Scrum environments
• Ability to translate business requirements into technical solutions
• Strong problem-solving and analytical skills

Nice To Haves

• Knowledge of on-premise platforms: Kubernetes, Teradata, minIO
• Experience with data modeling, dimensional modeling, and slowly changing dimensions
• Familiarity with streaming technologies (Kafka, Kinesis)
• Version control (Git) and CI/CD pipelines
• Experience with AI Workbench utilities for data solution design (preferred)

Responsibilities

• Design, build, and maintain efficient, reusable, and reliable code in Python, Scala, and Java to perform ETL (Extract, Transform, Load) operations
• Lead the design and implementation of robust data architecture ensuring alignment with business requirements and industry best practices
• Develop and maintain data structures and pipelines aligned to established standards for organizing, collecting, standardizing, and transforming data
• Implement solutions across hybrid environments including: On-premise platforms: Kubernetes, Teradata, minIO Cloud platforms: AWS (S3, Redshift), Databricks Big data tools: PySpark, Presto, Athena
• Determine appropriate storage platforms based on privacy, access, and sensitivity requirements
• Develop strategies for data acquisition, archive recovery, and database implementation
• Ensure data quality throughout the entire data lifecycle: ingest, processing, and final load to target tables
• Perform data profiling and data quality checks, implementing automated frameworks for identifying and resolving data quality issues
• Develop and maintain data models, data dictionaries, data lineage diagrams, and data flow documentation
• Understand and apply data sensitivity, customer data privacy rules, and regulations consistently across all Information Lifecycle Management activities
• Maintain comprehensive data lineage from source to semantic layer, including transformation rules for troubleshooting and impact analysis
• Support 95%+ reconciliation accuracy within 24 hours across SalesTech, OrderTech, and downstream systems
• Build data pipelines that support operational reporting for sales, orders, fulfillment processes, and churn rates
• Implement anomaly detection frameworks to identify fraud, order fallouts, and system errors before customer impact
• Support system integration testing by providing data validation capabilities across the customer journey
• Develop data assets that measure feature efficacy and business impact (revenue, retention, satisfaction)
• Contribute to reducing voluntary disconnects and enhancing Average Revenue Per User (ARPU) through data-driven insights
• Develop technical tools and programming that leverage artificial intelligence, machine learning, and big-data techniques for: Data cleansing and organization Automated data transformation Data structure maintenance and integrity Predictive analytics and insights
• Utilize Copilot and prompt engineering throughout the full SDLC to: Create high-level solutions and user stories Enhance code generation and debugging Improve overall software quality
• Leverage AI Workbench utilities for data solution design and data development
• Practice test-driven development in an Agile/Scrum environment
• Collaborate with product leads, developers, and product owners to understand business problems and create/augment data assets accordingly
• Work with stakeholders including Executive, Product, Data, and Design teams to support data infrastructure needs
• Interface with development teams and technical/functional architects to ensure optimal solution design
• Translate complex functional and technical requirements into detailed technical designs
• Conduct design reviews and oversee code reviews to ensure quality standards
• Mentor team members in relevant technologies, implementation architecture, and best practices
• Mentor, review code, and verify adherence to object-oriented design best practices and architectural guidelines
• Present solutions to senior architects and leadership
• Collaborate across SOEA sub-teams (Commerce Sales, Orders, Risk, Billing & Payments, Fulfillment & Provisioning, etc.)
• Review internal and external business and product requirements for data operations; suggest changes and upgrades to accommodate ongoing needs
• Develop user stories and requirements based on stakeholder and end-user needs
• Track and document requirements for enterprise development projects and enhancements
• Monitor current and future trends, technologies, and information; apply and integrate emerging technological trends
• Develop solution architecture (tactical and strategic) to support enterprise needs
• Participate in the development of business strategy
• Make far-reaching decisions that set precedents for business and technology
• Leverage expertise in Order Management, Provisioning, Sales, and Order Fulfillment domains
• Ensure programs are envisioned, designed, developed, and implemented to meet enterprise business needs for Xfinity and NOW products (Mobile, Internet, TV, OTT)
• Design and develop updated infrastructure in support of business processes
• Balance tactical and strategic technology solutions
• Consider business problems end-to-end: people, process, and technology

Benefits

• Medical & Dental
• 401(k) Savings Plan
• Generous paid time off
• Life Milestones - from adoption assistance, childcare resources, pet insurance, and more, Comcast supports you at all life stages.
• Courtesy Services - We offer all of our full-time employees in serviceable areas free digital TV and internet.
• Discount tickets for Universal Resorts, including theme park tickets and onsite hotel rooms.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level