Data Platform Engineer

New Balance AthleticsBoston, MA
257d

About The Position

New Balance is seeking a skilled Data Platform Engineer to join the Data & Analytics team and help build and maintain our cutting-edge cloud-based data platform. In this role, you will leverage your expertise in cloud technologies, particularly Azure, Databricks, and Snowflake, to design and implement scalable, efficient, and secure data solutions. You will work collaboratively with data engineers, data operations engineers, analysts, and cross functional teams to help deliver quality data products.

Requirements

  • Bachelor's degree in computer science, Engineering, or a related field is required; Master's is preferred.
  • 5+ years of experience in data platform engineering, platform engineering, scaling enterprise AI solutions using ML/AI infrastructure services.
  • Expertise in MLOps and distributed systems, as well as cloud-native architectures.
  • Proven track record in business partnership with strong communication and problem-solving skills, and attention to detail.
  • Strong technical competence, with the capability to understand and debate technical and product tradeoffs, and approach building scalable architectures.
  • Strong proficiency with SQL, Python, PySpark.
  • Knowledge of data governance and compliance standards (e.g., GDPR, CCPA).
  • Hands-on experience with Snowflake, including Snowflake architecture and best practices.
  • Experience with Databricks, including knowledge of Unity Catalog, PySpark and Databricks Jobs.
  • Experience with Azure DevOps, GitHub Actions or other CI/CD tools.

Nice To Haves

  • Familiarity with real-time data streaming technologies (e.g., Snowpipe Streaming, Kafka, Azure Event Hubs).
  • Familiarity with one or more of the following AI/ML Tools & Libraries: Dataiku, AWS Sagemaker, TensorFlow, PyTorch, Scikit-learn, MLFlow.
  • Experience with Generative AI applications and infrastructure preferred.

Responsibilities

  • Design, improve and implement scalable cloud-native data platforms, leveraging technologies such as Azure, Snowflake and Databricks.
  • Automate platform deployment pipelines for data infrastructure and applications and apply Infrastructure as Code (IaC) principles for comprehensive management of cloud resources.
  • Collaborate with data scientists and analysts to understand their needs, accelerate their workflows and support their data needs.
  • Work with other engineering teams such as Cloud and Security to inform system design and integrate new systems into enterprise stack.
  • Implement and optimize data pipelines for efficient ETL/ELT processes and AI/ML applications.
  • Ensure data security, compliance, and governance across all cloud platforms.
  • Monitor and optimize system performance, scalability, and cost-efficiency.
  • Implement and maintain data quality checks, data and model observability solutions.
  • Participate in architectural discussions and contribute to best practices for cloud data engineering.

Benefits

  • Comprehensive traditional benefits package including three options for medical insurance, dental, vision, life insurance and 401K.
  • Opportunities for online learning and development courses.
  • Tuition reimbursement.
  • $100 monthly student loan support.
  • Various mentorship programs.
  • Yearly $1,000 lifestyle reimbursement.
  • 4 weeks of vacations.
  • 12 holidays.
  • Generous parental leave.

Stand Out From the Crowd

Upload your resume and get instant feedback on how well it matches this job.

Upload and Match Resume

What This Job Offers

Job Type

Full-time

Career Level

Mid Level

Industry

Clothing, Clothing Accessories, Shoe, and Jewelry Retailers

Education Level

Bachelor's degree

© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service