Senior Analytics Platform Engineer

MSDNew York, NY
19h$117,000 - $184,200Hybrid

About The Position

As a Platform Engineer you will design, deploy, and maintain data platforms, predominantly concentrating on Databricks. This role involves both creative and analytical skills to solve complex problems and create efficient, reliable solutions. You will use your expertise in requirements analysis, programming languages, development methodologies, and tools to build and deliver platforms that meet the needs of businesses, organizations, or end-users. You will work with other engineers, product managers and technical leads, you will help to design systems, determine functional and non-functional needs requirements and implement them accordingly. You should be ready to work independently as well as in a team.

Requirements

  • Bachelor’s degree in information technology, Computer Science or any Technology stream.
  • 5+ years of hands-on experience working with IaC Terraform, SQL and databases, Analytics platforms, DevOps tools and REST API.
  • Excellent knowledge of Databricks as a user and architect, incl. network patters of how it is deployed as SaaS solution.
  • Excellent Cloud knowledge, ideally AWS certified with good understanding of AWS core service like EC2, EKS, S3, RDS, VPC networking, Security Groups, subnets, IAM roles/policies, Route 53, Transit Gateways, Load Balancing, Lambda, KMS.
  • Deep knowledge of DevOps tools and practices (like GitHub, GitHub Actions) for code versioning and deployment.
  • Understanding modern product development principles – Agile, test-driven development, UX, design thinking.
  • Knowledge of development practices such as infrastructure observability, continuous integration/continuous deployment - CI/CD, containerization.
  • Some experience with networking principles is necessary.

Nice To Haves

  • Proficiency with other programming languages (Scala, R, Java) is preferred.
  • Experience with Trino, Redshift and Grafana is preferred.

Responsibilities

  • Participate in defining the platform standards and architecture patterns primarily for the enterprise-wide implementation of Databricks platform.
  • Author, review, and maintain Terraform modules and state management for multi‑account/multi‑environment deployments.
  • Implement reusable and repeatable environment provisioning and configuration
  • Create and maintain clear documentation: platform design, Infrastructure as Code patterns, operational runbooks, best practices regarding coding, security and compliance.
  • Develop, verify, test, document, amend and refactor CI/CD pipelines and the platform configurations for deployment in collaboration with cross-disciplinary teams.
  • Integrate platform with data governance tooling (catalogs, lineage, access controls).
  • Utilize system life cycle working practices for platform components delivery.
  • Deploy automation to achieve well-engineered and secure outcome.
  • Contribute to the development of solution architectures in specific business, infrastructure or functional areas.
  • Participate in evaluation of alternative solutions and approaches to the current architecture and the trade-offs in cost, performance and scalability.
  • Work within a matrix organizational structure, reporting to both the functional manager and the Product manager.
  • Participate in planning, execution, and delivery of the platform ensuring alignment with both functional, product and company goals.

Benefits

  • The successful candidate will be eligible for annual bonus and long-term incentive, if applicable.
  • We offer a comprehensive package of benefits. Available benefits include medical, dental, vision healthcare and other insurance benefits (for employee and family), retirement benefits, including 401(k), paid holidays, vacation, and compassionate and sick days.
  • More information about benefits is available at https://jobs.merck.com/us/en/compensation-and-benefits.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service