Senior/Staff Software Engineer, Data Platform

Sovrn•Boulder, CO

1d•$155,000 - $200,000•Hybrid

About The Position

As a Senior or Staff Software Engineer, on the Data Platform team, you will collaborate with cross-functional teams to enhance our data architecture, troubleshoot data processing issues, and implement solutions to ensure the integrity, efficiency, and governance of our data ecosystem. The role requires strong problem-solving skills and expertise in managing and optimizing data pipelines (ELT). The ideal candidate is passionate about building and maintaining key datasets and data infrastructure, and has a proven track record in managing data platforms. Languages / components / tools in our stack: Python, Redpanda/Kafka, Databricks/Spark, AWS/S3, Terraform, Datadog, GitHub

Requirements

5+ years of software engineering experience and a passion for learning
Strong scala and python skills with an expert understanding of backend and data engineering design patterns
A deep understanding of big data processing environments such as Spark and Databricks.
Demonstrated experience with data processing using Spark in a production environment.
Proven experience with orchestration tools such as Airflow and MWAA.
Experience working in the Cloud Computing ecosystem. We use AWS heavily, but we are open to GCP, Azure, etc.
Experience with infrastructure as code tools like Terraform and AWS CloudFormation.
Deep understanding of relational databases, big data tables, and noSQL databases.
Able to triage, debug, and permanently fix complex and convoluted data processing issues.
Possesses a mature understanding of the product domain and architecture.
A strong individual contributor that can define and architect features required by the business and product.
Learning to apply industry best practices, design principles, and design patterns.
Executes on defined features of scope to achieve team goals and commitments.
Sets standards and best practices around team conventions and precedent for solving recurring problems.
Demonstrates an aptitude for writing clean, testable, readable, maintainable, quality code.
Experiments and takes calculated risks around proof of concept and greenfield development, ensuring the team makes the best possible decisions when solving problems.
Can set the standard and dictate the process for clear documentation and application coding processes.
Desire for professional growth opportunities and to be in a dynamic learning environment
Ability to efficiently multi-task and to work cooperatively and collaboratively with all levels of employees to maximize performance, creativity, problem solving and results
A creative yet analytical mindset with strong problem-solving skills.
Excellent communication and collaboration skills.
Quick to willingly jump in and help others when they are struggling with issues.

Nice To Haves

Experience comes in different forms, many skills are transferable, and passion goes a long way.
Clear demonstration of accountability and the ability to thrive in a fluid and collaborative environment.
Learn new things in this role

Responsibilities

Lead architecture design, table definition, metric consistency, data modeling, and implementation of big data solutions and analytics applications.
Work with the latest big data and analytics technologies to break down complex deliverables using industry leading big data design strategies.
Leader for governance of business-critical product data sets within Sovrn’s data warehouse and ensure their readiness for data analysts and other internal business users.
Architect components and configurations required for data pipeline implementation in AWS and Databricks.
Architect data pipeline metrics to monitor performance, accuracy, and availability.
Enable a team to research, implement, and evolve methods to process our data.
Optimize data processing and data access to business intelligence tools.
Work across the organization to enable business growth and development through data services and data models.
Spot and diagnose stability issues and author improvements.
Lead the developers with the security team to implement and maintain robust data security measures.
Ensure compliance with relevant data governance and privacy regulations.