Senior/Staff Software Engineer, Data Platform

Sovrn • Boulder, CO

1d • Hybrid

About The Position

As a Senior or Staff Software Engineer on the Data Platform team, you will collaborate with cross-functional teams to enhance our data architecture, troubleshoot data processing issues, and implement solutions to ensure the integrity, efficiency, and governance of our data ecosystem. The role requires strong problem-solving skills and expertise in managing and optimizing data pipelines (ELT). The ideal candidate is passionate about building and maintaining key datasets and data infrastructure, and has a proven track record in managing data platforms. Languages / components / tools in our stack: Python, Redpanda/Kafka, Databricks/Spark, AWS/S3, Terraform, Datadog, GitHub

Requirements

• 5+ years of software engineering experience and a passion for learning
• Strong scala and python skills with an expert understanding of backend and data engineering design patterns
• A deep understanding of big data processing environments such as Spark and Databricks.
• Demonstrated experience with data processing using Spark in a production environment.
• Proven experience with orchestration tools such as Airflow and MWAA.
• Experience working in the Cloud Computing ecosystem. We use AWS heavily, but we are open to GCP, Azure, etc.
• Experience with infrastructure as code tools like Terraform and AWS CloudFormation.
• Deep understanding of relational databases, big data tables, and noSQL databases.
• Able to triage, debug, and permanently fix complex and convoluted data processing issues.
• Possesses a mature understanding of the product domain and architecture.
• A strong individual contributor that can define and architect features required by the business and product.
• Learning to apply industry best practices, design principles, and design patterns.
• Executes on defined features of scope to achieve team goals and commitments.
• Sets standards and best practices around team conventions and precedent for solving recurring problems.
• Demonstrates an aptitude for writing clean, testable, readable, maintainable, quality code.
• Experiments and takes calculated risks around proof of concept and greenfield development, ensuring the team makes the best possible decisions when solving problems.
• Can set the standard and dictate the process for clear documentation and application coding processes.
• Desire for professional growth opportunities and to be in a dynamic learning environment
• Ability to efficiently multi-task and to work cooperatively and collaboratively with all levels of employees to maximize performance, creativity, problem solving and results
• A creative yet analytical mindset with strong problem-solving skills.
• Excellent communication and collaboration skills.
• Quick to willingly jump in and help others when they are struggling with issues.

Nice To Haves

• We understand that no candidate is perfectly qualified for any job. Experience comes in different forms, many skills are transferable, and passion goes a long way. Even more important than your resume is a clear demonstration of accountability and the ability to thrive in a fluid and collaborative environment. We expect you to learn new things in this role and encourage you to apply if your experience is close to what we're looking for.

Responsibilities

• Lead architecture design, table definition, metric consistency, data modeling, and implementation of big data solutions and analytics applications.
• Work with the latest big data and analytics technologies to break down complex deliverables using industry leading big data design strategies.
• Leader for governance of business-critical product data sets within Sovrn’s data warehouse and ensure their readiness for data analysts and other internal business users.
• Architect components and configurations required for data pipeline implementation in AWS and Databricks.
• Architect data pipeline metrics to monitor performance, accuracy, and availability.
• Enable a team to research, implement, and evolve methods to process our data.
• Optimize data processing and data access to business intelligence tools.
• Work across the organization to enable business growth and development through data services and data models.
• Spot and diagnose stability issues and author improvements.
• Lead the developers with the security team to implement and maintain robust data security measures.
• Ensure compliance with relevant data governance and privacy regulations.

Benefits

• medical, dental, and vision coverage
• short and long-term disability
• life insurance
• paid parental leave
• 401(k) plan and match
• 11 paid holidays
• flexible vacation
• commuter benefits

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed