Senior Data Engineer (Data)

Stable Kernel • Atlanta, GA

6d • $140,000 • Hybrid

About The Position

As a Stable Kernel Senior Software Engineer (Data), you play an essential role in setting our portfolio of world-class clients up for success through the development and delivery of their most innovative, transformational data initiatives. You will collaborate daily with other data engineers and a product owner to design, develop, and optimize scalable data pipelines that enable clients to extract actionable insights crucial to the health of their business. You have every opportunity to grow your skills and knowledge using a modern, feature-rich cloud-native data stack.. Your knowledgeable practice, reliability, and consultative nature make you a data engineer that stakeholders and teammates trust.
As a senior software engineer, you’ll take ownership of pipeline development and implementation, data model creation and refinement, and determine methods of extracting data from upstream data sources. You’ll own implementing system-wide data patterns compliant with architectural decision records and consistent with technologies in the data stack.
Senior Data Engineers may be classified as individual contributors or people managers with individual contributor responsibilities.

Requirements

• Extensive experience using Python.
• Designing and building data pipelines:
• Developing and maintaining scalable ETL/ELT pipelines using, among other technologies, AWS services such as AWS Glue, Lambda, and Step Functions to extract, transform, and serve data from upstream sources.
• Data Integration:
• Custom extraction from non-SQL sources (e.g., APIs) using established industry patterns for incremental and full snapshot datasets using Python and standard data engineering/data science libs
• Data Quality Management:
• Implementing and enforcing data quality checks to ensure the accuracy, consistency, and reliability of data across systems.
• Create and manage CI/CD to deploy system and data changes
• 7-10 years of development experience.
• Degree in Computer Science or relevant field or experience.

Nice To Haves

• Proven experience using additional programming languages is a plus.
• Experience creating cloud resources using Infrastructure as Code technologies such as Terraform or Pulumi.

Responsibilities

• Design and implement robust data pipelines, with an eye to the growth of the product and team, improving the speed of future work and ensuring high data quality and contributing to DataOps/DevOps initiatives to ensure complete and timely data flows.
• Improve performance of data pipelines and data lake queries used by data analysts.
• Apply your firm grasp of the concepts and practices of data engineering in the areas of ingestion, transformation, serving with a strong awareness of system and project needs for security, data management, DataOps, Data architecture, orchestration and standard software engineering practices.
• Providing expert feedback that improves the overall delivery of work.
• Defending the work against compromise and corner-cutting.
• Designing test strategies and involving yourself in CI/CD and automated testing for high system reliability.
• Mentoring others in best practices.
• Ensuring a high standard of quality across the project.
• Identifying, diagnosing, and resolving complex pipeline and data issues.
• Understanding the client's business and goals and using them to create and update roadmap issues.
• Identifying opportunities to provide additional value for our clients by suggesting and delivering improvements based on your observations.
• Contributing to the estimation of work for high-level planning and costing that clearly identifies gaps, risks, and assumptions.
• Coordinating with data stakeholders outside your team as necessary.
• Influencing your team’s roadmap.
• Advising people across the Director and VP-levels of the organization.
• Reporting status with a general understanding of where each member's work is.
• Designing and supporting long-term roadmaps with limited direction and requiring no direction on project plans.
• Considering and planning around cross-department dependencies to most effectively break down work across the team and solicit data product use cases and requirements.
• Working with ambiguity to define and break down challenging projects (e.g., projects that are hard to derive benefits from until the end of the project, projects that are very large, or projects that have a lot of uncertainty or require novel solutions).
• Making trade-offs between short-term and long-term solutions.
• Evaluating trade-offs others are making.
• Analyzing the effectiveness of decisions and demonstrating accountability for outcomes.
• Anticipating, recognizing, and mitigating risks to prevent potential roadblocks.
• Escalating issues and bringing recommended solutions to the table.
• Setting a positive example by using our company values and imperatives as a north star.
• Providing regular constructive feedback.
• Resolving conflicts.
• Guiding less experienced colleagues through complex projects.
• Leading team learning sessions.
• Demonstrating strong project roadmapping skills, including planning, delegating, and monitoring progress.
• Making critical decisions and driving projects to successful completion.
• Representing the team in client conversations.
• Taking ownership and contributing to process improvements that positively impact the work.
• Advocating for best practices across your project or client program.
• Mentoring junior and intermediate colleagues by helping them grow professionally.
• Leading projects.

Benefits

• Company-subsidized health, vision, and dental plan premium options beginning on the first day of employment
• 401k with above-average company matching
• Fully paid Group Life, Short and Long Term Disability, and AD&D insurance
• Optional Flexible Spending Account and Health Savings Account participation
• Voluntary Life, Critical Illness, and Accident insurance
• EAP and Health Advocacy program available at no cost to employees and their dependents
• $3000+ annual industry educational budget
• Paid time off and paid holidays
• Access to Perks at Work program featuring a variety of discounted products and services

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Number of Employees: 101-250 employees