Principal Data Engineer

Stable Kernel • Atlanta, GA

1d • Hybrid

About The Position

As a Stable Kernel Principal Data Engineer, you play an essential role in setting our portfolio of world-class clients up for success through the development and delivery of their most innovative, transformational initiatives. You will collaborate daily with other engineers and product team members, make decisions that influence the path of a product roadmap, leverage software development best practices, and become a more well-rounded engineer as you learn new technologies. Your knowledgeable practice, reliability, and consultative nature make you an engineer that stakeholders and teammates trust. Principal Data Engineers may be classified as individual contributors or people managers with individual contributor responsibilities.

Requirements

• Migrating production systems to ELT platforms like Databricks or Snowflake.
• One or more programming languages (Mastery of Python and Go strongly preferred).
• Integrating BI platforms like Tableau or Looker for business insights.
• Event systems like Kafka.
• Dimensional modeling and data warehouse design and migrations.
• Apache Spark for large-scale data processing.
• Cloud platforms (AWS, Azure, or GCP), including managed data services.
• Workflow orchestration tools like Airflow, Dagster, or Databricks Workflows.
• Implementing data quality frameworks and validation testing.
• Infrastructure as code (Terraform, Pulumi) and CI/CD for data pipelines.
• Version control practices with Git, including branching strategies for collaborative development.
• 7-10 years of development experience.
• Track record of incrementally migrating legacy systems while maintaining business continuity.
• Ability to translate business requirements into technical data models.
• Experience partnering with analysts and business stakeholders to define metrics and reporting needs.
• Comfortable working in ambiguous environments where requirements evolve.
• Degree in Computer Science or relevant field or experience.

Nice To Haves

• Experience with data catalog and lineage tools (Unity Catalog, Atlan, etc.).
• Familiarity with real-time/streaming architectures alongside batch processing.

Responsibilities

• Designing and implementing exemplary solutions regarding scalability and cost-effectiveness by making trade-offs between opportunity and complexity.
• Setting standards for codebase health and promoting best practices throughout the organization.
• Clarifying strategic outcomes and influencing roadmaps and projects.
• Identifying, suggesting, and driving improvements in your customers' end-to-end experience.
• Aiding in estimating work for new business with more unknowns and coaching others in estimation best practices.
• Coordinating across the entire company.
• Influencing the entire organization to make changes to support your work.
• Advising teams across the company.
• Designing a long-term roadmap with no direction.
• Translating customer and business needs and strategic direction into projects and consistently simplifying high-complexity situations.
• Coaching and mentoring others in tackling ambiguity.
• Decomposing strategic direction into projects:
• Planning, communicating, and executing to solve our most challenging problems.
• Ensuring alignment with long-term objectives, fostering a culture of informed decision-making and innovation.
• Anticipating most risks and driving simplification to mitigate risks ahead of time.
• Escalating issues while solving them in parallel ensuring others are informed.
• Proposing new organization-level processes to improve key areas such as team throughput, employee happiness, or product engagement.
• Driving best practices across the organization.
• Exhibiting exceptional mentoring abilities and fostering a culture of continuous learning and improvement by identifying and nurturing potential in others, providing strategic guidance, helping develop career paths for team members.
• Leading projects.
• Setting the strategic direction for projects or areas of technology, leading multiple project teams, and influencing decision-making at higher organizational levels.
• Exhibiting strong capabilities in stakeholder management, negotiating, and problem-solving in complex scenarios.
• Mentoring and developing other leaders within the team, fostering a culture of innovation, and contributing significantly to organizational goals.

Benefits

• Company-subsidized health, vision, and dental plan premium options beginning on the first day of employment
• 401k with above-average company matching
• Fully paid Group Life, Short and Long Term Disability, and AD&D insurance
• Optional Flexible Spending Account and Health Savings Account participation
• Voluntary Life, Critical Illness, and Accident insurance
• EAP and Health Advocacy program available at no cost to employees and their dependents
• $3000+ annual industry educational budget
• Paid time off and paid holidays
• Access to Perks at Work program featuring a variety of discounted products and services

What This Job Offers

• Job Type: Full-time
• Career Level: Principal
• Education Level: No Education Listed