Data Engineer

Stack Overflow

13h • Remote

About The Position

Stack Overflow is seeking a Data Engineer to design and deliver the data capabilities behind new application features in collaboration with software engineers and product partners. The role focuses on creating scalable connections to external systems, defining data contracts between services, transforming data into consistent models, and making it securely and reliably available to application services.

The Data Engineer will help shape data architecture, organization, and processing, including recovery from failures and scaling systems as the company grows. The role also supports shared data foundations for analysts, data scientists, and engineering teams. Success means delivering accurate, appropriately accessible data when products need it, in ways that provide value to users.

Requirements

• At least 5 years of relevant engineering experience, including building and operating production data pipelines and contributing to their architecture.
• Strong SQL and Python skills, with experience in relational databases, data modeling, and query optimization.
• Experience integrating external APIs and working with changing schemas, imperfect source data, and incremental updates.
• Experience applying software engineering practices to data systems, including version control, automated testing, code review, CI/CD tooling, observability, logging, and monitoring.
• Ability to investigate issues across ingestion, transformation, and downstream delivery.
• Ability to explain technical tradeoffs and collaborate with technical and non-technical stakeholders to deliver reliable, understandable, and maintainable solutions that provide customer value.
• Track record of sharing knowledge and helping other engineers grow, with the communication skills and self-direction to work effectively on a distributed team.
• Experience with Azure or GCP and cloud data platforms such as Databricks, Apache Spark, Delta Lake, or comparable technologies.

Nice To Haves

• Experience building data systems for customer-facing applications, particularly multi-tenant products or integrations with third-party services.
• Experience with document processing, knowledge systems, or pipelines that support AI-powered features.
• Experience with access controls, data governance, regional data requirements, or customer-data retention and deletion.
• Experience with event-driven processing, infrastructure as code, and monitoring or optimizing cloud workload costs.
• Examples of work to be proud of, from a previous role, personal project, open source, or contributions to the Stack Overflow community.

Responsibilities

• Embed with engineering teams to translate application requirements into data models, pipeline designs, and clear interfaces between systems.
• Design, build, and operate production data operations using SQL, Python, PySpark, and cloud data technologies such as Databricks, integrating APIs, databases, and structured, semi-structured, and unstructured content.
• Build ingestion and transformation workflows that deliver usable data to application services and downstream capabilities.
• Design customer-aware data flows that preserve tenant boundaries, source permissions, and data lifecycle requirements, including updates, deletions, and regional constraints.
• Improve pipeline resilience through incremental processing, checkpointing, safe retries, backfills, replay, and data-quality checks.
• Build observability to monitor data freshness, completeness, processing progress, and pipeline failures.
• Evaluate architecture and tooling choices against product needs, balancing reliability, performance, maintainability, and operating cost.
• Maintain and improve shared datasets and pipelines that support application features and internal analytics while avoiding unnecessary duplication of data and processing.
• Contribute to design reviews, testing, documentation, and deployment practices.
• Share knowledge and mentor less experienced engineers.

Benefits

• Competitive base salary.
• Generous paid vacation.
• Generous parental leave, family care leave, and unlimited sick days.
• Industry-leading health benefits applicable per country of residence for full-time employees.
• Company-paid life insurance.
• Home internet stipend.
• Professional allocation for growth and development.
• One-time allowance to assist with home office setup.
• Company-paid access to Calm, Prosus Academy, and Overdrive.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed