Engineering - Data - Data Engineer

LightBox

14h

About The Position

LightBox is seeking a Data Engineer to join its Data Integration team. The role designs, builds, and maintains reliable data pipelines, data-intensive applications, and AI-enabled automation that support LightBox products. The successful candidate works with large, diverse datasets and partners with engineering, product, and data stakeholders to deliver trusted, scalable data solutions. It is a hands-on, mid-career role for an engineer who enjoys solving practical data problems and taking ownership of well-defined work with team support.

Responsibilities may evolve as business needs change. The position may require work outside standard business hours, including occasional holiday, evening, or weekend hours, to meet deadlines or support customers and production operations. Employees may also be assigned other tasks, responsibilities, and training by their supervisors.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
• At least 2 years of relevant industry experience, including building and maintaining production ETLs.
• High proficiency in at least one SQL dialect, Python, and at least one scalable data processing framework such as Spark, DuckDB, or Polars.
• Experience designing, building, and operating batch and/or event-driven data pipelines.
• Experience with a workflow orchestration platform such as Prefect, Airflow, or Dagster, and familiarity with distributed data processing.
• Experience with cloud data and infrastructure services in AWS and/or GCP.
• Familiarity with modern data storage formats and technologies, including Apache Parquet and Delta Lake.
• Working knowledge of GitHub workflows, including pull requests, code review, branching, and CI/CD automation with GitHub Actions.
• Clear communication, curiosity, and a collaborative approach to problem-solving.

Nice To Haves

• Experience using Codex or other LLM-assisted development tools to generate and refine code from specifications, with strong code-review and testing practices.
• Experience processing large-scale geospatial or location-based data.
• Experience with data modeling and designing data solutions for multiple product or business use cases.
• Experience supporting production data workflows with monitoring, alerting, and incident-response practices.

Responsibilities

• Build, test, and maintain batch and event-driven data pipelines and ETL/ELT workflows.
• Transform, validate, and organize data for product features and downstream consumers.
• Investigate pipeline and data-quality issues, troubleshoot root causes, and implement fixes.
• Improve existing workflows for reliability, efficiency, and maintainability, and support platform modernization.
• Work with engineering, product, and data stakeholders to understand requirements and deliver solutions.
• Follow team practices for version control, code review, testing, monitoring, and documentation.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level