Senior Data Engineer
About The Position
We are looking for a talented Senior Data Engineer to join the team that builds the essential data infrastructure at the heart of InMarket's product suite. You should be a quick learner who is enthusiastic about learning new technologies, and a passionate engineer who empowers fellow engineers to write clean and efficient data pipelines. You will implement technical solutions to empower internal and external customers and scale the existing data platform, working closely with end users to define key business questions, leading fellow engineers to define technical solutions, and partnering with Product Managers to build the data sets that answer those questions. You will work with huge datasets and build ETLs that bring data together to answer business questions, drive reporting, and fuel growth.
Requirements
- Strong SQL experience
- Expertise in at least one data pipelining orchestration framework (Airflow, Luigi, etc.)
- Experience building ETL pipelines
- Strong software engineering skills in an object-oriented language such as Java or Python
- Experience building and optimizing a data warehouse on a major cloud platform (BigQuery preferred but not required)
- Deep understanding of Big Data technologies such as Hadoop and Spark
- Experience building and optimizing large-scale, high-performance systems
- Extensive knowledge of data-related tools and architecture concepts on a major cloud platform
- Knowledge of Kubernetes, Docker, Airflow, Git, and CI/CD best practices
- Strong collaboration and communication skills within and across teams
- B.S. or M.S. in Computer Science or a related technical field
- At least 4 years of software engineering experience, ideally in data engineering
- All applicants must be authorized to work for any employer in the U.S. We are unable to sponsor or take over sponsorship of an employment visa at this time.
Nice To Haves
- Experience optimizing BigQuery performance
- Experience building a data governance platform in a regulated environment
- Experience with various data testing frameworks and technologies
- Familiarity with the digital media/advertising industry
Responsibilities
- Design and implement ETL pipelines in Apache Airflow, BigQuery, Python, and Spark to transform upstream source data into curated data assets used across InMarket's data-driven products
- Architect and plan projects involving highly distributed, high-performance data platform systems
- Identify areas for improvement in existing pipelines and processes
- Understand business requirements and convert them into technical solutions
- Stay current with and advocate internally for Data Engineering best practices, technologies, and testing frameworks that shape InMarket's technical future
- Provide technical guidance to other engineers to help grow their knowledge and technical capabilities
- Lead fellow engineers in defining technical solutions to business problems
- Work closely with end users to define key business questions, and with Product Managers to build the data sets that answer them
- Communicate complex concepts and analysis results clearly and effectively to Product and Engineering Managers
Benefits
- Competitive salary and stock options
- Flexible vacation / Unlimited PTO (within reason)
- Medical, dental, and Flexible Spending Account (FSA)
- Company-matched 401(k)
- Paid Paternity & Maternity Leave
- Agile Development Program for continued learning and professional development
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
