Big Data Engineer
About The Position
Work with tech and product teams to develop new tools and systems to support the growth of the business Create and optimize our data pipeline architecture Build data access platform for our data science and tech teams Design and implement modernized ETL through cloud-based solutions Design and develop large-scale data structures for business intelligence analytics by using data mining tools Write reliable software to ingest, transform and distribute data into our internal applications. Support infrastructure and database processes Add and improve logging and monitoring to current solutions Provide ad-hoc queries and analysis as needed.
Requirements
- 5+ years of professional experience, or MS and 3+ years
- Strong experience with databases, SQL, writing and debugging
- Professional experience with Python development
- Working knowledge of bash scripting and/or JavaScript
- Experience working with MongoDB, Redis, and PostgreSQL
- Experience with cloud-based data solutions (AWS preferred)
- Experience with automation/configuration management/enterprise schedulers
- System monitoring and alerting, dashboarding experience
- Working understanding of code and script (Java, Python, JavaScript, bash)
Responsibilities
- Develop new tools and systems
- Optimize data pipeline architecture
- Build data access platform
- Design and implement modernized ETL
- Develop large-scale data structures
- Write reliable software to ingest, transform and distribute data
- Support infrastructure and database processes
- Improve logging and monitoring
- Provide ad-hoc queries and analysis
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Number of Employees
5,001-10,000 employees
