Data Engineer II (Python / PySpark / SQL)
About The Position
Our client is a leading global technology company recognized for building innovative consumer software and data-driven digital products. They are seeking a Data Engineer II to join a high-impact analytics and machine learning team responsible for developing scalable data solutions that power business insights and intelligent decision-making. This is an excellent opportunity for a data professional who enjoys building robust data pipelines, working with large-scale datasets, and collaborating with analysts and data scientists to enable advanced analytics and machine learning initiatives.
Requirements
- 5+ years of overall experience in Data Engineering, Data Analytics, or a related field.
- 2+ years of hands-on experience developing enterprise-scale solutions using PySpark.
- 4+ years of experience with data modeling and designing scalable data solutions.
- Strong programming skills in Python, including object-oriented programming concepts.
- Advanced SQL skills with experience querying and transforming large datasets.
- Experience building and maintaining production data pipelines.
- Strong troubleshooting and debugging skills in production environments.
- Excellent communication and collaboration skills with technical stakeholders.
Nice To Haves
- Experience supporting machine learning feature engineering pipelines.
- Familiarity with large-scale distributed data processing environments.
- Experience working in Agile development environments.
- Passion for mentoring teammates and sharing technical knowledge.
Responsibilities
- Design, build, and maintain scalable feature engineering pipelines for analytics and machine learning applications.
- Develop efficient, incremental data pipelines using PySpark to process enterprise-scale datasets.
- Create and optimize data models that support reporting, analytics, and predictive modeling.
- Monitor production data pipelines, troubleshoot issues, and ensure high availability and data quality.
- Collaborate closely with data scientists, analysts, and engineering teams to prioritize business requirements.
- Write clean, maintainable, object-oriented Python code following best practices.
- Optimize SQL queries and data processing workflows for performance and scalability.
- Support continuous improvements to data infrastructure and pipeline reliability.
- Mentor team members and promote best practices for feature engineering and data development.
Benefits
- Competitive W2 compensation
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Education Level
No Education Listed
