Data Engineer II

SelectQuote, Inc. • UNAVAILABLE, Remote

4d • Onsite

About The Position

Responsible for developing data solutions with a strong understanding of data engineering concepts and the ability to apply those concepts broadly across multiple technologies. The Data Engineer II must have the ability to work with business users to help integrate data from multiple sources and technologies and make that data available for use in reporting and system integration.

Requirements

• Bachelor’s/Master’s degree in Engineering, Computer Science (or equivalent experience) required
• 4+ years of experience engineering data systems required
• 2+ years with Apache Airflow or equivalent training required
• 2+ years of Python development using advanced modules (e.g., Pandas, NumPy) required
• 2+ years using ETL tools required
• 2+ years of troubleshooting stored procedures and other T-SQL required
• Experience working with external REST APIs required
• Experience with AWS ETL services and concepts (Glue, S3, Lambda, boto3)
• Knowledge of various file formats (e.g., JSON, CSV, Parquet, fixed-width)
• Experience with version control (Git CLI) and CI/CD preferred
• Microsoft SQL Server performance tuning
• Strong analytical skills
• Objectivity and openness to others views, providing solutions and creative input
• Must be able to adjust when there is a shift in priorities
• Excellent communicator with individuals and groups at all levels
• Detail-oriented, organized, and able to manage user expectations
• Good organizational, time management, and listening skills
• Self-motivated and excited to work with different technologies.
• Understanding of ETL concepts and ability to apply those concepts to multiple technologies
• Comfortable working with source control (bitbucket, git, GitHub)

Nice To Haves

• Experience working with C# or other statically typed languages is a plus
• Experience with Data Lake development is a plus
• AWS Certified Cloud Practitioner or higher level is preferred
• AWS Certified Data Engineer - Associate is a plus

Responsibilities

• Manage existing streaming, batching, and event-based data pipeline solutions while looking for opportunities to improve them.
• Independently translate business requirements into data solutions while maintaining a high level of accuracy and data integrity.
• Independently translates business requirements into technical terms for other team members.
• Collaborate with other team members to consolidate the data landscape to reduce the development time and increase consistency among data engineering solutions.
• Take ownership of complex projects and ensure their complete and accurate execution with an emphasis on delivering business value.
• Recommend changes to project architecture while following architecture guidelines set by senior developers.
• Demonstrate quality for junior team members and can provide guidance as needed.

Benefits

• Competitive Medical, Dental, and Vision Insurance
• HSA/FSA
• Voluntary Hospital Indemnity, Critical Illness, Accident Insurance, and Short Term Disability
• Voluntary Life Insurance for Self, Spouse and Dependent
• Company-paid Basic Life Insurance and Long Term Disability
• Retirement plan and Employer match contribution with Profit Share
• Tuition Reimbursement program
• Company perks and Discount program
• Engaging Wellness and Financial Education Resources
• Employee Assistance Program
• Incentive Plans

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: Associate degree