Data Engineer II

About the position

The Data Engineer II will design, develop, and implement data pipelines, data integration and data storage solutions such as data warehouses, data lakes, relational and non-relational databases. The role will partner closely with IT Managers, Enterprise Business Intelligence, Data Governance and Data Science teams to solve business-significant data problems and enable data-driven decision-making, automation, and optimization. Data is central to ICW Group's business strategy and digital evolution, and the Data Engineer ensures optimal data delivery architecture is consistent throughout all projects.

Responsibilities

• Builds data solutions that ensure data integrity and information usability for enterprise-wide digital solutions and decision making.
• Creates and maintains scalable data pipelines and solutions (batch and/or streaming) that make the best use of traditional and cloud platforms (AWS or similar).
• Provides analysis of complex data elements and systems, data flow and in development of conceptual, logical, and physical data models.
• Conducts unit, integration, and system tests on data sources to validate data against source systems.
• Builds pipelines that are reliable, efficient, testable, and maintainable.
• Maintains a good understanding of the current landscape and assists in the analysis of data deficiencies, gaps, and opportunities.
• Contributes to building the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using 'big data' technologies and tools.
• Works closely with BI and Data Science teams in implementing various data streams.
• Collaborates with data architects to ensure the output of the physical models meet required needs.
• Partners with Enterprise Architecture, Technology, and Project teams to ensure consistency of solutions approach while maintaining data governance requirements.
• Contributes to data governance and data quality best practices including design reviews, unit testing, code reviews, and continuous integration and deployment.
• Collaborates with the Enterprise Architecture team to drive tooling and standards to improve the productivity and quality of output for data engineers across the company.

Requirements

• Bachelor's degree in Computer Science, Applied Mathematics, Engineering, or any other technology related field required.
• Minimum 3 years of experience in a data integration (Cloud/Traditional) engineering related role required.
• Expertise with database & data warehouse design, using MS-SQL, PostgreSQL etc.
• Knowledge of Model and Design of DB schemas for read and write performance.
• Working knowledge of API or stream-based data extraction processes.
• Experience performing root cause analysis on internal and external data and processes.
• Experience with AWS technologies like Redshift, S3, EC2, Glue, EMR, Kinesis, Lambda, DynamoDB, etc.
• Experience with modern data architectures and modern data platforms like Snowflake, Databricks etc.
• Experience with data technologies: Hadoop, Spark, Kafka, Spark & Kafka Streaming, Python, Scala, Talend etc.
• Knowledge and experience with data movement tools - SSIS, Profisee, Alteryx, Informatica.
• Strong analytical and time management skills.
• Ability to cross collaborate with multiple teams and offer value-added solutions.

Nice-to-haves

• Insurance experience a plus.
• Data architecture or data engineering related certifications strongly desired.
• AWS Cloud Practitioner or more advanced AWS certification preferred.

Benefits

• Competitive benefits package, with generous medical, dental, and vision plans.
• 401K retirement plans and company match.
• Bonus potential for all positions.
• Paid Time Off with an accrual rate of 5.23 hours per pay period (equal to 17 days per year).
• 11 paid holidays throughout the calendar year.
• Support for continued learning.