Data Engineer II (ICP)
About The Position
The Data Engineer II ICP designs, develops, codes, implements, and supports Integration processes and Data Warehouse activities. Data Engineer II works closely with the business and translates the requirements into technical specifications to deliver a robust scheduled job to ingest and disseminate the information. Data Engineer II possesses programming skills to develop, customize and manage integration tools, databases, warehouses, and analytical systems. Data Engineer II monitors, troubleshoots and supports the production data pipeline jobs that transfer data to and from the databases. Data Engineer II mentors' other junior members on best practices and design patterns. Experience in utilizing data Ingestion, data transformation and data quality tools, leveraging tools such as the Unified Catalog or Microsoft Purview, will be highly valued and differentiated.
Requirements
- Bachelors Computer Science or related field Required
- 2 years, Data Lake House or Enterprise Data Required
- 2 years, Database development (Python, SQL, PL/SQL, Bash) Required
- 2 years, Experience Big Data (Data Bricks or Apache Spark or similar) Required
- 3 years, Data Engineering experience with any integration/ETL tool/Application. Required
Nice To Haves
- Masters Computer Science or related field Preferred
- 1 year, Experience with cloud technologies such as Azure or AWS Preferred
- 2 years, Healthcare or related experience Preferred
Responsibilities
- Code, test, and implement integration software to ETL solution.
- Develop efficient mappings for data extraction/transformation/loading (ETL) from different sources to a target data lake house/warehouse.
- Schedule and integrate application/software logs to monitoring application.
- Implement stored procedures and effectively query the Storage systems (Data Lakehouse/Data Warehouse, MySQL, Oracle, SQL Server) database.
- Debug and troubleshoot errors and provide required support to the production jobs.
- Produce in-depth documentation of all development, policies and procedures.
- Participate in development planning sessions, weekly team status meetings and create/update appropriate project management documentation as required.
- Available for occasional off-hours emergencies. support activities related to on call procedures.
- Maintain current knowledge in new and existing software to ensure productivity, capability, and return on investment.
- Performs other duties as assigned.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
