Data Engineer II (Hybrid)

American Medical Association•Chicago, IL

3d•$85,396 - $112,925•Hybrid

About The Position

AMA Insurance (AMAI) offers life, health and disability insurance at affordable and exclusive rates to help doctors achieve a healthy and secure financial future. AMAI is part of the American Medical Association (AMA), a nonprofit, and the nation's largest professional Association of physicians. We are a unifying voice and powerful ally for America's physicians, the patients they care for, and the promise of a healthier nation. To be part of the AMA is to be part of our Mission to promote the art and science of medicine and the betterment of public health. As an employer, we are dedicated to many efforts, including employee learning and development, social responsibility, diversity and inclusion and wellness. Our well-defined culture has strongly impacted the prosperity of our organization. Our foundational values of Respect, Integrity, Innovation, Impact, Collaboration, Agility and Trust are at the core of our efforts and continue to shape the success of the AMA. We have an opportunity at our corporate offices in Chicago for a Data Engineer II (Hybrid) on our AMA Insurance team. This is a hybrid position reporting into our Chicago, IL office, requiring 3 days a week in the office. This role is responsible for data ingestion, transformation, automation, and validating file based integrations. This role focuses on building and maintaining automation scripts for file extractions, managing structured and semi structured data files, and supporting reporting needs across the agency. This role requires working knowledge and experience in their job discipline with broadened capabilities. Performs a range of assignments related to the job discipline and uses prescribed guidelines or policies in analyzing situations. This role receives a moderate level of guidance and direction and continues to build knowledge of the AMA Mission and processes.

Requirements

Strong experience with SQL Server (complex queries, reporting, data updates)
Hands on experience with Snowflake data loading, staging, and extraction
Proficient in PowerShell scripting for automation and system integrations
Proficient in Python scripting for automation and system integrations
Proficient in Python scripting for file handling and automation
Experience working with FTP servers and external system integrations
Solid understanding of data quality, validation, and transformation
Demonstrated ability to multi-task and effectively manage multiple, concurrent projects with minimal supervision
Polished interpersonal skills, including proven liaison and relationship building skills
Written and verbal communications skills, including ability to collaborate with technical and nontechnical colleagues

Responsibilities

Process and clean Excel, CSV, and other flat files for various claims and administration related data with high volumes
Identify and resolve duplicates, inconsistencies, and data quality issues within these files
Transform files to required schemes and formats for downstream consumption
Load, stage, update, extract data in Snowflake
Perform manual and scheduled Snowflake runs
Prepare and transform rate data across multiple processing stages and generate outbound data files and upload CSV outputs to EXL
Develop and maintain PowerShell scripts from scratch and enhance existing scripts as needed
Automate file transfers, processing FTP interactions, directory management, and email notifications
Build automation solutions to improve operational efficiency
Write and optimize SQL queries, including complex joins and transformations
Update backend tables and support data corrections
Prepare reports and datasets for analytics and operational needs
Support database troubleshooting and data validation activities
Develop Python scripts for file-based automation, including file movement, copying, editing, and integration tasks
Support end to end automation of data and file workflows