Information Technology_USA - USA_Engineer

Real Soft • Jacksonville, FL

5d • Onsite

About The Position

This role focuses on Pipeline Development, Data Modeling, Performance Optimization, Data Quality & Integrity, and Operations within the Information Technology sector. The primary responsibilities include designing and implementing ETL/ELT pipelines, developing data models, optimizing Snowflake queries and Spark jobs, ensuring data quality, and troubleshooting production issues.

Requirements

• 6-8 Years of experience in Data Engineering.
• Proficiency in PySpark.
• Proficiency in SQL.
• Experience with Snowflake.
• Experience with data modeling (Star/Snowflake schemas).
• Experience with ETL/ELT pipeline development.
• Experience with Git for version control.

Responsibilities

• Design and implement robust ETL/ELT pipelines using PySpark and SQL to ingest data from diverse sources including APIs, flat files, and relational databases.
• Develop and manage complex data models (e.g., Star/Snowflake schemas) and maintain Fact and Dimension tables within Snowflake.
• Monitor and tune Snowflake queries and Spark jobs to optimize performance, reduce latency, and manage computational costs.
• Implement automated data validation frameworks and testing procedures to ensure a "single source of truth" and high data reliability.
• Troubleshoot production pipeline issues and manage version control via Git.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed