Data Engineer

CompoSecure•Franklin Township, NJ

1d•Onsite

About The Position

The Data Engineer is responsible for designing, building, and maintaining robust data pipelines and solutions to support business analytics and reporting. This role focuses on leveraging Microsoft Azure, Microsoft Fabric, PySpark, SQL, APIs, and ETL processes to ensure efficient, secure, and high-quality data delivery for enterprise analytics platforms such as Power BI. The Data Engineer will work fully on site, collaborating closely with cross-functional teams to drive data efficiency and innovation.

Requirements

Minimum 5 years of relevant experience.
Strong expertise in data languages (Python, SQL, DAX, M, R, etc.) and handling large data sets using PySpark.
Strong expertise in Azure Data Factory, Azure Synapse Analytics, and Microsoft Fabric.
Hands-on experience implementing Medallion architecture in a lakehouse environment.
Expertise in transforming Parquet datasets into Delta tables for reliable, incremental processing.
Experience building ETL/ELT pipelines and working with both structured and unstructured data.
Experience with Power BI integration and data modeling.
Excellent analytical and problem-solving skills.
Excellent record keeping and auditing skills.
Excellent communication skills, both oral and written.
Strong attention to detail and ability to self-check work.
Excellent time management skills.
Task oriented excellent organizational skills, ability to prioritize workload.
Enthusiastic attitude, cooperative team player, adaptable to new or changing circumstances, professional demeanor, sensitive to client needs, self-motivated, creative and innovative.
Must be able to work beyond 40 hour week during upgrades or new functionality rollout if necessary.
Must be able to work flex schedule. Weekends and late hours or staggered shifts.
Must have valid driver's license and personal vehicle.
Must be able to lift 50 lbs.
Must be able to sustain office work for 8+ hours per day including the following: Sitting in an office chair Typing Reaching for the telephone Standing at office equipment Hearing for phone use Sight for computer use

Nice To Haves

Databricks
Familiarity with CI/CD for data pipelines a plus.

Responsibilities

Design, develop, and maintain data pipelines using Azure Data Factory, Azure Synapse, and Microsoft Fabric Dataflows.
Implement and maintain Medallion architecture in Fabric and Azure environments.
Build ingestion and transformation flows that efficiently convert raw Parquet files into Delta tables to support curated, incremental, and governed datasets optimized for Power bi.
Implement efficient data lakehouse patterns within Microsoft Fabric.
Design and maintain star schemas, dimensional models, and semantic layers for Power Bi.
Collaborate with Power Bi developers to ensure models are performant and aligned to needs.
Tune queries, optimize partitioning, and manage performance across Fabric and Synapse environments.
Ensure solutions follow Azure best practices for scalability, cost efficiency, and security.
Implement data governance, lineage, and cataloging via Microsoft Purview and Fabric capabilities.
Partner with IT security and compliance teams to enforce data access controls.
Handles all Help Desk tickets related to reporting.
Performs general software and hardware installations as required.
Handles related email and telephone correspondence in a timely and professional manner.
Responds to inquiries for the purpose of resolving problems, providing information and/or referring to appropriate personnel.
Will be required to perform other job functions, as assigned.