Senior Data Engineer- MSI

The Baldwin Group

1d • Remote

About The Position

The Senior Data Engineer designs and manages data systems, pipelines, and management tools. The role oversees junior data engineers, recommends and deploys data models, and leads projects involving data collection and storage systems. It designs, builds, documents, tests, and maintains critical data pipelines that handle large volumes of data from internal and external sources across different platforms. The engineer also works with colleagues and stakeholders to define pipeline and automation requirements, performs ETL and ELT in accordance with enterprise governance and security standards, and develops data quality and governance processes.

Requirements

• 5–7 years of relevant experience.
• BA/BS degree in a relevant discipline.
• Vast experience with multiple development methodologies.
• Experience building large, complicated data pipelines across different platforms, data sources, and data structures.
• Experience with relational databases such as SQL Server and Oracle, and SQL scripting.
• Experience with Power BI.
• Experience with cloud platforms such as AWS, Azure, or GCP, including ETL tools and techniques for sourcing, maintaining, and updating data, data warehousing, data cleansing, and transformation.
• Programming experience in Python, Spark, and similar languages.
• Advanced programming knowledge and experience with large-scale processing engines.
• Deeper understanding of database security and compliance tools.
• Strong understanding of computer systems, integrations, databases, and data storage systems.
• Understanding of agile data engineering concepts and processes.
• Ability to capture and document business processes and requirements and work with colleagues to create functional requirements.
• Detail-oriented and proactive in avoiding or mitigating issues.
• Exceptional interpersonal skills and ability to communicate effectively with teams across the organization.
• Proficiency in Microsoft Office Suite (Word, Excel, PowerPoint, Outlook).
• Ability to learn other appropriate programs or software systems used by the firm as necessary.
• Ability to demonstrate behavior aligned with the firm's culture and core values.

Responsibilities

• Collaborate with the data architect, analysts, and stakeholders to identify and document data pipeline and process automation needs and requirements.
• Design, build, document, test, and maintain data pipelines using industry best practices.
• Perform ETL and ELT operations in accordance with enterprise data governance and security standards.
• Develop data quality and governance processes to ensure data accuracy and quality through inspection, validation, processing, and anomaly detection.
• Oversee junior data engineers and provide guidance, mentoring, and training to peers.
• Recommend and deploy data models and lead projects involving data collection and storage systems.
• Work with clients to translate business needs into technical solutions and document business processes and requirements.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior