Senior Data Engineer, AI/ML Platforms

The Baldwin Group

23h

About The Position

The Senior Data Engineer designs and manages data systems, pipelines, and management tools. The role oversees junior data engineers, recommends and deploys data models, and leads projects involving data collection and storage systems. It designs, builds, documents, tests, and maintains critical data pipelines that process large volumes of data from internal and external sources across different platforms.

The position collaborates with data architects, analysts, and stakeholders to define pipeline and process-automation requirements; performs ETL and ELT in accordance with enterprise data governance and security standards; and develops data quality and governance processes using inspection, validation, processing, and anomaly detection. It also provides guidance, mentoring, and training to peers and translates business needs into technical solutions.

This description outlines the expected level of work and essential responsibilities; other duties may be assigned as organizational needs arise. Requirements may be subject to reasonable accommodation for medical or religious reasons.

Requirements

• 5–7 years of relevant experience.
• BA/BS in a relevant discipline.
• Vast experience with multiple development methodologies.
• Experience building large, complicated data pipelines across different platforms, data sources, and data structures.
• Experience with relational databases such as SQL Server and Oracle, and SQL scripting.
• Experience with cloud platforms such as AWS, Azure, or GCP and their ETL tools and techniques for sourcing, maintaining, and updating data, data warehousing, data cleansing, and transformation.
• Programming experience in Python, Spark, and similar languages.
• Advanced programming knowledge and experience with large-scale processing engines.
• Deeper understanding of database security and compliance tools.
• Excellent understanding of computer systems, integrations, databases, and data storage systems.
• Understanding of agile data engineering concepts and processes.
• Ability to capture and document business processes and requirements and work with colleagues to create functional requirements.
• Detail-oriented and proactive in avoiding or mitigating issues.
• Exceptional interpersonal skills and ability to communicate effectively with teams across the organization.
• Proficiency in Microsoft Office Suite, including Word, Excel, PowerPoint, and Outlook.
• Ability to learn other appropriate programs or software systems used by the firm as necessary.
• Demonstrates behavior aligned with the organization’s core values and culture.

Responsibilities

• Collaborate with data architects, analysts, and stakeholders to identify and document data pipeline and process-automation needs and requirements.
• Design, build, document, test, and maintain data pipelines using industry best practices.
• Perform ETL and ELT operations in accordance with enterprise data governance and security standards.
• Develop data quality and governance processes to ensure data accuracy and quality through inspection, validation, processing, and anomaly detection.
• Oversee junior data engineers.
• Recommend and deploy data models.
• Lead projects involving data collection and storage systems.
• Provide guidance, mentoring, and training for peers.
• Work with clients to translate business needs into technical solutions.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior