Data Engineer

Bloomberg Industry Group•Arlington, VA

About The Position

Bloomberg Industry Group runs on data. As the Commercial Data Engineering team, we are responsible for creating the building blocks that allows us to drive analytics throughout the organization to improve our products, engage better with our customers, create greater efficiencies, and drive new businesses by providing data insights. Our data captures the who, what, when, where and why of how our company goes to market. Senior business leaders rely on our work every day to make strategic decisions.

Requirements

3 years of experience in data engineering, data integration, or related technical roles.
Hands-on experience with Databricks preferred.
Proficiency in SQL and experience querying large datasets.
Experience with Python for data processing and automation.
Understanding of ETL/ELT concepts and data pipeline development.
Familiarity with cloud platforms such as Microsoft Azure, AWS, or Google Cloud.
Basic knowledge of data warehousing concepts and dimensional modeling.

Responsibilities

Design, develop, and maintain data pipelines using Databricks
Build and optimize ETL/ELT processes to ingest, transform, and load data from various source systems.
Collaborate with business analysts, data scientists, and stakeholders to understand data requirements and deliver reliable datasets.
Monitor data pipeline performance and troubleshoot data quality or processing issues.
Develop and maintain data models, documentation, and metadata.
Support the implementation of data governance, security, and data quality standards.
Assist in managing cloud-based data infrastructure and storage solutions.
Participate in code reviews and follow best practices for data engineering and software development.
Support reporting and analytics teams by creating and maintaining curated data assets.
Continuously learn and apply new technologies, tools, and methodologies within the data engineering ecosystem.