Data Warehouse/BI Engineer

SCOR•Charlotte, NC

4d•$107,000 - $130,500•Hybrid

About The Position

Under the operational responsibility of the Solution Owner, you are responsible to work with Databricks and SQL Server databases, both relational and multidimensional, in compliance with the SCOR policies and procedures that produce high-quality software products and services. Right from prototyping and designing functional code to coding and testing, you collaborate with the US Life business and technical stakeholders and take ownership of the software until it is handed over to the end users. You are fully integrated within the Data Chapter, you contribute to develop the community, define and share guidelines, best practices, experience with others and perform technological watch on your domain. You will join the Tech, Data and AI department (more than 200 employees across the globe) and will be able to grow and evolve in a global and very dynamic structure providing products, services, and support to all SCOR Group worldwide.

Requirements

BS in Computer Science or related degree or equivalent work experience required
3+ years of working with Databricks, the medallion architecture, Databricks SQL, PySpark, Delta tables, pipelines and parquet files, focused on building and operating ETL/ELT workloads.
3+ years of experience building, enhancing, and supporting large-scale Enterprise ETL processes (data integration, migration, and data quality verification), including Python scripting for automation/reconciliation, with a proven track record of successful deliveries.
Strong Python skills for ETL development (scripting, data processing, and automation), including writing reusable modules, implementing logging/error handling, and integrating with scheduling/orchestration.
Experience working with data platforms enabling AI solutions.

Nice To Haves

Experience/ Knowledge of the Reinsurance business and/or the financial services industry is a plus

Responsibilities

Design, build, and optimize end-to-end ETL/ELT pipelines (batch and incremental loads) in Databricks to ingest, transform, and load enterprise data into the lakehouse/data warehouse.
Develop, test, and maintain ETL code (PySpark and Python scripts, Databricks notebooks/jobs, and SQL) and implement logging, error handling, and monitoring for reliable daily operations.
Identify and evaluate opportunities to integrate artificial intelligence(AI) and predictive analytics into existing data and BI workflows.
Partner with business and data stakeholders to identify source systems, define data mappings/business rules, and document transformations and lineage for ETL processes.
Write, maintain, test, and document ETL components (Databricks notebooks/jobs, Python scripts, SQL procedures, and SSIS packages) including unit tests, reconciliation checks, and data quality rules.
Collaborate with product owners, solution owners, QA, and other engineers to deliver ETL enhancements end-to-end (requirements, build, test, deploy), and support releases into production.
Apply agile delivery practices to ETL work, including backlog refinement, sprint planning, and disciplined testing (data validation, reconciliation, and performance testing).
Participate in code reviews and CI/CD for ETL assets (Python/PySpark, SQL, and Databricks jobs) to ensure maintainability, security, and operational stability.
Create and maintain Python scripts to automate data ingestion, file handling, and operational tasks (e.g., parameterization, re-runs, alerts), and to generate data quality/reconciliation reports.
Provide ongoing maintenance, support and enhancements in existing systems and global reporting platforms: troubleshoot and fix software defects, performance issues, and software compatibility problems.
Provide production support to systems that host PII data, responding quickly to any production issues that arise.
Maintain documentation and version control of software code and related artifacts.
Implement software security best practices and adhere to industry standards and regulations.
Stay up-to-date with emerging trends, technologies, and software engineering best practices.
Provide recommendations for continuous improvement.
Work alongside other engineers on the team to elevate technology and consistently apply best practices.
Leverage automation and AI tools to improve data quality, data processing and reporting efficiency.

Benefits

Medical, vision, and dental coverage
401(k) Plan with a competitive match
Company-funded Defined Contribution Retirement Program
Life and AD&D insurance
Long- and Short-Term Disability
Flexible Parental Leave
Unlimited Sick Days
Volunteer Time
Summer Fridays
Learning & Development Resources
Personal Wellness Tools and Rewards
Competitively priced gym memberships from a large nationwide network of gym brands and local fitness studios
Relocation assistance within the U.S. is available for this position.