Data Engineer III

Beusa Energy, LLC•The Woodlands, TX

87d•Onsite

About The Position

As a Data Engineer at Beusa, you will own the performance, reliability, and cost-efficiency of our Databricks environment. You’ll design and optimize Delta tables, pipelines, and SQL Warehouse workloads so teams get fast, trustworthy data at the lowest reasonable cost. You will collaborate with cross-functional teams to translate requirements into high‑performing, production‑grade datasets and dashboards with clear SLAs.

Requirements

Successfully passes background check, pre-employment drug screening, an any pre-employment aptitude and/or competency assessment(s).
Valid U.S. driver’s license and ability to pass a background check.
Bachelor’s degree in MIS, Computer Science, Engineering, IT, or related field.
7-10+ years of experience in a data-focused role (Business Intelligence, Data Analysis, Data Management, etc.).
8+ years of experience in Data Engineering, Data Warehousing, or Analytics Engineering.
3+ years of hands-on experience with Databricks and the Lakehouse Platform.
Expert-level proficiency with PySpark, Spark SQL, and distributed data processing concepts.
Advanced SQL development skills with experience in relational database platforms (Microsoft SQL Server preferred).
Experience designing and implementing Databricks Medallion Architectures (Bronze, Silver, Gold).
Experience building and optimizing batch and streaming data pipelines.
Experience designing, implementing, and maintaining CI/CD deployment strategies for data platforms.
Experience defining and implementing testing frameworks, including Unit Testing, Data Quality Testing, Schema Validation, Integration Testing, and Regression Testing.
Experience troubleshooting and optimizing Spark workloads for performance, scalability, reliability, and cost efficiency.
Experience implementing data governance, security, and access control frameworks, including Unity Catalog or similar technologies.
Experience with source control and DevOps practices using Git, Azure DevOps, or similar tools.
Experience mentoring junior engineers and providing technical leadership across projects.
Proven ability to work across multiple teams and stakeholders to deliver enterprise data solutions.

Responsibilities

Build and operate Lakehouse pipelines on Databricks (Bronze/Silver/Gold) using Delta Lake, Delta Live Tables (DLT), and/or Jobs.
Own ingestion patterns (Autoloader, CDC, streaming) optimization
Own data modeling, quality checks, and performance optimization.
Own performance optimization – profile and tune Spark/SQL workloads: partitioning, clustering, constraints, liquid clustering (if applicable), manage table health.
Engineer Delta tables for speed and cost: partitioning, Z-Ordering or clustering, constraints, file sizing; manage table health with Auto Optimize, OPTIMIZE, and VACUUM.
Implement incremental processing patterns (MERGE with Change Data Feed, APPLY CHANGES INTO) with idempotency and exactly-once delivery.
Partner with data consumers to deliver reliable, well-documented datasets with clear SLAs.
Design, build, and implement interactive dashboards and reports using Power BI and other visualization tools.
Collaborate with business units (Operations, Field Engineers, Assets) to gather requirements and translate them into technical solutions.
Develop and maintain data models, ensuring data quality and integrity.
Integrate data from multiple sources, including real-time field equipment and sensors.
Continuously evaluate and adopt new data management and analytics technologies.
Educate and support stakeholders on data tools and best practices.
Advocate for Beusa’s digital transformation and data-driven decision-making.
Engage with technology vendors and partners as needed.
Occasional travel to meet with stakeholders.
Performs other related duties as assigned to assist with successful operations and business continuity.