Data Engineer II

Lewis Energy Group • San Antonio, TX

3d

About The Position

The Data Engineer II designs, builds, and maintains Lewis Energy Group’s data platform on Microsoft Fabric. The role develops data pipelines using Data Factory, Dataflows Gen2, and PySpark notebooks; writes and optimizes T-SQL; and assists with migrating on-premises SQL Server databases and ETL/ELT processes to Fabric. It also builds semantic models for Power BI reporting, supports data quality and governance, and manages changes using source control and deployment pipelines. The position works with business users and stakeholders, communicating technical information clearly and accessibly.

Lewis Energy Group is a vertically integrated exploration and production company and a leading natural gas producer in South Texas and across the nation, with operations in South Texas and Mexico. The company describes its culture as family-oriented and highlights its long-standing commitment to excellence, innovation, and community engagement.

Requirements

• Bachelor’s degree from a four-year college or university; at least two years of related experience and/or training; or an equivalent combination of education and experience.
• Ability to design relational and dimensional data models, including fact and dimension tables, keys, relationships, referential integrity, and historical changes.
• Strong T-SQL skills for complex joins, transformations, query tuning, and troubleshooting.
• Hands-on experience building and supporting integrations across databases, APIs, or file-based sources, including scheduling, incremental processing, and recovery.
• Ability to validate data completeness and accuracy, reconcile source and target results, and investigate duplicates and broken relationships.
• Experience using Python or a comparable scripting language for data processing or automation, and version control for maintainable development.
• Ability to translate business requirements into documented models, explain technical decisions clearly, and willingness to learn unfamiliar platforms.

Nice To Haves

• Experience with Power BI semantic models, Power Query, DAX, or comparable business intelligence tools.
• Experience with Microsoft SQL Server, SSIS, SSAS, or comparable database and integration technologies.
• Experience with Microsoft Fabric, Azure Data Factory, Azure Data Lake Storage, Azure SQL, Synapse Analytics, Databricks, or Azure DevOps.
• Experience with oil and gas production data, SCADA, telemetry, time-series data, IoT, or streaming data.

Responsibilities

• Design, build, and maintain Microsoft Fabric data pipelines using Data Factory pipelines, Dataflows Gen2, and notebooks to move data from source systems into Lakehouses and Warehouses.
• Develop data transformation and processing logic in Python and PySpark within Fabric notebooks, including working with Delta tables and large or complex datasets.
• Develop and optimize T-SQL code, including stored procedures, views, and transformation logic, to support data processing and reporting.
• Apply data-modeling practices such as medallion architecture and star schema design to organize data in OneLake for performance and ease of use.
• Monitor pipeline runs, troubleshoot failures, and implement alerting and error handling to support timely and accurate data delivery.
• Assess existing on-premises SQL Server databases, SSIS packages, and scheduled jobs to plan migration to Microsoft Fabric.
• Rebuild or refactor legacy ETL processes as Fabric-native pipelines and PySpark notebooks, improving performance and maintainability.
• Coordinate migration timelines with the team and stakeholders to minimize disruption to reporting and operations.
• Build and maintain semantic models for Power BI reports, including relationships, measures, ontology, and Direct Lake or Import configurations.
• Work with report developers and business users to understand reporting requirements and create well-structured datasets.
• Tune data models and queries to improve report performance and refresh reliability.
• Communicate technical concepts, data limitations, and project status to non-technical stakeholders.
• Implement data-quality checks and validation rules to identify issues before they reach end users.
• Manage Fabric workspace organization, access permissions, and security settings in line with company data-governance standards.
• Use source control, including Azure DevOps or Git, and deployment pipelines to manage changes across development, test, and production environments.
• Create and maintain documentation of data sources, pipelines, models, dictionaries, and business logic.

Benefits

• Medical, dental, vision, basic life and AD&D insurance, and other benefit options.
• 401(k) with immediate matching contribution.
• Annual discretionary bonus.
• Generous paid time off and paid holidays.
• Employee Assistance Program offering free, confidential support for employees and dependents.
• Wellness and company events throughout the year.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level