Data Engineer – Modern Cloud & Semantic Data Platform

Mega Cloud Lab•Houston, TX

7d•Onsite

About The Position

Seeking a senior-level Data Engineer to design, build, and scale a modern cloud data platform centered on Snowflake and AWS. The role combines core data engineering with enterprise data platforms, ontology-driven modeling, and governed data products. The engineer will lead strategic data initiatives using Snowflake, AWS, Iceberg managed tables, Snowflake Catalog, Snowflake Horizon, Informatica, and dbt. The position translates business concepts into trusted, reusable data assets for advanced analytics, business intelligence, application development, and AI-enabled use cases across the energy sector. The role supports data architecture and products for news intelligence, asset intelligence, analytics, and AI/LLM integration, including Claude. Solutions must meet enterprise requirements for access control, security, privacy, and performance.

Requirements

9 to 13+ years of experience in data engineering, data modeling, ETL/ELT pipeline design, and cloud platform development.
Experience in the Oil & Natural Gas Midstream industry or broader Energy sector.
Deep hands-on proficiency with Snowflake, including data modeling, performance optimization, access controls, and warehouse/lakehouse patterns.
Hands-on experience building and supporting applications in AWS cloud environments.
Practical familiarity with Claude or LLM workflows integrated into data platforms.
Experience with Informatica or similar enterprise ETL tools for ingestion and extract-load patterns.
Hands-on dbt experience for transformations, testing, and CI/CD workflows.
Knowledge of Apache Iceberg, including managed tables, schema evolution, and catalog-based access.
Familiarity with data cataloging, lineage tracking, policy-driven data access, metadata management, and knowledge graph/ontology concepts such as semantic modeling, taxonomies, and business glossaries.
Advanced proficiency in SQL and Python or another core data engineering language.
Excellent communication, stakeholder management, documentation, and problem-solving skills.

Nice To Haves

Experience with Snowflake Catalog and Snowflake Horizon.
Experience building governed data products for advanced analytics and AI/ML applications.
Experience with enterprise governance tools, particularly Informatica Governance capabilities.
Knowledge of RDF, OWL, SHACL, SPARQL, graph databases, or knowledge graph platforms.
Hands-on design of semantic layers, domain ontologies, and enterprise metadata models.
Knowledge of modern DataOps practices, including CI/CD, Git, automated testing, and continuous integration for data pipelines.
Experience with data observability, data contracts, and automated quality frameworks.

Responsibilities

Design, build, and maintain scalable pipelines for structured, semi-structured, and unstructured data.
Develop ELT/ETL ingestion processes using Informatica, aligned with enterprise standards and existing infrastructure.
Build transformation logic using dbt, including modular models, automated testing, documentation, and deployment workflows.
Design and manage core data structures in Snowflake as the strategic enterprise data platform.
Integrate AWS-based data services and infrastructure to support applications and governed data products.
Support data architecture using Apache Iceberg managed tables, with attention to open table formats, interoperability, cataloging, and governed access patterns.
Use Snowflake Catalog and Snowflake Horizon for metadata management, data discovery, lineage tracking, policy enforcement, and secure data sharing.
Support ontology-driven data modeling, entity definitions, taxonomies, business glossaries, and semantic mappings in collaboration with domain experts.
Translate domain and business concepts into logical and physical data models and reusable data products.
Implement validation rules, data quality checks, observability tools, and lineage controls.
Support applications in news intelligence, asset intelligence, analytics, and AI/LLM integration, including Claude.
Ensure solutions satisfy enterprise requirements for access control, security, privacy, and performance.