Data Engineer

Metas Solutions•Myrtle Point, OR
•Remote

About The Position

Metas Solutions is hiring a Data Engineer to develop, maintain, and support data pipelines and observability solutions for reliable monitoring, operational insights, and public health analytics. The role is remote and centers on Databricks (including Delta Lake, Unity Catalog, and job orchestration), Palantir Foundry, and distributed processing with PySpark and SQL. The Data Engineer builds end-to-end pipelines within established architectural patterns and contributes to schema design, quality assurance, testing, deployment, and production support. The role includes troubleshooting pipeline issues and improving transformation efficiency, partitioning strategies, and query performance. It also involves modernizing Python and SQL analytical codebases, contributing to shared libraries and reusable templates, and supporting platform onboarding and migrations, including Palantir Foundry. The position works with cloud-native orchestration, CI/CD for data services, observability, data quality, and data security and governance. The engineer collaborates with analysts, program teams, and CDC partners to clarify requirements, document solutions, communicate progress and issues, and explain technical findings clearly. Candidates must be U.S. citizens or lawful permanent residents and able to obtain the required Public Trust or suitability determination based on client requirements.

Requirements

  • At least 3 years of hands-on data engineering experience, including developing transformations with PySpark and SQL and working with distributed data processing.
  • At least 3 years of experience developing, maintaining, troubleshooting, and supporting production data pipelines.
  • At least 1 year of experience with Databricks, including Delta Lake and job orchestration, and familiarity with Unity Catalog.
  • At least 1 year of experience with Microsoft Azure, including services such as Azure Data Factory, Azure Functions, and Azure Storage, or equivalent services on AWS or Google Cloud Platform.
  • Experience designing, developing, maintaining, and supporting observability data platforms and solutions for monitoring, troubleshooting, and performance optimization.
  • Experience implementing schema designs, medallion architecture patterns, partitioning strategies, and performance improvements within established data architectures.
  • Experience collaborating with business stakeholders to gather requirements and explain technical solutions and findings to technical and non-technical audiences.
  • Experience with Palantir Foundry, including datasets, transforms, pipeline development, and data modeling.
  • Ability to independently complete assigned engineering tasks, collaborate in cross-functional teams, and escalate technical issues appropriately.
  • Ability to obtain and maintain a Public Trust or Suitability/Fitness determination based on client requirements; the security section specifies ability to obtain a U.S. Government Public Trust 5 clearance within a reasonable period.
  • Bachelor's degree.
  • Must be a U.S. citizen or lawful permanent resident (Green Card holder).

Nice To Haves

  • Experience contributing to CI/CD pipelines for data engineering and application services using Azure DevOps or equivalent tooling.
  • Experience implementing data-quality checks, observability, monitoring, data security, or governance controls.
  • Experience supporting data-platform onboarding, cloud migration, or modernization of existing Python and SQL analytics code.
  • Knowledge of Agile development methodologies, DevOps, and DataOps practices.
  • Knowledge of Generative AI concepts and tools, including retrieval-augmented generation (RAG), large language models (LLMs), and embedding models.

Responsibilities

  • Develop, maintain, and support scalable data pipelines and platform components using Databricks and Palantir Foundry, following established architecture and engineering standards.
  • Contribute to the design, development, and continuous improvement of observability metadata models, standards, and frameworks for monitoring, data quality, operational visibility, and platform reliability.
  • Implement schemas and transformations using PySpark and SQL; troubleshoot processing issues and improve partitioning and query performance.
  • Configure and maintain cloud-native orchestration workflows, contribute to CI/CD pipelines for data services, and develop automated tests and validation checks.
  • Support platform onboarding and migration activities, including Palantir Foundry; contribute to reusable libraries, templates, and technical documentation.
  • Implement data-quality checks, pipeline monitoring, and established security and governance controls.
  • Collaborate with stakeholders to clarify requirements and communicate progress, issues, and technical findings.
  • Modernize existing Python and SQL analytical codebases and support data-platform onboarding, migrations, and production operations.

Benefits

  • Medical insurance
  • Dental insurance
  • Vision insurance
  • Life insurance
  • Paid Time Off (PTO)
  • 401(k) with company match
  • Growth and promotion opportunities
  • Market-competitive salary commensurate with experience and education
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service