Data Engineer

University of Maryland Global CampusAdelphi, MD
21hHybrid

About The Position

A skilled, hands-on Data Engineer responsible for designing, building, deploying, and operating enterprise data ingestion, transformation, and delivery pipelines within a Databricks Lakehouse environment. The role focuses on data integration and interoperability, enabling secure and reliable access to curated datasets for analytics, applications, and machine learning use cases.

Requirements

  • Databricks, Apache Spark, Delta Lake
  • SQL and Python
  • Batch and streaming ingestion patterns
  • Federated data access and APIs
  • Unity Catalog and governance
  • Bachelor’s degree in Computer Science, Information Systems, or a related field.
  • 5+ years of hands-on data engineering experience supporting production data pipelines.

Nice To Haves

  • Master’s degree preferred.
  • Large-scale governed data environments.
  • Databricks certifications preferred.

Responsibilities

  • Design, build, test, and operate scalable batch and streaming data ingestion and transformation pipelines using Databricks, Apache Spark, Delta Lake, Python, and SQL.
  • Implement data integration workflows that ingest and process data from diverse internal and external sources, including databases, files, REST APIs, and streaming platforms, in alignment with established architectural standards.
  • Develop, maintain, and document curated datasets and data products that support analytics, reporting, and downstream application and machine learning use cases.
  • Package, version, and deploy data pipelines using Databricks Asset Bundles, adhering to established CI/CD processes and environment promotion practices (development, test, production).
  • Apply data quality validation, monitoring, and observability controls to ensure data accuracy, pipeline reliability, and compliance with defined service-level objectives.
  • Implement and maintain access controls, authentication, and authorization using Unity Catalog in accordance with enterprise data governance and security requirements.
  • Monitor pipeline performance and resource utilization, perform routine tuning, and support incident resolution and root-cause analysis for production data workflows.
  • Collaborate with platform, analytics, and governance teams to clarify data requirements, resolve integration issues, and support data consumers.

Benefits

  • Generous Time Off: Enjoy 22 days of paid vacation, 15 days of sick leave, 3 personal days, and 16 paid holidays (17 during general election years). For part-time employees, time off rates will be prorated based on the number of hours worked.
  • Comprehensive Health Coverage: Access to health care, medical with vision, dental, and prescription plans for both individuals and families, effective from the 1st of the month following your hire date.
  • Insurance Options: Term Life Insurance, Accidental Death and Dismemberment Insurance, and Long-Term Disability (LTD) Insurance. Part-time employees working less than 0.5 FTE are not eligible for LTD.
  • Flexible Spending Accounts: Available for medical and dependent care expenses.
  • Retirement Plans: Choose between the Optional Retirement Program (ORP) or the Maryland State Retirement and Pension System (MSRPS).
  • Supplemental Retirement Plans: include 401(k), 403(b), 457(b), and various Roth options. The university does not provide matching funds.
  • Tuition Remission: Immediate availability for Regular Exempt Staff. Spouses and dependent children are eligible for undergraduate tuition remission after two years of service. NOTE: For part-time employees (at least 50 percent of the time), tuition remission benefits are prorated.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service