Databricks Data Developer and Architect (Ref #: 1118803)

Estrada Consultingorporated • Clearfield, UT

1d • Onsite

About The Position

Estrada Consulting, Inc. is seeking a data developer and architect to build a materials research database from the ground up at a university advanced materials research center in northern Utah. The center builds and tests high-temperature carbon fiber composite parts for aerospace. Its 3D printers, ovens, furnaces, microscopes, and mechanical and thermal test machines store their own data. The role will extract machine logs, sensor readings, and microscope images, land the data in Azure Blob Storage in an Azure Government account, and build staging and production layers on Databricks for research analytics and data science.

The six-month engagement includes developing ingestion pipelines, a typed and validated Databricks staging environment, a production data model, and orchestration with alerts for failed, missing, or corrupt data. The developer will support automated reporting and analytics, document the pipelines and data model, and work alongside center staff and student interns to train them and hand over a maintainable system. Work is onsite, full time (40 hours per week) in Clearfield, Utah. The engagement may be renewable, contingent on contract award. The expected start is January 2027. Compensation is $60 to $85 per hour on a W2 contract, depending on experience. U.S. citizenship is required. The candidate's name and resume will be included in ECI's proposal, with references who can verify data engineering experience.

Requirements

• Three years or more of data engineering experience.
• Experience building data ingestion pipelines, data models, and pipeline monitoring and alerting.
• Strong SQL and Python.
• Cloud experience (Azure, AWS, or GCP), including IaaS and PaaS services.
• Data security, permission management, and secure networking experience.
• U.S. citizenship and ability to work onsite in Clearfield, Utah, full time.
• References who can verify data engineering experience.

Nice To Haves

• Databricks, Apache Spark, and Delta Lake experience.
• Microsoft Azure experience, including Azure Government, Blob Storage, and Azure Data Factory or Databricks Workflows.
• Data lake or lakehouse architecture experience, including storing images in blob storage with references in tables.
• Experience reading data from Windows servers, log files, PLC or controller registers, and lab instruments.
• Experience working with and training student interns.
• Databricks or Azure data engineering certification.

Responsibilities

• Build extraction from machines—including log files, controller registers, instrument outputs, and microscope images—into Azure Blob Storage.
• Create the Databricks staging environment with data types checked and enforced.
• Design and build the production data model for research use, including tables that reference images in blob storage.
• Build orchestration with alerts when loads fail or data is missing or corrupt.
• Support automated reporting and analytics on production data with the center's staff.
• Document the pipelines and data model, and pair with student interns so the center can maintain them.

What This Job Offers

• Job Type: Full-time
• Education Level: No Education Listed