Data Platform Support Engineer

Innosystech•Dallas, TX

11d•Onsite

About The Position

We are seeking a Data Platform Support Engineer to provide day-to-day operational and production support for enterprise data platforms built on Azure Databricks, Azure Data Factory (ADF), SQL, and Azure Data Lake Storage (ADLS/ADLS Gen2). This role involves monitoring data pipelines, troubleshooting failures, investigating incidents, and ensuring the timely and successful execution of data processes. You will work closely with various teams to resolve issues, perform root-cause analysis, and maintain operational documentation. The ideal candidate will have strong SQL skills, experience with PySpark/Spark and Python, and a solid understanding of production support methodologies.

Requirements

6+ years of experience in IT, Data Engineering, Data Platform Support, Application Support, or Production Support.
Strong hands-on experience with Azure Databricks.
Strong experience with Azure Data Factory (ADF), including monitoring and troubleshooting pipelines.
Strong SQL skills for querying, troubleshooting, data validation, and performance analysis.
Experience supporting ETL/ELT pipelines, batch jobs, data integrations, and enterprise data-processing environments.
Experience troubleshooting Databricks jobs/notebooks, ADF pipelines, SQL jobs, and data-processing failures.
Experience with Azure Data Lake Storage (ADLS/ADLS Gen2).
Working knowledge of PySpark/Spark and Python.
Strong experience with production support, incident resolution, root-cause analysis (RCA), monitoring, and problem management.
Ability to troubleshoot data discrepancies and identify issues across source and target systems.
Good communication and stakeholder coordination skills.
Ability to work from Dallas, TX as required.

Nice To Haves

Azure Monitor / Log Analytics
Delta Lake
Unity Catalog
Azure DevOps / CI/CD
ServiceNow
Power BI
Git
ITIL-based production support experience

Responsibilities

Provide day-to-day operational and production support for enterprise data platforms built on Azure Databricks, ADF, SQL, and ADLS.
Monitor data pipelines, Databricks jobs, scheduled processes, and integrations to ensure successful and timely execution.
Troubleshoot failed ADF pipelines, Databricks notebooks/jobs, SQL processes, ETL/ELT workflows, and data-load failures.
Investigate production incidents, data discrepancies, performance issues, and processing failures.
Perform root-cause analysis and coordinate permanent fixes for recurring issues.
Execute SQL queries to validate data, reconcile source and target systems, and diagnose production issues.
Monitor platform health, job performance, data availability, and processing SLAs.
Work closely with Data Engineers, Technical Leads, application teams, infrastructure teams, and business stakeholders to resolve incidents.
Support deployment, configuration, release, and change-management activities.
Maintain operational documentation, troubleshooting procedures, support runbooks, and knowledge-base articles.
Escalate complex platform or development issues to the appropriate engineering teams.
Participate in incident, problem, and change-management processes.
Identify opportunities to automate repetitive support activities and improve platform reliability.