Systems Analyst with Business Intelligence ETL exp for HHSC, Austin, Tx

Pedigo Staffing Services•Austin, TX

3d•Onsite

About The Position

Texas Health and Human Services Commission requires the services of 2 Systems Analyst 3, hereafter referred to as Candidate(s), who meets the general qualifications of Systems Analyst 3, Applications/Software Development and the specifications outlined in this document for the Texas Health and Human Services Commission. The Databricks Engineer should design, develop, and optimize scalable data solutions on Databricks, leveraging PySpark or Scala for large-scale data processing. Build and maintain ingestion pipelines, Declarative Pipelines (DLT), and Medallion Architecture (Bronze, Silver, Gold) to support enterprise analytics and reporting. Develop robust data models and implement data quality, validation, and governance frameworks. Create dynamic dashboards, Databricks Apps, and analytical solutions to deliver actionable business insights. Optimize workloads, monitoring, and operational processes to ensure scalability, security, and cost efficiency. All work products resulting from the project shall be considered "works made for hire" and are the property of the Texas Health and Human Services Commission and may include pre-selection requirements that potential Vendors (and their Candidates) submit to and satisfy criminal background checks as authorized by Texas law. Texas Health and Human Services Commission will pay no fees for interviews or discussions, which occur during the process of selecting a Candidate(s).

Requirements

8 years of experience in IT, supporting the design, development, deployment, or delivery of technology solutions.
8 years of experience with Databricks, including building and optimizing ETL/ELT data pipelines using Apache Spark.
8 years of experience in data warehousing and dimensional data modeling (star/snowflake schemas).
8 years of proficiency in SQL and Python (or Scala) for large-scale data processing.
8 years of experience designing and developing dashboards and applications natively within Databricks (e.g., Databricks SQL dashboards, Databricks Apps).
8 years of experience implementing data governance, data quality, and data security practices.
8 years of experience implementing Lakeflow Declarative Pipelines (formerly Delta Live Tables/DLT) for building and managing production data pipelines.
8 years of experience with Delta Lake, medallion architecture (bronze/silver/gold layers), data lakehouse design, and creating and scheduling offline jobs using Lakeflow Jobs (formerly Databricks Workflows) or similar orchestration tools (e.g., Airflow).
8 years of excellent communication skills, both verbal and written, including presenting insights to technical and business stakeholders.
8 years of knowledge of and ability to interpret Texas Vital Statistics laws, policies, procedures and regulations.
8 years of knowledge of MS Office Suite (Word, Excel, PowerPoint, Project, and Visio).
8 years of skill in project planning and organization.
8 years of skill in business analysis methodologies.
8 years of skill in analyzing and evaluating complex information technology applications, policies, and issues.
8 years of skill in developing creative and workable solutions to complex problems and issues.
8 years of skill in communicating effectively both verbally and in writing with individuals and groups.
8 years of skill in using initiative and independent judgment and managing time effectively to establish priorities, organize tasks, and assign and direct the work of others.
8 years of skill in establishing and maintaining effective working relationships, including the ability to work with people under pressure, negotiating with multiple parties and resolving conflicts.
8 years of skill in reading, interpreting and understanding material to prepare concise reports or appropriate responses for the review and/or signature of section managers and/or directors.
8 years of skill in gathering, organizing and analyzing facts, recommending solutions and resolving work-related problems.
8 years of skill in maintaining statistical and accounting records and producing data summaries.
8 years of ability to manage small to medium sized projects when needed.
8 years of ability to create project work plans.
8 years of ability to produce accurate work estimates and monitor progress.
8 or more years of experience, relies on experience and judgment to plan and accomplish goals, independently performs a variety of complicated tasks, a wide degree of creativity and latitude is expected.
Understands business objectives and problems, identifies alternative solutions, performs studies and cost/benefit analysis of alternatives.
Analyzes user requirements, procedures, and problems to automate processing or to improve existing computer system: Confers with personnel of organizational units involved to analyze current operational procedures, identify problems, and learn specific input and output requirements, such as forms of data input, how data is to be; summarized, and formats for reports.
Writes detailed description of user needs, program functions, and steps required to develop or modify computer program.
Reviews computer system capabilities, specifications, and scheduling limitations to determine if requested program or program change is possible within existing system.

Nice To Haves

1 year of experience working in public sector or state government environments.
1 year of Databricks certification (e.g., Databricks Certified Data Engineer Associate/Professional).
1 year of experience with CI/CD practices for data pipelines (DevOps, Git-based workflows).

Responsibilities

Interpret Texas Vital Statistics laws, policies, procedures and regulations.
Plan and organize projects.
Perform business analysis.
Analyze and evaluate complex information technology applications, policies, and issues.
Develop creative and workable solutions to complex problems and issues.
Communicate effectively both verbally and in writing with individuals and groups.
Use initiative and independent judgment and manage time effectively to establish priorities, organize tasks, and assign and direct the work of others.
Establish and maintain effective working relationships, including the ability to work with people under pressure, negotiating with multiple parties and resolving conflicts.
Read, interpret and understand material to prepare concise reports or appropriate responses for the review and/or signature of section managers and/or directors.
Gather, organize and analyze facts, recommend solutions and resolve work-related problems.
Maintain statistical and accounting records and produce data summaries.
Manage small to medium sized projects when needed.
Create project work plans.
Produce accurate work estimates and monitor progress.
Support the design, development, deployment, or delivery of technology solutions.
Build and optimize ETL/ELT data pipelines using Apache Spark.
Design and develop dashboards and applications natively within Databricks (e.g., Databricks SQL dashboards, Databricks Apps).
Implement data governance, data quality, and data security practices.
Implement Lakeflow Declarative Pipelines (formerly Delta Live Tables/DLT) for building and managing production data pipelines.
Work with Delta Lake, medallion architecture (bronze/silver/gold layers), data lakehouse design, and creating and scheduling offline jobs using Lakeflow Jobs (formerly Databricks Workflows) or similar orchestration tools (e.g., Airflow).
Present insights to technical and business stakeholders.
Design, develop, and optimize scalable data solutions on Databricks, leveraging PySpark or Scala for large-scale data processing.
Build and maintain ingestion pipelines, Declarative Pipelines (DLT), and Medallion Architecture (Bronze, Silver, Gold) to support enterprise analytics and reporting.
Develop robust data models and implement data quality, validation, and governance frameworks.
Create dynamic dashboards, Databricks Apps, and analytical solutions to deliver actionable business insights.
Optimize workloads, monitoring, and operational processes to ensure scalability, security, and cost efficiency.