Senior Data Engineer (Information Systems Analyst III Opt. S)

State of Illinois•Chicago, IL
•$9,130 - $13,573•Hybrid

About The Position

The Senior Data Engineer serves the Department of Innovation and Technology under administrative direction, performing highly complex professional and advisory work. The position leads the design, development, and optimization of enterprise data pipelines and distributed processing systems that support analytics, operations, and regulatory reporting. It architects and governs data lakehouse and warehouse environments, with a focus on high-performance data models, reliable ingestion, scalable transformation, data quality, observability, and secure, compliant access. The role also leads technical practices across cross-functional teams through architectural guidance, code review, mentorship, and advice to vendor partners and executive stakeholders. The position is a full-time, salaried union position. The anticipated starting salary is $9,130 per month, with a full range of $9,130–$13,573 per month. Normal work hours are 8:30 a.m.–5:00 p.m., Monday through Friday, though hours may vary. The position has an anticipated hybrid schedule, with one to five days per week in the office depending on operational needs, at the Chicago headquarters. Occasional travel, including overnight stays, and work outside normal business hours to meet deadlines may be required.

Requirements

  • Education equivalent to four years of college, with coursework in Computer Science, Computer Engineering, Information Systems, Data Engineering, Software Engineering, Management Information Science, or a closely related field.
  • Five years of professional experience in a related IT field, such as data engineering, software engineering, database administration, business intelligence development, data architecture, systems integration, or a closely related technical discipline.
  • Five years of professional experience designing, building, and optimizing enterprise-scale data pipelines, fault-tolerant ETL/ELT patterns, and distributed processing systems in a high-volume near-time production environment, including SQL performance tuning, execution plan analysis, index strategy, and workload optimization.
  • Five years of professional experience with distributed data processing and Spark execution engine optimization, including large-scale batch, micro-batch, and streaming workloads; execution plans; shuffle and partition strategy; memory management; and cluster autoscaling.
  • Five years of professional experience designing enterprise data platforms and lakehouse architectures, including multi-zone lake and lakehouse patterns, open table format optimization, schema evolution, and integration of storage, compute, and catalog layers.
  • Four years of professional experience engineering reusable data access layers and gateway patterns that abstract source-system complexity, reduce redundant data movement, and provide consistent, governed interfaces for downstream consumers and applications.
  • Ability to verify identity, provide authorization to accept permanent full-time State employment, and pass a position-specific background check with criminal-history self-disclosure.
  • Ability to travel for work, including occasional overnight stays, and work outside normal business hours to meet deadlines.
  • Ability to use agency-supplied equipment, including a laptop, personal computer, and work cell phone.
  • Ability to lift and carry up to 10 pounds; the position is described as sedentary work with occasional lifting, carrying, walking, and standing.
  • Must comply with applicable revolving-door restrictions and file Statements of Economic Interest as required.

Nice To Haves

  • Five years of professional experience designing, building, and optimizing enterprise-scale data pipelines, fault-tolerant ETL/ELT patterns, and distributed processing systems in a high-volume near-time production environment, including SQL tuning and optimization across relational and cloud data systems.
  • Five years of professional experience with distributed processing and Spark optimization for large-scale batch, micro-batch, and streaming workloads.
  • Five years of professional experience with enterprise data platform and lakehouse architecture, including multi-zone patterns, open table format optimization, schema evolution, and integration of storage, compute, and catalog layers.
  • Four years of professional experience engineering reusable data access layers and gateway patterns that support enterprise interoperability and governed access for downstream consumers and applications.
  • Four or more years of professional experience implementing role-based access control frameworks across enterprise data platforms in alignment with formal data governance or security classification policy.
  • Four or more years of professional experience implementing enterprise data observability and quality monitoring, including automated checks, schema drift detection, privacy monitoring incident leadership, lineage tracking, anomaly detection, and pipeline alerting.
  • Four or more years of professional experience with DataOps, CI/CD, and infrastructure-as-code for data workloads, including automated deployment of notebooks, Spark jobs, SQL deployments, and dbt models and provisioning cloud data infrastructure.
  • Ability to provide expert peer code review and mentor junior and mid-level engineers.
  • Ability to analyze data and recommend and implement technical solutions that strengthen enterprise standards, reusability, and interoperability.
  • Strong verbal and written communication skills, including the ability to explain technical concepts to technical and non-technical audiences through documentation, presentations, and cross-functional collaboration.

Responsibilities

  • Lead the design, development, and optimization of enterprise data pipelines, scalable data platforms, data quality and governance, and data engineering practices.
  • Design, build, and optimize enterprise ETL and ELT pipelines, distributed processing workloads, and semantic data models supporting analytics, business intelligence, and operational reporting.
  • Lead technical governance of enterprise data lake architecture, including high availability, data quality, cost-efficient storage tiering, and end-to-end observability.
  • Design, implement, and govern CI/CD automation frameworks for data engineering workloads, ensuring reliable and secure code promotion, environment parity, and production deployment.
  • Implement, govern, and improve role-based access control for data platforms, ensuring access policies are enforced, auditable, and aligned with security standards and applicable regulations.
  • Engineer and optimize workloads across relational, non-relational, and emerging data platforms, including relational databases, document databases, key-value stores, and graph databases.
  • Participate as a senior technical contributor and player-coach within cross-functional data delivery squads, representing enterprise data engineering standards and advising vendor partners and executive stakeholders.
  • Keep current with information technology developments through online training, meetings, training sessions, seminars, and conferences.
  • Perform other duties within the scope of the position as required or assigned.

Benefits

  • Competitive group insurance benefits, including health, life, dental, and vision plans.
  • Flexible work schedules when available and dependent on the position.
  • 10–25 days of paid vacation annually, with 10 days for the first year of State employment.
  • 12 days of paid sick time annually, carried over year to year.
  • Three paid personal business days per year.
  • 13–14 paid holidays per year, depending on election years.
  • 12 weeks of paid parental leave.
  • Pension plan through the State Employees Retirement System.
  • Voluntary Deferred Compensation supplemental retirement plan.
  • Optional pre-tax Medical Care Assistance Plan and Dependent Care Assistance Plan.
  • Tuition Reimbursement Program.
  • Eligibility for the Federal Public Service Loan Forgiveness Program.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service