Lead Data Engineer - R01549424
This job is no longer available
There are still lots of open positions. Let's find the one that's right for you.
About The Position
Brillio is seeking a Lead Data Engineer to join our team in St. Louis, MO. This position is hybrid and involves developing ingestion processes to source data from various types of sources such as flat files, databases, and JSON to be consumed in Databricks. The ideal candidate will develop ETL PySpark code in Databricks to build reporting layer tables for PowerBI while adhering to best practices. Additionally, the role requires utilizing GitHub for code inventory management and collaborating with the team for testing and deployment. The Lead Data Engineer will also use Jenkins for CI/CD processes, ensuring code standards are met in terms of parameterization, job scheduling, and email notifications through Terraform scripts. The position involves developing reports on PowerBI based on business and process improvement needs, participating in Agile team scrum calls, and working closely with tech leads for code reviews and design meetings.
