Database Developer

BRILLIENT CORPORATION•Reston, VA

6d•Remote

About The Position

Brilliant Corporation is seeking an ETL Developer/Engineer to support a mission-critical IRS data warehousing initiative. In this role, you will design, build, and maintain ETL processes that extract data from source systems, transform it according to business rules, and load it into our data warehouse. You'll work closely with data architects, business analysts, and data quality specialists to ensure data is accurate, consistent, and available to business users. This role supports Compliance Data Warehouse (CDW) operations within RAAS, providing data analysis, process improvement recommendations, and research and evaluation of emerging technologies. These services optimize RAAS data availability and analytics to deliver improved services and value to RAAS stakeholders. Within RAAS, our team maintains the Compliance Data Warehouse — a non-IT data warehouse containing all the IRS's return, entity, information return, regulatory, enforcement, web, and security data. The team provides technical guidance and executes work across extract-transform-load, database administration, SQL development, Bash development, SAS administration, system security, COTS ETL development, metadata, customer service, web design, data quality, and intergovernmental data exchanges.

Requirements

Bachelor's degree in Computer Science, Information Systems, or a related field
Minimum ten (10) years of experience in ETL development, preferably with SQL, with a focus on load, select, and update commands
Must be able to obtain a Public Trust Security Clearance
High proficiency in Linux/Unix operating systems, Sybase Database, and Sybase SQL scripting
Working experience with Postgres Database, Postgres SQL scripting, SecureCRT, and SecureFX

Nice To Haves

Familiarity with additional technologies, including: DBeaver, Visual Studio Code, GitLab, Wiki, JSON, Airflow, SAP Data Services, and shell scripting tools (KSH, BASH, SSH, sed, awk, Perl)

Responsibilities

Design and Development: Move data and tables from Unix operating systems, performing extract, transformation, and load (ETL) operations into Sybase IQ. Refactor existing jobs and build new solutions as needed, including: Supporting users with documentation on moving data into Sybase IQ and providing metadata for the metadata repository. Developing an object-oriented, UNIX-based framework and engine of scripts and stored procedures to execute and monitor multiple ETL and statistics processes. Troubleshoot errors in shell and SQL; configure and operate SSH clients across servers. Participate in Scrum and client meetings, create documentation, and update Kanban board cards.
Optimization and Performance: Optimize ETL processes for efficient, timely data processing. Monitor ETL jobs and resolve performance bottlenecks.
Data Quality: Ensure data accuracy and integrity through validation, cleansing, and auditing. Partner with the Data Quality team to resolve data inconsistencies and issues.
Collaboration and Documentation: Work with Data Architects to design data models and schemas that meet business needs. Partner with Business Analysts to understand transformation requirements. Document ETL processes, workflows, and data dictionaries for transparency and future reference.
Troubleshooting and Support: Diagnose and resolve ETL process failures in a timely manner. Support business users with data-related queries and issues.
Continuous Improvement: Stay current on ETL tools and techniques. Recommend and implement improvements to ETL processes and infrastructure.