Systems Engineer

J5 Consulting•Tysons Corner, VA

1d•Onsite

About The Position

The Sponsor requires a team to provide operations and maintenance as well as new development work for existing applications. The Sponsor's office is a central data processor and applications developer for applications that utilize travel data. The Sponsor aims to establish support to travel data applications and the associated backend environment while that travel data undergoes a transition period and is ingested into new environments and user applications. As these travel applications analytic capabilities continue to be absorbed, this team will need to provide ongoing support and development to travel data models and travel data ETL pipelines.

Requirements

Demonstrated experience building and managing data pipelines.
Demonstrated experience with Python.
Demonstrated experience with cloud computing using AWS services.
Demonstrated experience processing data using Apache Spark.
Demonstrated experience with an RDBMS (Relational Database Management System) such as Postgres, Oracle, or MySQL and writing SQL queries.
Demonstrated experience with Linux and shell scripting.
Demonstrated experience analyzing data in different file formats such as CSV, XML, JSON, Avro, and Parquet.
Demonstrated experience writing and validating unit tests.
US Citizenship
active U.S. Government Top Secret Security Clearance with a Full Scope Polygraph

Nice To Haves

Demonstrated experience in NiFi, Apache AirFlow, or equivalent orchestration tools for data pipelines.
Demonstrated experience with Java or Scala.
Demonstrated experience administering an EMR/Spark cluster.
Demonstrated experience conducting performance tuning of Spark jobs.
Demonstrated experience supporting Hive, Iceberg, or similar SQL access technologies.
Demonstrated experience developing cloud-based security solutions.
Demonstrated experience following configuration management processes to review and deploy code as part of releases.