Poly) - Bid role starting in 8-10 weeks

Leading Path Consulting•McLean, VA

1d•Onsite

About The Position

The Sponsor requires a team to provide operations and maintenance as well as new development work for existing applications. The Sponsor's office is a central data processor and applications developer for applications that utilize travel data. The Sponsor aims to establish support to travel data applications and the associated backend environment while that travel data undergoes a transition period and is ingested into new environments and user applications. As these travel applications analytic capabilities continue to be absorbed, this team will need to provide ongoing support and development to travel data models and travel data ETL pipelines. The Team shall be responsible for providing General O&M support for the Sponsor’s travel applications. General O&M support includes, the following activities: The team will identify and facilitate the collection and monitoring of system performance, availability metrics, and travel data parsing metrics, as well as other pertinent usage metrics required by the Sponsor, to determine the usage and value of the application. The team will ensure that database and software maintenance activities, including those related to travel data parsing, are completed, and that application performance, especially in the context of processing travel data, does not degrade over time. The team will monitor storage allocation and usage against planned data growth, including travel data, to ensure current and future storage needs are identified and allocated by appropriate system maintenance personnel in order to prevent any operational impacts related to travel data integration. The team will continue parsing data for external Sponsor partners. The team will recommend changes or upgrades, including enhancements for travel data parsing capabilities, that need to be made to handle increased loads of data, growth of the user base, or other changes over the life of the application. The team will recommend termination or integration of functionality, including aspects related to travel data processing, with other applications to maximize the use of limited resources effectively. The team will coordinate with additional Sponsor offices (when applicable) to track expirations and support renewals of hardware and software licenses used by Sponsor applications. The team will coordinate with the Sponsor to monitor expirations of server and application-level certificates to ensure continuity of operations and take action to ensure they are renewed as necessary. The Contractor Team shall conduct thorough and rapid investigation of high priority software trouble tickets and reports to determine the cause and severity of system issues. This effort includes the review of system and application logs and the review of system fault alerts and messages. The team will attempt to replicate system issues in the Sponsor’s development, integration and test environments using operational data where appropriate. The team will coordinate high priority software bug fixes and patches with any external application providers, vendors, and other Sponsor partner organizations as necessary. The Contractor Team shall, at the Sponsor’s direction and approval, be responsible for supporting the transition of operational travel applications. This transition is part of a comprehensive and systematic approach to consolidating the Sponsor’s travel data capabilities within the existing ecosystem. The transition will adhere to deadlines and timelines at the discretion of the Sponsor. The team will develop software transition plans (i.e., deployment procedures) and data validation and migration plan and support the execution of those plans. The team will prepare and present briefings to seek approval from Sponsor mission partners and Group management. The team will set up and conduct project meetings with other Sponsor divisions as necessary to coordinate work and integrate schedules. The team will develop technical approaches, validate design plans, and conduct feasibility studies. The team will perform lessons learned sessions for Sponsor management and project teams at appropriate intervals. The team will perform assessment and accreditation activities in support of existing systems in accordance with the Sponsor’s Assessment and Authorization (A&A) process.

Requirements

Demonstrated experience building and managing data pipelines.
Demonstrated experience with python.
Demonstrated experience with cloud computing using AWS services.
Demonstrated experience processing data using Apache Spark.
Demonstrated experience with an RDBMS (Relational Database Management System) (Postgres, Oracle, MySQL) and writing SQL queries.
Demonstrated experience with Linux and shell scripting.
Demonstrated experience analyzing data in different file formats like csv, xml, json, avro, parquet, etc.
Demonstrated experience writing and validating unit tests.

Nice To Haves

Demonstrated experience in NiFi, Apache AirFlow, or an equivalent solution or tool for orchestrating data pipelines.
Demonstrated experience with java or scala.
Demonstrated experience administering an EMR/Spark cluster.
Demonstrated experience conducting performance tuning of a spark job.
Demonstrated experience supporting Hive, Iceberg, or another technology providing SQL access to data.
Demonstrated experience developing cloud-based security solutions.
Demonstrated experience following a configuration management process to review and deploy code as part of releases.

Responsibilities

Provide operations and maintenance as well as new development work for existing applications that utilize travel data.
Provide ongoing support and development to travel data models and travel data ETL pipelines.
Identify and facilitate the collection and monitoring of system performance, availability metrics, and travel data parsing metrics, as well as other pertinent usage metrics.
Ensure database and software maintenance activities are completed and application performance does not degrade.
Monitor storage allocation and usage against planned data growth to ensure current and future storage needs are identified and allocated.
Continue parsing data for external Sponsor partners.
Recommend changes or upgrades to handle increased loads of data, growth of the user base, or other changes.
Recommend termination or integration of functionality with other applications.
Coordinate with additional Sponsor offices to track expirations and support renewals of hardware and software licenses.
Coordinate with the Sponsor to monitor expirations of server and application-level certificates and ensure they are renewed.
Conduct thorough and rapid investigation of high priority software trouble tickets and reports.
Review system and application logs and system fault alerts and messages.
Attempt to replicate system issues in the Sponsor’s development, integration and test environments.
Coordinate high priority software bug fixes and patches with external application providers, vendors, and other Sponsor partner organizations.
Support the transition of operational travel applications.
Develop software transition plans (i.e., deployment procedures) and data validation and migration plans.
Support the execution of transition and migration plans.
Prepare and present briefings to seek approval from Sponsor mission partners and Group management.
Set up and conduct project meetings with other Sponsor divisions.
Develop technical approaches, validate design plans, and conduct feasibility studies.
Perform lessons learned sessions for Sponsor management and project teams.
Perform assessment and accreditation activities in support of existing systems in accordance with the Sponsor’s Assessment and Authorization (A&A) process.