Senior Data Developer
About The Position
We are looking to add a Senior Data Developer to our ongoing development, maintenance, and data engineering team. We support the Commodity Futures Trading Commission (CFTC) Data Engineering and Processing (DEAP) project by providing analyses, solutions and maintenance of many processes that ingest financial market data used across multiple CFTC regulatory and analytical systems, including high‑volume, mission‑critical data ingest pipelines. These processes and the data ingested are critical to the mission of the CFTC. This position requires up to three (3) specific days onsite in the Washington DC facility and two (2) remote teleworking days per week.
Requirements
- 8 years of experience and a Bachelor’s degree or 12 years with a HS Diploma
- Experience working with regulatory data (CFTC or similar), market structure concepts, and reporting workflows is strongly preferred.
- Experience working and automation/development in an AWS environment
- Experience with some or most of: Python, C#, PowerShell, Bash, S3, Redshift, RDS, DMS, SageMaker, QuickSight
- Experience in Microsoft SQL Server database; SQL Server Management Studio (SSMS); SQL Server Reporting Services (SSRS)
- Experience with Extract, Transform & Load (ETL) workflows
- Experience in Microsoft Office Tools and Azure DevOps for Backlog and Sprint management.
- Must be a US Citizen
- Must be able to obtain and maintain the required agency clearance
Nice To Haves
- Active Public Trust or other active clearance
- Master’s degree in business, finance, computer science, statistics or related field and 5 years of experience
- Bachelor’s Degree is a plus
- Experience with microservices, distributed data processing, or event‑driven architectures.
- Prior experience supporting high‑volume data pipelines in a regulated environment.
- Experience with troubleshooting ingest failures, rule‑based validation systems, and XML/FIXML transformation workflows.
Responsibilities
- Serve in a technical lead role providing leadership for a small team of data engineers responsible for development, maintenance, and modernization of multiple DEAP ingest loaders and microservices.
- Work with the customer and Peraton project manager on requirements gathering and task estimation. Collaborate closely with CFTC stakeholders and Peraton project manager to refine ingest rules, validate reporting requirements, and estimate development or remediation tasks.
- This role will require performing routine data operational checks, development and automation of the quality checks.
- Perform daily operational monitoring of high‑volume ingest pipelines and build automated data‑quality and anomaly‑detection workflows.
- Communicate with other departments and internal teams to coordinate requirements, triage ingest failures, and ensure rapid resolution of data, system, and reporting anomalies.
- Ensure reporting entities submit complete and compliant data; identify root causes of rejections and coordinate corrective action with CFTC and external reporting counterparts.
- Support operations and maintenance of ingest systems, including SQL/database performance issues, service restarts, pipeline failures, and AWS resource troubleshooting.
- Conduct analysis of futures, options, swaps, and related regulatory data to validate quality, detect inconsistencies, and ensure accurate transformation into downstream systems.
- Lead code reviews, promote engineering best practices, and contribute to modernization initiatives including migration of legacy loaders to microservices-based architectures.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Number of Employees
5,001-10,000 employees
