Principal Data Processing Engineer

Nyla Technology Solutions•Annapolis Junction, MD

17h

About The Position

We have an immediate need for a Software Engineer with extensive expertise in dataflow design, data transport mechanisms, and Apache Spark distributed processing. In this high-impact role, you will be responsible for designing, implementing, and optimizing end-to-end data ingress and egress pathways. You will ensure the efficient, scalable, and highly reliable processing of enterprise-scale analytics workloads while maintaining strict data quality and system integrity.

Requirements

ACTIVE SECURITY CLEARANCE AT THE TS/SCI POLYGRAPH LEVEL IS REQUIRED
Extensive experience with distributed Big Data processing engines, specifically Apache Spark.
Recent, hands-on software development experience using both Python and Java.
Practical experience using Apache Airflow (DAG design, scheduling, operators, and sensors) for workflow management.
Hands-on experience with data manipulation tools (pandas, NumPy, Jupyter Notebook) and working with formats including Parquet, JSON, CSV, and XML.
Familiarity with relational database technologies (MySQL, MariaDB, PostgreSQL) for querying, joining, and aggregating large datasets.
Familiarity with data quality principles, automated validation methods, and anomaly detection strategies.
Strong operational experience with the Linux CLI, standard utilities, and writing Bash scripts for process automation.
Proficiency with Git source control workflows.
Bachelor’s Degree in Data Analytics, Intelligence Studies, Computer Science, Finance/Economics, or a related discipline, PLUS 7 + years of specialized data analytics or financial intelligence experience OR Master’s Degree in a related field, PLUS 5 + years of specialized analytical experience OR High School Diploma / GED, PLUS 9 + years of hands-on intelligence analysis, financial tracking, and data discovery experience in lieu of a degree.

Nice To Haves

Familiarity with High-Performance Computing (HPC) job scheduling tools such as Slurm.
Practical experience using the Atlassian Tool Suite (Jira, Confluence) for collaborative tracking and documentation.

Responsibilities

Designing, implementing, and optimizing end-to-end data ingress and egress pathways.
Ensuring the efficient, scalable, and highly reliable processing of enterprise-scale analytics workloads.
Maintaining strict data quality and system integrity.