Software Engineer L3 - Dataflow

Technology Resource Experts • Fort Meade, MD

1d • $200,000 - $275,000

About The Position

Technology Resource Experts, LLC is looking for an experienced Software Engineer to join their rapidly growing team! Description The Software Engineer shall possess extensive expertise in dataflow design, data transport mechanisms, and Apache Spark based distributed processing. In this role, the Software Engineer will be responsible for designing, implementing, and optimizing data ingress and egress pathways to ensure efficient, scalable, and reliable processing of the organization’s analytics workloads.

Requirements

• Experience using the Linux CLI and Linux tools
• Experience developing Bash scripts to automate manual processes
• Recent software development experience using Python and Java
• Experience with Distributed Big Data processing engines including Apache Spark
• Experience using Jupyter Notebook
• Experience with data wrangling and preprocessing using tools such as pandas, NumPy
• Experience working with structured, semi-structured, and unstructured data such as Parquet, JSON, CSV, XML
• Familiarity with data quality concepts, data validation, and anomaly detection
• Experience with Git Source Control System
• An active TS/SCI with a polygraph is required.

Nice To Haves

• Experience using Apache Airflow (DAG design, scheduling, operators, sensors) to orchestrate, schedule, and monitor complex workflows
• Familiar with SQL technologies such as MySQL, MariaDB, and PostgreSQL for querying, joining, and aggregating large datasets
• Familiar with HPC Job Scheduling tools including Slurm
• Experience using the Atlassian Tool Suite (JIRA, Confluence)

Responsibilities

• designing, implementing, and optimizing data ingress and egress pathways to ensure efficient, scalable, and reliable processing of the organization’s analytics workloads

Benefits

• 100% company-paid individual health , dental , and vision premiums
• Automatic company contributed Health Savings Account (HSA) up to $3,900 for families
• Up to 7 weeks of Paid Time Off (PTO)
• 401(k) Plan, 4% match with 3% guaranteed
• Paid 11 Federal Holidays
• BlueCross BlueShield Health Insurance
• BlueCross CareFirst dental, ortho and vision
• Tuition/Training, up to $5250 annually for pre-approved education
• Company-paid events, including golf events, fishing trips, baseball games, hockey games and more
• Health Insurance
• Dental and Vision Coverage
• Health Savings Account (HSA)
• Paid Time Off
• Holiday Pay
• Short Term and Long Term Disability
• Life Insurance
• 401(k) Plan
• Safe Harbor 401k Investment
• Learning and Development opportunities
• Referral Bonuses
• Flex Time

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed