HPC - Senior Software Engineer - Linux, Bash, Apache Spark

Erias Ventures•Annapolis Junction, MD

1d•$229,000 - $251,000

About The Position

The Software Engineer shall possess extensive expertise in dataflow design, data transport mechanisms, and Apache Spark based distributed processing. In this role, the Software Engineer will be responsible for designing, implementing, and optimizing data ingress and egress pathways to ensure efficient, scalable, and reliable processing of the organization’s analytics workloads.

Requirements

Master’s degree in computer science or related discipline from an accredited college or university, plus five (5) years of experience as a SWE, in programs and contracts of similar scope, type, and complexity or Bachelor’s degree in computer science or related discipline from an accredited college or university, plus seven (7) years of experience as a SWE, in programs and contracts of similar scope, type, and complexity or nine (9) years of experience as a SWE, in programs and contracts of similar scope, type, and complexity.
A current Top-Secret/SCI with polygraph security clearance (within 7 years) is required.
Candidates cannot be sponsored or nominated for a government security clearance under this position.
Experience using the Linux CLI and Linux tools
Experience developing Bash scripts to automate manual processes
Recent software development experience using Python and Java
Experience with Distributed Big Data processing engines including Apache Spark
Experience using Jupyter Notebook
Experience with data wrangling and preprocessing using tools such as pandas, NumPy
Experience working with structured, semi-structured, and unstructured data such as Parquet, JSON, CSV, XML
Familiarity with data quality concepts, data validation, and anomaly detection
Experience with Git Source Control System

Nice To Haves

Experience using Apache Airflow (DAG design, scheduling, operators, sensors) to orchestrate, schedule, and monitor complex workflows
Familiar with SQL technologies such as MySQL, MariaDB, and PostgreSQL for querying, joining, and aggregating large datasets
Familiar with HPC Job Scheduling tools including Slurm
Experience using the Atlassian Tool Suite (JIRA, Confluence)

Responsibilities

designing, implementing, and optimizing data ingress and egress pathways to ensure efficient, scalable, and reliable processing of the organization’s analytics workloads

Benefits

Erias Ventures provides a complete package of wealth, health, and happiness benefits.
Above Market Hourly Pay
11% Roth or Traditional 401k with Immediate Vesting and Deposit
Spot Bonuses for Assisting with Business Development and Company Growth
Professional Development Bonuses for Certificates and Degrees
Company subsidized Medical Coverage
100% Company Paid Vision and Dental Coverage
100% Company Paid Long Term Disability , Short Term Disability , and Group Life Insurance
Monthly Wellness Reimbursement
Paid Time Off with Flexible Work Schedules and Birthday Off
Amazon Prime Membership and Monthly Internet Reimbursement
Technology and Productivity Allowance for Equipment and Supplies
Morale Building and Company Events to Celebrate our Successes and Build our Community
Onboarding and Annual Swag
Company Paid Professional Development and Training