Enterprise - Software Engineer - Apache, Python, Docker
About The Position
Erias Ventures is seeking engineers who wish to grow their careers and want to become part of a technically strong and growth-oriented company focused on bringing innovative solutions to the difficult mission problems facing our customers. We are seeking a talented and experienced Data & Software Engineer who will work with a small team to build complex data flows for a custom application. A successful candidate will have advanced Python programming skills, familiarity with Java, an understanding of data security, privacy, governance and compliance principles and a demonstrated history of building production data pipelines and ETL workflows at scale.
Requirements
- Apache Spark & PySpark
- Advanced Python skills (including Pandas & NumPy)
- Docker, Podman
- AWS S3, Lambda & Step functions
- Apache Iceberg, Airflow, etc
- SQL (with Trino)
- NoSQL, DynamoDB
- Unity Catalog OSS, Apache Polaris
- Apache Superset
- Terraform or CloudFormation
- OpenLineage
- H3, PostGIS
- A current Top-Secret/SCI with polygraph security clearance is required.
- Candidates cannot be sponsored or nominated for a government security clearance under this position.
Nice To Haves
- Familiarity with Java
- Understanding of data security, privacy, governance and compliance principles
- Demonstrated history of building production data pipelines and ETL workflows at scale
Responsibilities
- Work with stakeholders to understand data requirements, assess feasibility, and design appropriate solutions with minimal oversight
- Leverage strong problem-solving and debugging skills for data quality issues, pipeline failures, and performance bottlenecks
- Leverage a background in large-scale data migration or platform modernization efforts
- Contribute to data engineering documentation, best practices, and design patterns
- Build end-to-end data pipelines leveraging Python
- Use orchestration tools to deploy data pipelines, including configuring and updating Spark Jobs
- Containerize and deploy applications in cloud environments like AWS
- Work with MySQL and PostgreSQL including performance tuning, schema design, and query optimization for complex, analytical workloads
- Leverage industry standard tools for code control (Git, IaaC control, etc.)
- Work with data catalogs, tracking data lineage and handling a variety of data formats, including Geospatial
- Use Bash scripting for automation and data processing tasks
- Integrate Al/ML services and models
Benefits
- Above Market Hourly Pay
- 11% Roth or Traditional 401k with Immediate Vesting and Deposit
- Spot Bonuses for Assisting with Business Development and Company Growth
- Professional Development Bonuses for Certificates and Degrees
- Company subsidized Medical Coverage
- 100% Company Paid Vision and Dental Coverage
- 100% Company Paid Long Term Disability , Short Term Disability , and Group Life Insurance
- Monthly Wellness Reimbursement
- Paid Time Off with Flexible Work Schedules and Birthday Off
- Amazon Prime Membership and Monthly Internet Reimbursement
- Technology and Productivity Allowance for Equipment and Supplies
- Morale Building and Company Events to Celebrate our Successes and Build our Community
- Onboarding and Annual Swag
- Company Paid Professional Development and Training
- Referral bonus of up to $10,000 for each successful hire
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
