Enterprise - Software Engineer - Apache, Python, Docker
About The Position
We are seeking a talented and experienced Data & Software Engineer who will work with a small team to build complex data flows for a custom application. A successful candidate will have advanced Python programming skills, familiarity with Java, an understanding of data security, privacy, governance and compliance principles and a demonstrated history of building production data pipelines and ETL workflows at scale. Work with stakeholders to understand data requirements, assess feasibility, and design appropriate solutions with minimal oversight Leverage strong problem-solving and debugging skills for data quality issues, pipeline failures, and performance bottlenecks Leverage a background in large-scale data migration or platform modernization efforts Contribute to data engineering documentation, best practices, and design patterns Build end-to-end data pipelines leveraging Python Use orchestration tools to deploy data pipelines, including configuring and updating Spark Jobs Containerize and deploy applications in cloud environments like AWS Work with MySQL and PostgreSQL including performance tuning, schema design, and query optimization for complex, analytical workloads Leverage industry standard tools for code control (Git, IaaC control, etc.) Work with data catalogs, tracking data lineage and handling a variety of data formats, including Geospatial Use Bash scripting for automation and data processing tasks Integrate Al/ML services and models
Requirements
- A bachelor’s degree in computer science, Computer Information Systems, or Computer Engineering with ten (10) years of experience executing software development activities.
- Apache Spark & PySpark
- Advanced Python skills (including Pandas & NumPy)
- Docker, Podman
- AWS S3, Lambda & Step functions
- Apache Iceberg, Airflow, etc
- SQL (with Trino)
- NoSQL, DynamoDB
- Unity Catalog OSS, Apache Polaris
- Apache Superset
- Terraform or CloudFormation
- OpenLineage
- H3, PostGIS
- A current Top-Secret/SCI with polygraph security clearance is required. Candidates cannot be sponsored or nominated for a government security clearance under this position.
Responsibilities
- Work with stakeholders to understand data requirements, assess feasibility, and design appropriate solutions with minimal oversight
- Leverage strong problem-solving and debugging skills for data quality issues, pipeline failures, and performance bottlenecks
- Leverage a background in large-scale data migration or platform modernization efforts
- Contribute to data engineering documentation, best practices, and design patterns
- Build end-to-end data pipelines leveraging Python
- Use orchestration tools to deploy data pipelines, including configuring and updating Spark Jobs
- Containerize and deploy applications in cloud environments like AWS
- Work with MySQL and PostgreSQL including performance tuning, schema design, and query optimization for complex, analytical workloads
- Leverage industry standard tools for code control (Git, IaaC control, etc.)
- Work with data catalogs, tracking data lineage and handling a variety of data formats, including Geospatial
- Use Bash scripting for automation and data processing tasks
- Integrate Al/ML services and models
Benefits
- Above Market Hourly Pay
- 11% Roth or Traditional 401k with Immediate Vesting and Deposit
- Spot Bonuses for Assisting with Business Development and Company Growth
- Professional Development Bonuses for Certificates and Degrees
- Company subsidized Medical Coverage
- 100% Company Paid Vision and Dental Coverage
- 100% Company Paid Long Term Disability , Short Term Disability , and Group Life Insurance
- Monthly Wellness Reimbursement
- Paid Time Off with Flexible Work Schedules and Birthday Off
- Amazon Prime Membership and Monthly Internet Reimbursement
- Technology and Productivity Allowance for Equipment and Supplies
- Morale Building and Company Events to Celebrate our Successes and Build our Community
- Onboarding and Annual Swag
- Company Paid Professional Development and Training
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Number of Employees
1-10 employees
