Software Engineer III
About The Position
Design and develop supply-chain data pipelines that generate accurate business metrics, including demand forecasts. Optimize pipeline performance and running costs while meeting strict downstream SLAs. Work with stakeholders to understand feature requirements, develop technical specifications, recommend designs, and build pipelines at substantial scale. Provide post-production support to keep business-serving pipelines operational, configure the required infrastructure, analyze complex datasets, and share relevant metrics and datasets with stakeholders. Collaborate with data scientists on feature-engineering pipelines for production-grade machine-learning models and provide insights on model accuracy. Maintain data quality, security, and correctness through automated tests, data-validity scripts, and strict access policies.
Requirements
- Master’s degree or equivalent in Computer Science, Engineering (any), or a related field.
- Experience designing and developing scalable backend systems and data-processing frameworks using Python and Java.
- Experience architecting, implementing, and maintaining production-grade ETL pipelines using Java for large-scale data ingestion and transformation.
- Experience designing distributed data systems using parallel-computing principles to optimize performance and resource utilization at scale.
- Experience applying object-oriented design patterns to build modular, maintainable, and extensible software components for data-engineering platforms.
- Experience authoring, scheduling, and monitoring complex data-pipeline orchestration workflows using Apache Airflow.
- Experience with cloud infrastructure solutions including GCP, AWS, and Azure for scalable ETL workloads and data-processing services.
- Experience with source-code version control, collaborative development workflows, and containerized deployment pipelines using GitHub and Docker.
- Experience building distributed data-processing pipelines in Apache Spark and Java, using Hadoop and HDFS for high-volume data operations.
- Experience with relational databases including PostgreSQL and NoSQL databases for structured and unstructured data storage and retrieval.
- Experience developing Python analytical scripts to evaluate, validate, and benchmark machine-learning model performance metrics.
- Experience applying machine-learning concepts, including feature engineering and model evaluation, and data-warehousing principles to support data-driven decisions.
- Experience managing project tasks and sprint-based delivery using Agile methodologies and tools including Jira.
- The position does not require specific years of experience; the employer will accept any amount of graduate coursework, graduate research experience, or professional experience with the required skills.
Responsibilities
- Design and develop scalable data pipelines in the supply-chain domain, including pipelines that generate demand forecasts.
- Automate and enhance pipelines to improve performance, minimize running costs, and meet downstream SLAs.
- Collaborate with stakeholders to gather feature requirements, formulate technical specifications, recommend designs, and develop large-scale pipelines.
- Provide post-production support to prevent downtime for business-serving pipelines.
- Configure infrastructure needed to operate the pipelines.
- Collect and analyze extensive, complex datasets and distribute relevant metrics and datasets to stakeholders.
- Collaborate with data scientists to build feature-engineering pipelines for production-grade machine-learning models and share insights on model accuracy.
- Maintain production data quality, integrity, security, and correctness using automated tests, data-validation scripts, and access policies.
Benefits
- Medical, vision, and dental coverage.
- 401(k), stock purchase plan, and company-paid life insurance.
- Paid time off, including sick leave, parental leave, family care leave, bereavement leave, jury duty, and voting leave.
- Short-term and long-term disability.
- Education assistance, including 100% company-paid college degrees.
- Company discounts.
- Military service pay.
- Adoption expense reimbursement.
- Annual or quarterly performance incentives.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
