Senior Software Engineer, ML Data Platform
About The Position
Develop fast, robust, and spike-resistant data consumption, data mining, and processing tools for the entire company. Develop orchestration for large-scale post-processing, and computational pipelines. Participate in the development, optimization and productionization of the next generation data processing platform using Beam and Spark in the cloud. Build self-serve capabilities to help customers to adopt the next generation data processing platform. Use the latest cloud technologies to own, design, implement, and test scalable distributed data systems in the cloud. Champion engineering excellence by continuously improving systems and processes. Own technical projects from start to finish, contribute to the team’s product roadmap, and be responsible for major technical decisions and tradeoffs. Effectively participate in team’s planning, code reviews and design discussions. Consider the effects of projects across multiple teams and proactively manage conflicts. Work with partner teams and orgs to achieve cross-organizational goals and satisfy broad requirements. Conduct technical interviews with well-calibrated standards and play an essential role in recruiting activities.
Requirements
- Bachelor's degree in Computer Science, Electronic Engineering, Management Information Systems, or related field of study
- Five (5) years of experience as a Software Engineer, Programmer Analyst, or related occupation
- Five (5) years of experience with Building Peta Byte (PB) scale data management systems
- Five (5) years of experience optimizing data processing clusters for cost efficiency and performance
- Five (5) years of experience building serving systems capable of delivering data at high-throughput, low-latency and high QPS (Queries Per Second) in a cost-efficient and spike-resilient manner
- Five (5) years of experience building scalable infrastructure on the cloud with Python, Java, or Scala
- Five (5) years of experience writing SQL queries for analytic purposes
Responsibilities
- Develop fast, robust, and spike-resistant data consumption, data mining, and processing tools for the entire company.
- Develop orchestration for large-scale post-processing, and computational pipelines.
- Participate in the development, optimization and productionization of the next generation data processing platform using Beam and Spark in the cloud.
- Build self-serve capabilities to help customers to adopt the next generation data processing platform.
- Use the latest cloud technologies to own, design, implement, and test scalable distributed data systems in the cloud.
- Champion engineering excellence by continuously improving systems and processes.
- Own technical projects from start to finish, contribute to the team’s product roadmap, and be responsible for major technical decisions and tradeoffs.
- Effectively participate in team’s planning, code reviews and design discussions.
- Consider the effects of projects across multiple teams and proactively manage conflicts.
- Work with partner teams and orgs to achieve cross-organizational goals and satisfy broad requirements.
- Conduct technical interviews with well-calibrated standards and play an essential role in recruiting activities.
Benefits
- Bonus Potential: An incentive pay program offers payouts based on company performance, job level, and individual performance.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
