Senior Engineer - Data Infrastructure
About The Position
The Venmo Data Infrastructure team supports Venmo's internal and customer-impacting data movement and message streaming infrastructure. We are actively engaged in partnering with development groups, platform, and infrastructure teams — providing deep subject matter expertise on Kafka-based streaming architecture, and acting as the escalation point for analyzing and resolving complex, large-scale streaming and performance issues. Design, implement and operate data infrastructure’s initiatives to provide secure, scalable, reliable and performant platform to Venmo product, analytics and the other infrastructure teams Automate provisioning, management and monitoring solutions for the supported data infrastructure Build and implement scalable and reliable data pipeline architecture to optimize overall performance. Build tools that help users leverage our data into actionable insights to improve our customers’ experiences, operational efficiency, and business performance. Build and implement message streaming solutions for Venmo applications with AWS SQS, Apache Kafka etc Collaborate with stakeholders including the Executive, Product, Engineering and Analytics teams to assist with data-related technical issues and support their data infrastructure need. Collaborate with teammates on planning and execution of initiatives. Process, extract and manage relational databases and systems such as query authoring (SQL) and NoSQL databases. Create large, complex data sets that meet functional and non-functional business requirements. Demonstrable ability to learn new technologies and process practices.
Requirements
- 1+ years relevant experience and a Bachelor’s degree OR Any equivalent combination of education and experience.
- Bachelors and/or master's in computer science or related field of study
- 3+ years' experience in software development or a related field
- 3+ years' experience operating global scale high throughput AWS native data pipelines
- Hands-on experience with designing and implementing infrastructure to support global-scale services
- Hands-on experience with IaaS and PaaS solutions from AWS (or similar cloud provider), including: Infrastructure as code (Terraform, AWS CloudFormation), Programming and scripting (Python, Java, Lambda)
- Hands-on experience with related big data infrastructure — AWS S3, AWS DMS, AWS EKS, Apache Spark, AWS Glue — and how they integrate with a streaming backbone
- Experience with operating/maintaining message streaming solutions like AWS SQS, Apache Kafka etc.
- Ability to troubleshoot problems
- Strong communication skills with the ability to understand and explain technical issues to a non-technical audience
- 3+ years relevant experience and a Bachelor's degree, OR any equivalent combination of education and experience
Nice To Haves
- AWS Solutions Architect is a plus
Responsibilities
- Implements tasks within the Software Development Lifecycle (SDLC), receiving structure and oversight from more experienced staff
- Follows well-established internal conventions and standard procedures
- Understands internal standards & processes an applies them to make technical decisions
- Collaborates with peers, manager, and project lead to gain understanding of tasks and review solutions
- May contribute to code & design reviews
- Design, implement and operate data infrastructure’s initiatives to provide secure, scalable, reliable and performant platform to Venmo product, analytics and the other infrastructure teams
- Automate provisioning, management and monitoring solutions for the supported data infrastructure
- Build and implement scalable and reliable data pipeline architecture to optimize overall performance.
- Build tools that help users leverage our data into actionable insights to improve our customers’ experiences, operational efficiency, and business performance.
- Build and implement message streaming solutions for Venmo applications with AWS SQS, Apache Kafka etc
- Collaborate with stakeholders including the Executive, Product, Engineering and Analytics teams to assist with data-related technical issues and support their data infrastructure need.
- Collaborate with teammates on planning and execution of initiatives.
- Process, extract and manage relational databases and systems such as query authoring (SQL) and NoSQL databases.
- Create large, complex data sets that meet functional and non-functional business requirements.
- Demonstrable ability to learn new technologies and process practices.
Benefits
- generous paid time off
- healthcare coverage for you and your family
- resources to create financial security
- support your mental health
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
