DevOps Data Platform Developer
About The Position
The successful candidate will work as a member of the IT Development Team to deploy and maintain infrastructure and data platforms for use by research projects. They will be expected to apply a cross-functional skillset to design, develop, and manage a variety of systems in production environments. Candidate will use DevOps best practices to ensure that systems can be created and maintained efficiently, continuously improved, and can incorporate changes quickly. Applicant must be able to work independently and as part of a team to engineer on-premise and cloud infrastructure and data platforms built around Kubernetes and its ecosystem of technologies. The successful candidate will be able to engage with developers and researchers at VTTI and external clients to understand requirements and architect and implement solutions. Documenting systems and cross-training colleagues at VTTI to ensure that information is effectively shared will be a requirement. Our team builds and operates large-scale systems that power data-driven transportation research and smart city innovation. As part of this work, we maintain the Smart Cities Data Exchange, a secure, cloud-native platform for sharing transportation and environmental data across jurisdictions. You'll work on DevOps and infrastructure automation supporting Intelligent Transportation Systems (ITS) and Automated Driving System (ADS) research, helping ensure the reliability, scalability, and observability of mission-critical services that enable safer and smarter mobility. Performance at this level requires significant experience in a professional position or equivalent graduate level education.
Requirements
- M.S. degree in Computer Science or engineering comparable with exception for a lesser degree with significant related professional experience
- Proficient in Kubernetes and related technologies with multiple years of experience
- Experience with Kafka and related streaming data technologies
- Experience with basic Linux system administration
- Experience with authentication and authorization, particularly OAuth2 and OIDC
- Experience working with product owners to develop requirements
- Familiarity with relational database technologies and SQL
- Familiarity with data lake architecture
Nice To Haves
- Experience with Apache NiFi
- Experience with Apache Trino
- Experience with Apache Iceberg
- Experience using GitLab and CI/CD pipelines
- Experience with end-to-end testing
- Experience with Ceph
- Experience with Grafana's monitoring stack
- Experience with Keycloak
- Experience with Infrastructure as Code
- Experience with GPU clustering technologies and frameworks
- Familiarity with networking in an on-prem environment
Responsibilities
- Deploy and maintain infrastructure and data platforms for use by research projects
- Apply a cross-functional skillset to design, develop, and manage a variety of systems in production environments
- Use DevOps best practices to ensure that systems can be created and maintained efficiently, continuously improved, and can incorporate changes quickly
- Engineer on-premise and cloud infrastructure and data platforms built around Kubernetes and its ecosystem of technologies
- Engage with developers and researchers at VTTI and external clients to understand requirements and architect and implement solutions
- Documenting systems and cross-training colleagues at VTTI to ensure that information is effectively shared
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Industry
Educational Services
Number of Employees
5,001-10,000 employees
