Platform Software Engineer
About The Position
Design and Build Data Pipelines: Architect, develop, and maintain scalable data pipelines and microservices that support real-time and batch processing on GCP. Service-Oriented Architecture (SOA) and Microservices: Design and implement SOA and microservices-based architectures to ensure modular, flexible, and maintainable data solutions. Full-Stack Integration: Leverage your full-stack expertise to contribute to the seamless integration of front-end and back-end components, ensuring robust data access and UI-driven data exploration. Data Ingestion and Integration: Lead the ingestion and integration of data from various sources into the data platform, ensuring data is standardized and optimized for analytics. GCP Data Solutions: Utilize GCP services (BigQuery, Dataflow, Pub/Sub, Cloud Functions, etc.) to build and manage data platforms that meet business needs. Data Governance and Security: Implement and manage data governance, access controls, and security best practices while leveraging GCP's native row- and column-level security features. Performance Optimization: Continuously monitor and improve the performance, scalability, and efficiency of data pipelines and storage solutions. Collaboration and Best Practices: Work closely with data architects, software engineers, and cross-functional teams to define best practices, design patterns, and frameworks for cloud data engineering. Automation and Reliability: Automate data platform processes to enhance reliability, reduce manual intervention, and improve operational efficiency. Develop robust, scalable services using Java Spring Boot, Python, Angular, and GCP technologies. Design and develop RESTful APIs for seamless integration across platform services. Implement robust unit and functional tests to maintain high standards of test coverage and quality. Established and active employee resource groups
Requirements
- Bachelor's degree in Computer Science, Data Engineering, Information Systems, or a related field.
- Minimum 2 years of experience as a Software Engineer
- Proficient in Java, angular or any technology with experience in designing and deploying cloud-based data pipelines and microservices using GCP tools like BigQuery, Dataflow, and Dataproc.
- Ability to leverage best in-class data platform technologies to deliver platform features, and design & orchestrate platform services to deliver data platform capabilities.
- Strong analytical skills with the ability to troubleshoot complex data platform and microservices issues.
Nice To Haves
- Master's degree or equivalent experience preferred.
- Familiarity with CI/CD pipelines, Infrastructure as Code (IaC) tools like Terraform, and automation frameworks.
- Certifications (Preferred): GCP Data Engineer, GCP Professional Cloud
Responsibilities
- Architect, develop, and maintain scalable data pipelines and microservices that support real-time and batch processing on GCP.
- Design and implement SOA and microservices-based architectures to ensure modular, flexible, and maintainable data solutions.
- Contribute to the seamless integration of front-end and back-end components, ensuring robust data access and UI-driven data exploration.
- Lead the ingestion and integration of data from various sources into the data platform, ensuring data is standardized and optimized for analytics.
- Utilize GCP services (BigQuery, Dataflow, Pub/Sub, Cloud Functions, etc.) to build and manage data platforms that meet business needs.
- Implement and manage data governance, access controls, and security best practices while leveraging GCP's native row- and column-level security features.
- Continuously monitor and improve the performance, scalability, and efficiency of data pipelines and storage solutions.
- Work closely with data architects, software engineers, and cross-functional teams to define best practices, design patterns, and frameworks for cloud data engineering.
- Automate data platform processes to enhance reliability, reduce manual intervention, and improve operational efficiency.
- Develop robust, scalable services using Java Spring Boot, Python, Angular, and GCP technologies.
- Design and develop RESTful APIs for seamless integration across platform services.
- Implement robust unit and functional tests to maintain high standards of test coverage and quality.
- Manage code changes with GitHub and troubleshoot and resolve application defects efficiently.
- Ensure adherence to SDLC best practices, independently managing feature design, coding, testing, and production releases.
Benefits
- Established and active employee resource groups
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Entry Level
Number of Employees
5,001-10,000 employees
