Senior Python Platform Engineer – PySpark, FastAPI & GCP

Infosys Pontoon • Charlotte, NC

1d • Hybrid

About The Position

We are seeking a Python-based platform engineer to design and build a containerized API layer that abstracts and governs interactions with Apache Spark through a well-defined API contract. The role focuses on building platform capabilities that enable consistent, secure, and scalable access to Spark-based data pipelines.

The ideal candidate has experience developing production-grade Python APIs that interface with data frameworks or pipeline orchestration systems, packaging services with containers such as Docker and Kubernetes, and operating them as reusable platform services. The role also requires CI/CD automation using GitHub Actions and sound software engineering practices for testing, versioning, and deployment. Hands-on GCP experience is required.

The engineer should be able to coordinate with the client, manage offshore resources, and work with onsite team members and the client. The role is suited to engineers who have built data or compute platforms, service layers, or internal frameworks, translating complex Spark capabilities into stable, contract-driven APIs for broad enterprise use. The position is hybrid in Charlotte, North Carolina, with a mandatory three days in the office each week.

Requirements

• At least 10 years of experience in the IT industry.
• Strong Python experience.
• PySpark experience.
• Experience building production-grade APIs and microservices.
• Experience with CI/CD automation using GitHub Actions.
• Hands-on experience with GCP.
• Experience with Docker and Kubernetes containerized services.
• Experience with control planes.
• Knowledge of design patterns and capabilities including modular containerized services, asynchronous processing, job-based work queue execution, immutability and idempotency, metadata management, policy enforcement, semantic modeling, observability and telemetry, and side effect capability injection.
• Experience with functional and behavioral testing.
• Ability to coordinate with clients, manage offshore resources, and work with onsite team members.

Nice To Haves

• ETL experience.

Responsibilities

• Design and build a containerized API layer that abstracts and governs interactions with Apache Spark through a well-defined API contract.
• Build platform capabilities that provide consistent, secure, and scalable access to Spark-based data pipelines.
• Develop production-grade Python APIs that interface with data frameworks or pipeline orchestration systems.
• Package services using containers and operate them as reusable platform services.
• Apply software engineering practices for testing, versioning, and deployment.
• Coordinate with the client and work with onsite team members.
• Manage offshore resources.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed