Senior Data Platform Engineer
About The Position
As a Platform Data Engineer, you are an architect and builder of the foundations. You do not just move data; you build the resilient infrastructure, automated tooling, and scalable systems that allow the entire analytics ecosystem to function. Your mission is to eliminate human bottlenecks by stitching together complex components into a high-performance, controlled, and reliable data engine. You will match the capabilities and scale of the platform to our unique business requirements, ensuring that every byte of data is stored, orchestrated, and accessed with maximum efficiency and minimum manual intervention.
Requirements
- Technical Background: Proven track record as a builder in cloud-based data environments (preferably Azure) with a focus on System Design and Architecture.
- Software Engineering Mindset: Strong foundation in Python development and experience with distributed data processing (e.g., Spark).
- Expertise in Data Structures: Deep knowledge of Data Warehouses, Lakes, and Lakehouses, including query optimization and schema design.
- Automation: Experience with Infrastructure as Code (IaC) and automated testing to ensure platform resilience and maintainability.
- Problem Solving: The ability to take a complex chain of computations and turn it into a controlled, reliable ecosystem that recovers easily from failure.
Nice To Haves
- Experience in MLOps Engineering to support model development and deployment.
- Knowledge of Security & Governance frameworks (encryption, access control, and compliance).
- Familiarity with Observability & Monitoring tools (logging, metrics, and audit trails) to ensure platform health.
Responsibilities
- Infrastructure & Platform Engineering: Design, build, and maintain the physical and logical architecture of our data platform. You ensure the platform evolves with our needs, moving beyond a "set it and forget it" mentality to a dynamic, scalable system.
- Ingestion & Integration: Build the ingestion layer to take raw data from various internal and external sources and integrate it seamlessly into the analytical platform for processing.
- Automation & Developer Experience: Champion the "machine-first" approach by automating repetitive tasks and building software to handle data efficiently. You ensure that data foundations are built on code, not manual inputs or human-heavy workflows.
- Orchestration & Workflow Management: Turn computational chaos into a controlled ecosystem by designing complex orchestration chains that distribute, monitor, and recover processes automatically.
- System Reliability & Performance: Optimize SQL queries, schema designs, and distributed processing tasks to ensure the platform remains performant as scale increases.
- Security & Cost Control: Implement tightly designed access controls and resource management strategies to ensure compliance and prevent cloud bills from skyrocketing.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Education Level
No Education Listed
