Senior Data Platform Engineer

Dataiku

84d

About The Position

Dataiku is looking for a Sr. Data Platform Engineer to join our Enterprise Data and Analytics (EDA) team. As a member of the EDA Team, you will play a central role in delivering data & GenAI solutions to fuel analytics and data-driven insights to various stakeholders and teams within the company. You will be a key technical member contributing to the Data Platform that fuels centralized analytics, embedded analytics teams, and self-service users across the organization. At this level of seniority, non-technical skills, learning & teaching, and business acumen are critical, along with the expectation of technical excellence as you will help drive technical decision-making and solutioning of key technical challenges both within the team and across the Analytics Community. The technical day to day will primarily be within the Data Platform built using Snowflake, Dataiku & Github.

Requirements

• Experience & a strong understanding of GenAI development, security & governance concepts a must
• 5+ years of relevant experience in Data Engineering / Data Platform Engineering /Data Architecture
• Expert level SQL & Python is a must
• Experience in Dataiku DSS is a strong plus
• Prior experience with Snowflake required
• Prior experience with DevOps technologies such as Github Actions, Azure DevOps or Jenkins
• Strong understanding of data architecture & data modeling concepts
• Prior experience building and maintaining replication & data pipelines in a cloud data warehouse or data lake environment
• Strong analytical mindset; proactively clarifies ambiguous problems, challenges assumptions, and proposes pragmatic solutions
• Works effectively with complex stakeholders, translating vague asks into clear, testable requirements
• Excellent written and verbal communication with senior audiences; articulates business value, data products, and platform capabilities; produces precise, concise documentation
• Demonstrated ownership in remote, fast-paced environments: manages multiple projects, adapts to different roles, mentors peers, and invests in continuous learning & knowledge-sharing

Responsibilities

• Be an expert level engineer within the Dataiku Platform including Platform Automation, GenAI Capabilities, Plugin Development, maintenance & troubleshooting
• Be an expert level engineer within Snowflake for data engineering and security/governance features
• Build & maintain GenAI Platform solutions focused on security and governance for engineering delivery
• Build & maintain Python & SQL based platform automation process
• Build & maintain DataOps process for SDLC delivery
• Build & maintain data quality metrics & observability to help drive data quality standards
• Build & maintain administration systems and applications for monitoring, alerting, data observability, access management, platform metrics, and end user transparency
• Assist Data Engineering with building python & SQL data replication & data pipelines on large & often complex data sets
• Design data models for both short term and long term use cases to support data warehouse scalability
• Identify opportunities for improvements & optimization for greater scalability & delivery velocity
• Collaborate with engineers within GenAI Engineering & Analytics Engineering to build scalable solutions within the Data Platform
• Perform root cause analysis on often complex errors to help ensure data pipeline availability
• Help drive technical & architectural decisions on the data platform including decisions on data architecture, data engineering processes, data quality frameworks, data access security & governance frameworks, DataOps processes & data consumption models
• Help test new features in Dataiku and partner tools to both provide feedback internally and determine value towards internal analytics & data platform integration
• Work closely with key stakeholders across the organization including Infra, embedded analytics teams, Product and Engineering to help foster both technical implementations & requirements gathering
• Promote the Data Platform internally, help train & mentor others within the organization with technical excellence, & provide support on data & platform related inquiries
• Proactively drive innovation internally with dedicated innovation time & projects that aim to be transformational for either the platform, team or company as a whole
• Actively contribute to the expertise level and competencies of the EDA Team and participate in the creation and support of data development standards and best practices

What This Job Offers

• Career Level: Senior
• Number of Employees: 1,001-5,000 employees