Senior Data Engineer (6-month contract)

gravity9

3d • Remote

About The Position

gravity9 is a boutique IT consulting company headquartered in the UK, with offices in the US, Canada, and Poland. It works with clients on complex business problems, combining engineering, experience design, and product management.

The Senior Data Engineer will join a client’s Product Development team within its Digital Practice and contribute to digital transformation initiatives. The role focuses on productizing subject-matter expertise through robust data platforms and AI-enabled solutions built on Microsoft Azure. The successful candidate will help deliver solutions supporting decision-making, autonomous execution, and integrated operations. They will work in a flat, connected organization that values innovation and an entrepreneurial mindset, and will be expected to set direction, mentor team members, communicate effectively, and lead through hands-on work. This is a fully remote position, but the employee must physically reside in Poland. The role is a six-month contract.

Requirements

• At least 7 years of experience in data engineering or software development, including at least 3 years of hands-on experience with Azure Databricks or Spark.
• Experience actively mentoring junior team members.
• Expert-level Python and PySpark skills, and SQL skills.
• Experience with Azure Data Factory, Azure Databricks (Delta Lake, Workflows, and Unity Catalog), Azure Data Lake Storage, and Azure SQL.
• Experience with dimensional and lakehouse data modelling and integrating data through APIs, OData, JDBC/ODBC, and files.
• Experience with Azure AI services, such as Azure AI Foundry or Azure OpenAI, and preparing data for AI agents.
• Experience with secure CI/CD and infrastructure-as-code, such as Terraform, Bicep, or Databricks Asset Bundles, across DEV, UAT, and PROD using Azure DevOps or GitHub, with sound Git branching practices.
• Experience with AI-assisted development and sound judgement in reviewing generated code.
• Experience with data quality, testing, security, and privacy in regulated or restricted-data environments.
• Experience designing end-to-end data solutions and recommending new frameworks and technologies.
• Experience with Agile and Kanban delivery in mixed-discipline teams, building consensus across subject matter experts, engineers, data scientists, and designers.
• Self-starter who is organized and needs minimal supervision.
• Bachelor’s degree in computer science, engineering, or a related field, or equivalent education and experience.
• Physical residence in Poland is required.

Nice To Haves

• Experience integrating enterprise systems, such as ERP, project management, or document management platforms.
• Knowledge of data management and governance concepts, such as data quality, cataloguing, lineage, master data, and stewardship, using any supporting toolset.

Responsibilities

• Work in Agile teams to deliver the committed backlog against acceptance criteria.
• Design, build, and operate ingestion and orchestration pipelines in Azure Data Factory.
• Develop ETL/ELT in Azure Databricks using a medallion architecture to deliver trusted data for analytics, reporting, and AI.
• Lead code reviews and set engineering standards; participate in estimating, planning, testing, deployments, and documentation.
• Shape data architecture decisions, including metric definitions, semantic models, and data that serves AI agents.
• Apply data governance, security, and access controls in line with client classification and residency requirements.
• Use AI-assisted development tools responsibly to accelerate delivery without compromising quality or security.
• Communicate progress, open items, and issues to stakeholders, including management.
• Stay abreast of relevant technology developments.

What This Job Offers

• Career Level: Senior