Senior Data Engineer
About The Position
We offer a flexible working policy that supports a healthy balance between personal and professional well-being. This role requires in-office presence on Tuesdays & Thursdays to collaborate, connect, and learn from peers - while also maintaining the flexibility for meaningful work-life balance. Being a Senior Data Engineer at iManage Means... You are passionate about building a reliable, scalable data infrastructure that powers modern AI products. You thrive on designing lakehouse architectures, engineering robust pipelines, and making data accessible, trustworthy, and performant at scale. You bring a strong engineering mindset to everything from ingestion to governance, and you know how to choose the right tools for the job. As a Senior Data Engineer on the Applied Data team, you will design, build, and maintain the data platform and pipelines that support AI/ML solutions, and intelligent features across iManage. You will partner with applied AI, product, and engineering teams to ensure data is well-structured, reliable, and ready to power the next generation of iManage capabilities.
Requirements
- A bachelor's degree or higher in Computer Science, Data Engineering, Applied Mathematics, or a related quantitative field
- 4+ years of data engineering experience, with a strong track record delivering production-grade pipelines at scale
- Strong proficiency in Python, PySpark, and Spark SQL for large-scale data processing
- Hands-on experience with Databricks, including Delta Lake, Delta Live Tables, Unity Catalog, Volumes, and Databricks Workflows
- Solid understanding of lakehouse architecture principles, including Medallion architecture, and experience designing for reliability, performance, and governance
- Experience orchestrating data pipelines on cloud infrastructure, preferably Microsoft Azure and Databricks
- Proficiency with Git and collaborative development practices
- A strong sense of ownership over data quality and platform reliability
Nice To Haves
- Experience with Microsoft Azure services including Azure Data Lake Storage, Azure AI Foundry, Azure ML, and Microsoft Fabric
- Familiarity with AI or ML workflows and experience supporting data needs for model training, fine-tuning, or evaluation
- Experience with data processing, including text normalization, embeddings, or semantic search datasets
- Experience with large document datasets
- Experience working with data in the legal domain
- Prior work designing architectures for large-scale document or text corpora
Responsibilities
- Designing, developing, and maintaining scalable data pipelines on Databricks & Microsoft Azure to ingest and transform large volumes of structured and unstructured data from multiple sources
- Building and optimizing large-scale data workflows for normalization, deduplication, enrichment, and quality enforcement
- Architecting and managing data platforms that enforce governance, lineage tracking, and access controls across the organization
- Implementing automated data validation and quality monitoring to ensure accuracy, consistency, and reliability across datasets
- Supporting AI and ML teams by preparing clean, well-documented datasets and building reliable data interfaces for model development and evaluation workflows
- Maintaining data lineage and following data privacy, security, and governance best practices across the lakehouse
- Collaborating with applied AI, analytics, and product teams to understand data requirements and translate them into scalable engineering solutions
Benefits
- Flexible work hours
- Collaborate in a modern open plan workspace, with a gaming area, free snacks, drinks and regular social events.
- Focus on impactful work, solving complex, real challenges utilizing the latest technologies and protocols.
- Own my career path with our internal development framework.
- Learn new skills and earn certifications with access to unlimited courses in LinkedIn Learning.
- Comprehensive Health/Vision/Dental/Life Insurance
- 401k Retirement Savings Plan with a company match up to 4%
- HealthJoy, a healthcare concierge service
- Enhanced leave for expecting parents; 20 weeks 100% paid for primary leave, and 10 weeks 100% paid for secondary leave.
- Flexible time off policy
- Multiple company wellness days
- Free access to the Healthy Minds app for mindfulness, meditation and more.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
