Senior Data Engineer and Analytics Lead

OpenDataJobs

1d • $155,000 - $175,000 • Remote

About The Position

Peregrine Advisors is a rapidly growing AI and data innovation hub helping government solve hard problems and deliver better outcomes. We work across the full lifecycle—from strategy and governance through architecture, engineering, analytics, AI, visualization, and training—for clients including the SEC, PCAOB, DDOT, and DCAA. Peregrine is the first and only social enterprise organized as a Benefit Corporation and SBA 8(a) company focused on AI and data for government. We believe business success should create client value, social value, and opportunity for our people. As we enter our next stage of growth, we need dependable, motivated, and skilled people who have a combination of intellectual curiosity and intellectual courage. With new clients, larger programs, and expanding responsibilities, the people joining Peregrine now will have the opportunity to help shape the company we become. People first. Ownership always. We solve problems through people, process, and technology—in that order. Technology matters, but people make transformation happen. That principle defines our culture. Trust and motivation come before competence. We hire people we can trust, who care deeply about what they do, take ownership, learn quickly, help one another, and refuse to walk past a problem because it belongs to someone else. At Peregrine, you are not joining simply to fill a position. You are joining a team, taking ownership of a mission, and helping build a company. If that excites you, we should talk. At Peregrine Advisors, you will serve as our full-time technical continuity across three production data products for a federal agency. But we hire people, not seats. As the work evolves, you will learn new systems and tools, take on greater responsibility, and help develop the firm's capabilities, tools, and lines of business. We move our best to where the hardest problems are.

Requirements

• 8+ years in data engineering or analytics engineering
• At least three years with Azure Databricks or a comparable lakehouse platform
• Advanced Structured Query Language (SQL)
• Python or PySpark
• Delta Lake
• Extract, Transform, and Load (ETL) and Extract, Load, and Transform (ELT)
• Orchestration
• Schema design
• Data quality
• Performance tuning
• Hands-on experience with Data Vault 2.0
• Dimensional modeling
• Semantic models
• Production analytics
• Working familiarity with Unity Catalog
• Source control
• Automated deployment
• Environment promotion
• Continuous integration and continuous delivery (CI and CD)
• Ability to support Microsoft Power BI datasets and dashboards
• Ability to collaborate with machine learning engineers on feature pipelines and model deployment
• Strong technical writing skills
• Discipline to maintain diagrams, mappings, specifications, and runbooks as the build changes
• United States citizenship
• No dual citizenship where prohibited by the contract
• Ability to satisfy the required suitability, security, and access requirements

Nice To Haves

• Experience on a federal system accredited at Impact Level 5 (IL-5) or higher
• Databricks Data Engineer, Azure Data Engineer, or a relevant cloud certification
• ServiceNow data
• Federal audit data
• Government financial data
• Controlled federal environments
• Experience moving solutions between Azure environments using infrastructure as code and Databricks Asset Bundles

Responsibilities

• Build critical components, integrate partner work, own data quality, and ensure products are understandable and supportable after cutover.
• Develop reliable ingestion and transformation pipelines across legacy, current, and multi-format contractor submission systems, with traceable source-to-target mappings.
• Create Data Vault 2.0 and Gold tier models that support required analytics and can be queried independently by agency analysts.
• Implement documented deduplication, reconciliation, and data quality controls, including evidence for acceptance.
• Integrate semantic models, support Microsoft Power BI, optimize performance, and produce production-ready code.
• Perform technical review of partner work before it enters the Peregrine acceptance process.
• Create complete data dictionaries, pipeline specifications, runbooks, and knowledge transfer materials.
• Experiment, fail, learn, and repeat quickly.
• Own an outcome rather than being handed a task.
• Teach, document, and review without becoming a bottleneck.
• Be reliable in a partner-heavy team and own the seams between work packages.
• Be curious about audit and planning questions, not only platform mechanics.

Benefits

• Medical, dental, and vision with the employee premium fully paid and half of dependent premiums
• Employer-paid life, accidental death, and short-term and long-term disability insurance
• A 401(k) matched 100% up to 4% of salary, vesting immediately
• Unlimited paid time off
• Sponsored professional certifications and continuing education

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed