Senior Specialist, Intelligence Platform Databricks Engineer
Nasdaq•Atlanta, GA
•$111,000 - $194,000•Hybrid
About The Position
As a Senior Specialist, Intelligence Platform Engineer reporting to the AVP of Enterprise Architecture, you'll play a critical role in administering, governing, and scaling Nasdaq's centralized Databricks Lakehouse environment — the CAP Intelligence Platform — which serves multiple business units across the Capital Access Platforms organization. You'll thrive in this position if you're detail-oriented, technically strong, and energized by building platforms that bring data governance, compliance, and operational efficiency together at scale.
Requirements
- Bachelor's degree in Computer Science, Information Systems, or a related field, or equivalent practical experience.
- 5+ years of experience in data platform administration, cloud infrastructure, or a comparable technical discipline.
- Hands-on experience administering Databricks at scale, including Unity Catalog, workspace configuration, and compute management.
- Proven ability to deliver governance frameworks, compliance reporting, and cost management in a complex, regulated environment.
- Strong communicator who works effectively across technical and business teams in matrixed, cross-functional environments.
Nice To Haves
- Databricks Certified Professional certification or equivalent cloud certifications (e.g., AWS).
- Experience in financial services, fintech, or regulated industries, including familiarity with compliance requirements such as Reg SCI.
- Background in FinOps principles, identity lifecycle management, or large-scale platform rollouts.
Responsibilities
- Administer and support a multi-workspace Databricks environment, including Unity Catalog governance, service principal management, and enterprise integrations, ensuring platform reliability and operational standards across all business units.
- Own platform-wide governance by monitoring compliance with catalog structure, metadata standards, naming conventions, and tagging requirements — producing scorecards, audit reports, and driving remediation where needed.
- Deliver monthly cost and usage reporting across workspaces, compute clusters, serverless workloads, and storage resources, identifying optimization opportunities and providing business unit-level consumption transparency.
- Partner with workspace administrators and data stewards across six business units to enable self-service administration, develop operational documentation, and serve as the escalation point for complex platform issues.
- Support Infrastructure-as-Code implementations using Terraform to automate provisioning, governance validation, and reporting — contributing to a scalable, efficient platform.
Benefits
- 401(k) program with 6% employer match
- Employee Stock Purchase Program with 15% discount
- Student loan repayment program up to $10k
- Company paid life and disability plans
- Generous paid time off
- Comprehensive medical, dental and vision coverage
- Health spending account with employer contribution
- Paid flex days to support mental wellbeing
- Gym membership discounts
- Hybrid home/office schedule (for most positions)
- Paid parental leave
- Fertility benefits
- Paid bereavement leave
- Company gift matching program
- Employee resource groups
- Paid volunteer days
- Education Assistance Program
- Robust job skills training and Professional development opportunities
- Generous annual bonus/commission (short-term incentive)
- Equity (long-term incentive)
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Upload and Match Resume
What This Job Offers
Job Type
Full-time
Career Level
Senior
