Senior Software Engineer - Data Platform

NASDAQ Omx Group, Inc.Atlanta, GA
50dHybrid

About The Position

Nasdaq's Data Platform turns messy, multi‑modal content into trusted, governed data that powers decisions and AI experiences across the company. As a Software Engineer, you'll design and scale workflows that acquire content from heterogeneous sources, extract structured knowledge, and assemble golden records with full lineage and governance. You'll build multi‑agent workflows and digital workers that automate onboarding, transformation, and quality checks-so the right data is accurate, explainable, and on time. You'll join a tight‑knit engineering group where you own meaningful slices of the platform, collaborate closely with product and data partners, and see your work land in production.

Requirements

  • 3+ years in software/data engineering (or equivalent), with production experience building and operating data pipelines or AI‑enabled data services.
  • Proficiency in Python and SQL; working comfort with Bash and Linux tooling.
  • Demonstrated ability in containerization (Docker), Git CICD pipelines, and AWS services (S3, EC2, ECS, EKS).
  • Hands‑on with at least one of: Spark/Databricks (or similar distributed compute), orchestration, Kafka (or event/stream tech).
  • Ability to write clear design docs, run experiments, interpret metrics, and make trade‑offs (speed vs. reliability vs. cost).

Nice To Haves

  • Experience building agentic and multi‑agent workflows (tool routing, skill specialization, evaluation/guardrails).
  • Familiarity with LLM‑powered enrichment (prompting, RAG, embeddings), vector stores, and quality evaluation for extraction/matching.
  • Exposure to Databricks, Delta/Unity Catalog, data lineage, and data governance.

Responsibilities

  • Acquire - Design and implement pluggable connectors (APIs, S3/Blob, SFTP, HTTP, message buses). Ship auth, throttling/backoff, CDC, idempotent loaders, and safe backfills with dashboards and alerts.
  • Extract - Build layout‑aware parsing for PDFs/HTML/DOCX/Images with OCR; segment content for RAG and entity matching; enrich topics, language, and license flags with measurable precision/recall.
  • Match - Implement and evaluate entity‑resolution pipelines (Siamese/bi‑encoders + rules); define blocking keys; add transparent match explanations for stewards and audit.
  • Map - Contribute to an LLM‑assisted "suggest → approve → apply" field‑mapping flow; run change‑impact checks; extend transformation libraries (dates, currencies, code mappings) with tests and versioning.
  • Master - Assemble golden records with survivorship rules; maintain SCD2 history; enforce constraints, anomaly detection, and freshness SLOs.

Benefits

  • 401(k) program with 6% employer match
  • Employee Stock Purchase Program with 15% discount
  • Student loan repayment program up to $10k
  • Company paid life and disability plans
  • Generous paid time off
  • Comprehensive medical, dental and vision coverage
  • Health spending account with employer contribution
  • Paid flex days to support mental wellbeing
  • Gym membership discounts
  • Hybrid home/office schedule (for most positions)
  • Paid parental leave
  • Fertility benefits
  • Paid bereavement leave
  • Company gift matching program
  • Employee resource groups
  • Paid volunteer days
  • Education Assistance Program
  • Robust job skills training and Professional development opportunities

Stand Out From the Crowd

Upload your resume and get instant feedback on how well it matches this job.

Upload and Match Resume

What This Job Offers

Job Type

Full-time

Career Level

Mid Level

Industry

Securities, Commodity Contracts, and Other Financial Investments and Related Activities

Education Level

No Education Listed

Number of Employees

1,001-5,000 employees

© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service