Senior Algorithm Developer - PySpark / SQL

ACA Group • Durham, NC

2d

About The Position

ACA Global delivers market abuse surveillance solutions to institutional investors, hedge funds, and asset managers. The Market Abuse Surveillance (MAS) platform monitors trading activity across equities, fixed income, and derivatives to identify potential regulatory and policy violations. This role sits on the Market Abuse Surveillance Product Development team and focuses on validating, optimizing, and advancing a PySpark‑based surveillance platform. Following a multi‑year algorithm migration initiative, the emphasis is now on production quality, performance optimization, and next‑generation algorithm development. The position blends deep PySpark/Python and SQL expertise with financial markets and regulatory domain knowledge.

Requirements

• 3+ years of hands‑on PySpark/Python development in production environments
• Strong Spark expertise (DataFrames, SQL functions, windowing, joins, optimization, execution plans)
• 5+ years of advanced SQL experience (CTEs, window functions, performance tuning, stored procedures)
• Experience operating within the Spark ecosystem (EMR, Iceberg, Spark UI)
• Strong AWS experience (S3, EMR, IAM, CloudWatch, cost optimization)
• Familiar with CI/CD, Git workflows, JIRA, automated testing, and code review practices
• 5+ years total software development experience, including large‑scale data processing systems
• Proven track record delivering production‑ready data or algorithmic platforms
• Strong validation, testing, and reconciliation experience across complex data systems
• Experience working in agile teams with cross‑functional stakeholders (QA, DevOps, Product)

Nice To Haves

• Financial instruments: equities, fixed income, and derivatives
• Trade lifecycle and portfolio concepts
• Market abuse and regulatory surveillance (KYC/AML, best execution, fair dealing)
• Institutional trading behavior and surveillance patterns
• Background in fintech, RegTech, or financial services strongly preferred

Responsibilities

• Validate and QA migrated surveillance algorithms by reconciling PySpark outputs against legacy SQL baselines across multiple client environments
• Optimize PySpark algorithms and Spark infrastructure to meet processing SLAs across large data volumes
• Enhance and develop new surveillance algorithms aligned to evolving regulatory and client requirements
• Support legacy SQL systems during transition and ensure data integrity and auditability

What This Job Offers

• Career Level: Senior
• Education Level: No Education Listed