Senior Data Engineer

MarketAxess•New York, NY

19d•Hybrid

About The Position

We are seeking a hands-on Senior Data Engineer to join our Data and Analytics Platform team, driving the strategy, design and implementation of our next-generation cloud-based Data Fabric and Data Mesh platform (Data Platform 2.0). This is a deeply technical role for a builder who enjoys writing high-quality code, designing scalable systems, and working directly with engineering teams to implement complex, real-time data solutions. You’ll be equally comfortable sketching out an event-driven architecture for a business unit, contributing code to shared data infrastructure, and guiding implementation across multiple domains. This role is pivotal to enabling teams to create scalable, data-driven products and underpinning our enterprise-wide data strategy.

Requirements

9+ years of progressive software/data engineering experience with high proficiency in two of the following: Spark, Python, and/or Java
Experience in cloud computing (e.g. applications, infrastructure, storage, data and platforms)
Designing and building complex, highly scalable, reliable data pipelines, using the Big Data ecosystem (Spark Data Analytics, Iceberg, Glue Catalog, Kafka or equivalents)
Cloud native application and cloud services architecture on AWS (MSK - Kafka, Flink, Bedrock, Lambdas, Spark/EMR)
API and microservices architecture
Streaming and event processing architectures and platforms (e.g., Kafka, FlinkSQL, Python) . Including topic design, provisioning and config.
Structured and unstructured databases and usage patterns
High-speed, high-volume, high-frequency transaction processing systems
Real-time logging, monitoring and resiliency approaches
Process automation approaches and tooling (e.g., DevOps, GitOps and AIOps)
UNIX/Linux OS and scripting skills.
Infrastructure as code technologies, such as Terraform, Helm Charts and CloudFormation
Databases, both SQL and NoSQL (Redis, Oracle, DuckDb, OpenSearch, Mongo, etc)
Craftsman-like approach to building software; takes pride in engineering excellence and instils these values within the team and others
A proponent of strong collaborative software engineering techniques and methods: agile development, continuous integration, code review or pairing, unit testing, refactoring and related approaches
Excellent problem-solving and critical-thinking skills; demonstrated ability to employ fact-based decision-making to resolve complex problems, by applying logic analysis, experience and business knowledge
Proven ability to build and maintain effective, trusting partnerships with product managers, architects and technical leads for individual products and applications
Ability to leverage GenAI tools (e.g., GitHub Copilot or equivalent) to accelerate development and improve code quality.
Skill in applying AI-driven practices such as prompt engineering and AI-assisted code reviews to boost productivity and reduce delivery time while mitigating risks.

Nice To Haves

E-trading and financial services industry experience is a plus
Knowledge in Docker, Kubernetes is a plus

Responsibilities

Collaborate with Product Managers, Data Scientists, Engineers and analysts on critical initiatives to build and distribute revenue producing data products
Architect, design, build and implement and support data pipelines and products to support Agentic Al, Streaming SQL, ML and analytical use cases
Lead the architecture, implementation, and operations of platforms and tools for securing, processing, and querying data at scale
Provide the leadership and research of new technologies within the team
Collaborate with and across Agile teams to design, develop, test and implement data and analytics solutions
Design, build, and scale infrastructure in Cloud (e.g., AWS, Iceberg, Bedrock) and analytics applications using big data and machine learning technologies
Participate in setting the standards for cloud-based initiatives
Architect and develop end to end scalable data applications and data pipelines

Benefits

Hybrid Environment: Our employees enjoy a mix of working in the office and from home
Free Food: We provide free lunch for employees when they are working in the office. Plus, our offices are stocked with snacks
Paid Time Off: Competitive PTO package including vacation and personal days, sick leave and charity days
Generous Parental Leave: Up to 20 weeks fully paid leave
401(k): Dollar-for-dollar employer match up to $17,500
Employee Stock Purchase Plan: Employees can purchase MarketAxess common stock at a discount
Wellness Stipend: We provide employees with up to $1K annually towards gym memberships, home office equipment and more
Onsite Healthcare: We offer convenient access to world-class care through Mount Sinai at our Hudson Yards location
Tuition Assistance and Professional Development: Benefit from live and on-demand learning, role-specific training, employee-led Lunch and Learns and guest speakers
Core benefits: Highly competitive medical, dental, and vision programs