Senior Data Engineer
About The Position
What is the opportunity? Compliance is a team within Global Functions Technology that deals with trading and employee surveillance, privacy, and risk governance. This position is within the Compliance Technology area of GFT. This role will focus on building high-performance big data applications and analytics platforms. What will you do? Develop expertise in the trade surveillance data infrastructure and application portfolio Design and implement scalable data pipelines, ETL processes, and data integration solutions Build and optimize data models and database schemas to support business analytics and reporting needs Collaborate with cross-functional teams to gather requirements and translate them into technical data solutions Implement data quality frameworks and monitoring to ensure data accuracy and reliability Provide technical guidance on data architecture, best practices, and emerging technologies Support production data systems and troubleshoot data-related issues Document data processes, pipelines, and system architecture
Requirements
- 5+ years of hands-on development experience with big data technologies, specifically Spark, Scala, and distributed computing frameworks
- Strong programming skills in Scala and Python with experience building production-grade applications
- Proven experience working with big data platforms such as Databricks, Snowflake, or Hadoop ecosystem
- Knowledge of streaming technologies (Kafka, Spark Streaming) and event-driven architectures
- Familiarity with AI-assisted development workflows, including prompt engineering for code generation and the ability to critically evaluate AI-generated code for correctness and security
- Solid understanding of data structures, algorithms, and performance optimization for large-scale data processing
- Experience with version control, testing frameworks, and CI/CD practices in a collaborative development environment
Nice To Haves
- Experience with kdb+ or time-series databases for financial data
- Familiarity with containerization and cloud-native development (Docker, Kubernetes)
- Capital Markets/Wealth management and/or regulatory/compliance domain knowledge
Responsibilities
- Develop expertise in the trade surveillance data infrastructure and application portfolio
- Design and implement scalable data pipelines, ETL processes, and data integration solutions
- Build and optimize data models and database schemas to support business analytics and reporting needs
- Collaborate with cross-functional teams to gather requirements and translate them into technical data solutions
- Implement data quality frameworks and monitoring to ensure data accuracy and reliability
- Provide technical guidance on data architecture, best practices, and emerging technologies
- Support production data systems and troubleshoot data-related issues
- Document data processes, pipelines, and system architecture
Benefits
- We thrive on the challenge to be our best, progressive thinking to keep growing, and working together to deliver trusted advice to help our clients thrive and communities prosper.
- We care about each other, reaching our potential, making a difference to our communities, and achieving success that is mutual.
- A comprehensive Total Rewards Program including bonuses and flexible benefits, competitive compensation, commissions, and stock where applicable
- Leaders who support your development through coaching and managing opportunities
- Ability to make a difference and lasting impact
- Work in a dynamic, collaborative, progressive, and high-performing team
- A world-class training program in financial services
- Flexible work/life balance options
- Opportunities to do challenging work
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Education Level
No Education Listed
Number of Employees
5,001-10,000 employees
