We’re looking for a high-performing associate software engineer to join the engineering team of Man Group’s central data platform, named Codex. Projects don’t get much more cross-cutting or high-profile than this: we have hundreds of internal users and whatever you work on will be used by teams across the business for years to come. Fundamentally, we are not a data engineering team: we empower our userbase to become data engineers with our software. This is a great time to join the team as we consider how to expand our offering to the entire business with some true greenfield projects. There are three main pillars of the Codex platform: Data Acquisition - an ETL/ELT platform for research and production which scales to multi-terabyte datasets; and can index all data at Man for re-usability and discoverability. Data Governance - cataloguing the thousands of datasets at Man; allowing discovery, entitlements, data quality, and end-to-end data lineage. Data Delivery - providing a unified interface across the thousands of datasets across Man with a focus on scaling, identifier mapping, and UX. Our systems are almost all running on Linux and most of our code is in Python, with the full scientific stack: numpy, scipy, pandas to name a few of the libraries we use extensively. We implement the systems that require the highest data throughput in Java. Within Data Engineering we use Pandas, Dataiku, Snowflake, Prometheus, and ArcticDB heavily. We use Kafka for data pipelines, Python and Spark for ETL, Bitbucket for source control, Jenkins for continuous integration, Grafana + Prometheus for metrics collection, ELK for log shipping and monitoring, Docker for containerisation, Kubernetes for container orchestration, OpenStack for our private cloud, Ansible for architecture automation, and Slack for internal communication. Our technology list is never static: we constantly evaluate new tools and libraries.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Job Type
Full-time
Career Level
Entry Level