Senior Software Engineer, Backend Services

University of Chicago•Chicago, IL

1d•Remote

About The Position

As a senior member of the Globus product team, you will design and deliver new capabilities in Globus data management platform, with focus on the data automation services. Delivered as a hosted service (SaaS) and platform (PaaS), Globus’ secure data management platform is used by researchers worldwide. This role is a great opportunity to work on innovative solutions to data management and task automation at scale that directly influence and accelerate research in various domains. As a senior member of our team, the Senior Software Engineer, Backend Services will work in both collaborative and independent capacities on complex issues and projects, in some cases making progress under minimal guidance. We are looking for skilled Python engineers with experience building scalable systems to join the development team to expand the services delivered. In this role, you will architect new features, develop high-quality software and operate services with high-availability. If you enjoy collaborative, innovative, mission-driven environments, Globus could be a great fit for you!

Requirements

Minimum requirements include a college or university degree in related field.
Minimum requirements include knowledge and skills developed through 5-7 years of work experience in a related job discipline.
Professional experience in software engineering and delivering large scale systems.
5+ years of relevant programming experience developing, implementing, debugging, and maintaining applications with Python.
Managing pipelines that process and transform large-scale datasets (terabyte-scale, billion+ records), including, building and maintaining data warehouses and data marts.
Developing, implementing, debugging, and maintaining applications with Python.
Generalized architecture patterns and service oriented architecture.
Python web frameworks such as FastAPI or Flask.
Unit testing and continuous integration tools, such as pytest, GitHub Actions and shell scripting, especially bash.
SQL databases, including PostgreSQL, SQLite.
Implementation of RESTful API services.
Development, deployment and operation of SaaS and PaaS systems.
Amazon Web Services, including IAM, boto3, S3, ECS, Cloud Formation, Step Functions, and Lambda.
Work with containers, such as Docker, and ECS.
Hands-on with modern data stack tooling, including PySpark, Iceberg/Delta Lake, Parquet, S3 Tables, Firehose, Kafka/Kinesis, or similar programs.
Elasticsearch/OpenSearch, including cluster management, text analysis pipelines, relevance tuning, and ranking strategies.
Integrating with large-scale, high-performance filesystems, such as Lustre, GPFS, and VAST.
Linux system programming, process execution and management.
Web security technologies, such as OAuth2, SAML, OpenID Connect and PKI.
Excellent verbal and written communication skills.
Strong analytical and problem solving skills.
Excellent organizational skills and constant attention to detail.
Work both independently and as a team member.
Receptive to feedback; willing to learn and embrace continuous improvement.
Mastery of fundamental concepts, practices, and procedures of software development.
Confidentiality related to sensitive University matters such as strategic initiatives, trade secrets, quiet periods, and scientific discoveries yet to be put in the public domain.

Responsibilities

Architecture and Design - leads the definition and documentation of requirements, architecture and design of secure, scalable, asynchronous, data access services, based on deep knowledge of principles of API design, asynchronous processes, data engineering, service deployment, and delivery of services with high availability.
Software Development - develops, tests, documents, deploys and maintains high-quality software on a cloud-based platform, including REST interfaces, command-line interfaces, socket-based services, and data processing pipelines; works with other service and client development teams to integrate and design cross-service features. Leads code and design reviews, and mentors other junior engineers to ensure high quality service delivery.
Support and Documentation - works in close collaboration with the Globus front line support and professional services teams, and directly with end users, to provide technical support services; sometimes serving as the point of escalation for complex issues; responsible for ensuring standard operating procedures and protocols are maintained and documented.
Team Coordination and Professional Development - maintains a working knowledge of relevant software technologies being developed and/or used in scientific and commercial communities; contributes to team coordination and development activities, including project planning, project reporting, and recruitment. Designs new systems, features, and tools. Solves complex problems and identifies opportunities for technical improvement and performance optimization. Reviews and tests code to ensure appropriate standards are met. Utilizes technical knowledge of existing and emerging technologies, including public cloud offerings from Amazon Web Services, Microsoft Azure, and Google Cloud. Performs other related work as needed.