Data Infrastructure Team Lead
Melio
·
Posted:
March 19, 2023
·
Remote
About the position
We are seeking an experienced and skilled Team Lead to manage our Data Infrastructure team. The ideal candidate will have a strong background in data and backend engineering, along with extensive experience in recruiting, managing, and mentoring a team of data professionals. The mission of the data infrastructure team is to ensure the company can manage data at scale efficiently and seamlessly through robust and reliable data infrastructure. The successful candidate will be responsible for designing and implementing data pipelines, data warehousing, and data architecture to support our business needs, ensuring that our data systems are compliant with regulatory requirements and industry best practices, and collaborating with other teams to integrate data and machine learning models into our products and services.
Responsibilities
- Manage a team of data and backend engineers, including recruiting, mentoring, and performance management.
- Design and implement data pipelines, data warehousing, and data architecture to support our business needs.
- Ensure that our data systems are compliant with regulatory requirements and industry best practices.
- Collaborate with other teams to integrate data and machine learning models into our products and services.
- Collaborate with stakeholders across the company to understand data requirements and ensure that our data infrastructure supports business goals.
- Stay up to date with industry trends and emerging technologies in data engineering, and make recommendations for improvements to our data infrastructure.
Requirements
- 6+ years of experience in data and backend engineering, with at least 2 years in a leadership role.
- Strong knowledge of data architecture, data schematizing and ETL processes.
- Experience with cloud-based data infrastructure, such as AWS, GCP or Azure.
- Experience with SQL and NoSQL databases.
- Experience with Data Warehouse technologies such as Snowflake and BigQuery.
- Experience working with Python.
- Excellent communication and collaboration skills.
- Experience working with Typescript (preferred).
- Experience administering and managing Apache Spark clusters (preferred).
- Experience working with serverless products such as AWS Lambda (preferred).
- Experience with streaming technologies such as Apache Kafka and Amazon Kinesis (preferred).
- Experience building infrastructure for Machine Learning (preferred).