Data Engineering Team Lead

Steampunk • McLean, VA

2d • $130,000 - $160,000

About The Position

We are looking for a seasoned Data Engineering Team Lead to work with our team and our clients to develop enterprise grade data platforms, services, and pipelines. We are looking for more than just a "Data Engineering Team Lead", but a technologist with excellent communication and customer service skills and a passion for data, problem solving, and mentorship. You will contribute to the growth of our AI & Data Exploitation Practice!

Requirements

• Ability to hold a position of public trust with the US government.
• Master's degree in IT-related field and 12+ years of experience
• 8+ years industry experience coding commercial software and a passion for solving complex problems.
• 8+ years direct experience in Data Engineering with experience in tools such as: Big data tools: Hadoop, Spark, Kafka, etc.
• Relational SQL and NoSQL databases, including Postgres and Cassandra.
• Data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
• AWS cloud services: EC2, EMR, RDS, Redshift (or Azure equivalents)
• Data streaming systems: Storm, Spark-Streaming, etc.
• Search tools: Solr, Lucene, Elasticsearch
• Object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.
• Advanced working SQL knowledge and experience working with relational databases, query authoring and optimization (SQL) as well as working familiarity with a variety of databases.
• Experience with message queuing, stream processing, and highly scalable ‘big data’ data stores.
• Experience manipulating, processing, and extracting value from large, disconnected datasets.
• Experience manipulating structured and unstructured data for analysis
• Experience constructing complex queries to analyze results using databases or in a data processing development environment
• Experience with data modeling tools and process
• Experience architecting data systems (transactional and warehouses)
• Experience aggregating results and/or compiling information for reporting from multiple datasets
• Experience working in an Agile environment
• Experience working with Junior Data Engineers and providing mentorship / coaching
• Experience supporting project teams of developers and data scientists who build web-based interfaces, dashboards, reports, and analytics/machine learning models
• Must hold a relevant certification
• Must possess an active USDA suitability determination

Responsibilities

• Lead, mentor, and provide technical oversight for a team of data engineers, ensuring successful delivery of complex data environment migrations with optimal performance and reliability.
• Oversee and guide the assessment, design, and optimization of ETL processes, workflows, business intelligence tools, and reporting solutions.
• Act as the primary technical liaison for addressing strategic inquiries related to data product customization, integration strategies, enterprise architecture alignment, and overall functionality.
• Define best practices and technical standards for cloud-based database and data warehousing solutions leveraging platforms such as AWS, Azure, or GCP.
• Set technical direction, conducting code reviews and coaching team members in key technologies including Python and AWS services.
• Facilitate Agile methodologies and development practices across the data engineering team, coordinating sprints, backlog grooming, and iterative delivery cycles.

Benefits

• As an employee owned company, we focus on investing in our employees to enable them to do the greatest work of their careers – and rewarding them for outstanding contributions to our growth.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior