Senior Director, Data Engineering

HG Insights

10h•Remote

About The Position

Headquartered in beautiful Santa Barbara, HG Insights is the global leader in technology intelligence. HG Insights uses advanced data science methodologies to help the world’s largest technology firms and the fastest-growing companies accelerate their sales, marketing, and strategy efforts. We offer a competitive salary, 401K, growth potential, stock options, great benefits, and a casual yet professional environment. We are passionate about our jobs with a get-it-done attitude, yet we don’t take ourselves too seriously. As the Director of Data Engineering, you will lead a high-performing team responsible for designing, building, and managing the data infrastructure and pipelines that drive HG Insights’ data products and services. You will define the strategic direction of the Data Engineering function, collaborate with cross-functional teams, and ensure the scalability, efficiency, and reliability of our data systems. Your role will be pivotal in ensuring the success of our data-driven initiatives.

Requirements

BS or MS in Computer Science, Data Engineering, or a related field.
10+ years of experience in data engineering, with at least 5 years in a leadership role.
Proven track record of designing and managing large-scale, distributed data systems.
Deep expertise in data engineering technologies such as Hadoop, Spark, Kafka, and cloud platforms (AWS, Azure, GCP).
Strong knowledge of database systems (SQL and NoSQL) and ETL processes.
Excellent leadership and communication skills, with the ability to influence across all levels of the organization.
Experience with data governance, compliance, and best practices.
A passion for building scalable, efficient, and innovative data systems.

Responsibilities

Strategic Leadership
Define and execute the strategic roadmap for the Data Engineering team.
Align the data infrastructure and processes with the company’s business objectives and growth strategy.
Team Leadership and Development
Lead, mentor, and grow a team of skilled data engineers, fostering a culture of collaboration, innovation, and excellence.
Attract and retain top talent to build a world-class Data Engineering organization.
Data Infrastructure Management
Oversee the development and optimization of scalable, reliable, and efficient data pipelines and platforms.
Ensure data systems are designed for high availability, security, and performance.
Collaboration and Stakeholder Management
Partner with Product, Data Science, Engineering, and Business teams to understand their data needs and deliver solutions that meet those needs.
Act as a key liaison between technical teams and business stakeholders, ensuring alignment and transparency.
Innovation and Continuous Improvement
Stay abreast of emerging technologies and industry best practices in data engineering.
Drive the adoption of new tools, technologies, and methodologies to enhance the team’s efficiency and effectiveness.
Operational Excellence
Define and enforce standards, processes, and best practices for data engineering.
Monitor and optimize the performance of data systems to ensure they meet SLAs and business requirements.
Data Governance and Compliance
Ensure that all data systems and processes comply with relevant regulations and standards.
Implement robust data governance practices to maintain data quality and integrity.