Lead Data Engineer

FlightSafety International • Columbus, OH

1d

About The Position

FlightSafety International is hiring a Lead Data Engineer to provide technical leadership and direction for developing and maintaining enterprise analytics deliverables, including operational data stores, data integrations, and reports. The role guides a team in a mixed-technology environment to deliver data products that support decisions for the business and its customers. It collaborates with technical and business resources within and outside the IT organization.

This highly technical leadership role oversees data engineering components that support business objectives. The Lead Data Engineer sets technical direction and engineering standards, mentors engineers, partners with stakeholders on enterprise data warehouse design, and oversees the development, testing, deployment, and support of data engineering solutions. The role also monitors jobs and platform performance, troubleshoots data and process issues, and helps developers and users understand data flows and application data.

Requirements

• Bachelor’s degree from an accredited institution or equivalent industry experience; the posting also specifies a bachelor’s degree in a related field, preferably computer science.
• 10 or more years of software development experience.
• 5 or more years of enterprise ETL, analytics, and reporting development experience with SSIS, SSAS, and SSRS.
• 2 or more years of Databricks experience, with expert-level proficiency in DLT and Unity Catalog.
• 2 or more years of Python development experience.
• 5 or more years of RDBMS design and development experience, including mastery of logical and physical database design for transactional systems and data warehouses, and data normalization concepts.
• 5 or more years of expert SQL abilities and hands-on development with T-SQL, UDFs, UDAFs, views, triggers, and stored procedures, along with experience using relevant tools and platforms and troubleshooting.
• 3 or more years of Azure experience using ADLS, Azure Data Factory, and automation.
• Demonstrated experience building and maintaining data products.
• Experience with Visual Studio and DevOps platforms for code management and deployment using CI/CD techniques.
• Familiarity with SDLC, Agile methodologies, and tools such as TFS, Git, or Scrum.
• Experience communicating with users, technical teams, and management to gather requirements, identify tasks, provide estimates, and meet production deadlines.
• Experience with professional software engineering best practices across the software development life cycle, including coding standards, code reviews, source control, build processes, testing, and operations.
• Experience designing and building BI reporting solutions.
• Experience with Apache Spark and PySpark.
• Experience building Python data engineering platforms for data science or analytics groups.
• Strong leadership and mentoring skills.
• Proactive, self-starting approach, strong work ethic, accountability, and responsibility for the accuracy and completeness of assigned work and results.
• Excellent communication and customer service skills.
• Ability to work individually and as part of a team to achieve shared goals.
• Ability to manage time and prioritize workload amid competing or changing priorities.

Nice To Haves

• Databricks certification is preferred.
• Data Vault 2.0 warehouse modeling experience; certification is preferred.
• Power BI experience for BI reporting solutions is preferred.
• Knowledge or experience in the education or aviation industry.
• Experience with NoSQL.
• Experience consuming data from streaming platforms such as Kafka.
• Knowledge of system and networking fundamentals.
• Exposure to AI concepts, tools, and frameworks, preferably using Databricks.

Responsibilities

• Provide technical direction and oversight to a team of data engineers and developers.
• Establish standards for data engineering practices, code quality, and documentation.
• Mentor and coach junior and mid-level engineers and promote skills development and knowledge sharing.
• Lead code and design reviews to ensure adherence to established standards.
• Partner with business stakeholders, business analysts, data engineers, and developers to design enterprise data warehouse components.
• Provide project estimates, schedules, and timely updates to project managers and senior management.
• Analyze systems and recommend policy and procedure changes to improve operations.
• Oversee and validate designs for accuracy and completeness against business use cases.
• Lead development of data integration and transformation solutions to meet model input needs.
• Guide development and support of batch jobs.
• Perform unit and regression testing and conduct code and peer reviews.
• Collaborate with development and quality assurance teams on testing and product quality improvements.
• Produce deployment scripts, checklists, playbooks, and operations runbooks in accordance with SDLC and change-management requirements.
• Oversee deployment of database and data engineering components to higher environments, using CI/CD automation where applicable.
• Help ensure adherence to committed service-level agreements.
• Monitor scheduled jobs and platform performance for smooth operations.
• Troubleshoot and fix data or process issues independently and with other developers.
• Serve as a techno-functional expert and help developers and users understand data flows and application data.
• Take projects from requirements scoping through launch, communicate with users and technical teams, estimate work, and meet production deadlines.
• Comply with applicable laws, regulations, and company policies.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior