Staff Data Engineer - Craft Education

Western Governors University•Nashville, TN

About The Position

If you’re passionate about building a better future for individuals, communities, and our country—and you’re committed to working hard to play your part in building that future—consider Craft Education as the next step in your career. Craft Education is on a mission to solve skilled labor shortages by powering work-based learning pathways for all. At Craft, we’re revolutionizing the apprenticeship degree, combining on-the-job learning with accredited instruction to create innovative educational pathways that accommodate working professionals and meet employer needs. Our flagship product - Craft Connect - helps organizations administer apprentice degree programs and address mission-critical data and reporting needs. Through the same platform, Craft is also transforming how on-the-job learning converts into academic credits. Our team of technology, education and workforce professionals also provides technical assistance to organizations looking to launch and manage apprenticeship degree programs. We are working tirelessly to accelerate the expansion of these programs along with the data infrastructure that underpins them. If you’re looking to join the work-based learning revolution, we’d love to talk with you. At Craft, you’ll have the opportunity to solve hard problems in a high-growth startup environment and make a lasting impact on the future of education and workforce development. We couldn’t be more excited to advance this work as a team of innovative, collaborative and mission-oriented professionals - we hope you’ll consider joining us. The Staff Data Engineer for Craft Education will lead a team of Data Engineers to produce system architecture, data ingest/egress pipelines in support of customer and business intelligence analytics. You should be agnostic to tools and should be able to supervise, design, architect and code using tools like Apache Kafka, Airflow, or Spark and other cloud technologies. The core responsibility for this position includes supervision of data engineering technical aspects, design of data and system architecture for the Data Lake and data warehouse, supervision of the technical aspects of a data engineering team and projects encompassing dimensional and normalized data modeling. The Staff Data Engineer will improve technical standards in the environment ensuring optimal use of data warehouse and other data stores to solve business problems. They will serve as the lead engineer and go to person for all aspects of the data engineer team including solution architecture of data systems.

Requirements

Solid design skills for creating non-competing processes for data transfer between OLTP and OLAP sources/sinks
Expertise with analytical reporting tools, preferably Metabase
Mastery in code based ETL/ ELT tools for importing and exporting data across disparate systems.
Expertise in analytic skills related to working with unstructured datasets.
Use of industry best practices for code development, testing, implementation and documentation.
Ability to evaluate and prioritize work based on the organization’s needs.
Ability to supervise cross team projects to accomplish data integrations and pipelines.
Supervisory abilities for data engineering team with respect to technical design and architecture.
Excellent verbal & written communication, along with technical documentation
Ability to work and deliver in a team environment
Ability to manage the use of tools like Jira, Confluence, GitHub
Architect and Develop processes for audit of Data Integrity
Ability to mentor Associate/Senior/Data Engineer in data pipeline architecture and coding standards
Supervise Validation and testing to analyze and debug issues
Mastery of AWS cloud technologies and REST APIs
Mastery of relational SQL and NoSQL databases
Mastery with object-oriented/object function scripting languages: Python, Java, Scala
Mastery of big data tools: Hadoop, Spark, Kafka, Databricks, etc.
M. S. in Business, Management Information Systems, Computer Science, or a related field, or an equivalent combination of experience and training.
Six or more years of experience as a Data Engineer, Data Integration, Big Data, or Business Intelligence, Software Engineer
Prior experience acting as a Team Lead, where you run the team from a technical perspective, creating ownership and accountability for high performance delivery.
The individual is acknowledged within the group as a subject matter expert.
Typically requires a University Degree or equivalent experience.

Nice To Haves

Strong experience with early stage companies distance education and distance learning students is preferred.
6 years of prior relevant experience.

Responsibilities

Supervise work on cloud technologies and architect scalable and performant Data Warehouse/Lake systems
Establish design and methodology for database build processes.
Supervise the architecture and design of complete data model solutions.
Supervise necessary data protection and security processes.
Create and design extract processes for data access layer.
Translate business problems/information requirements accurately to logical/physical data models aligning with customers’ data architecture standards.
Supervise and perform research and analysis to find solutions for complex business problems.
Monitor job performance and fine tune Spark SQL queries as appropriate on a regular basis.
Supervise the profiling of data, the publishing of data profiles and corrective actions if required to ensure data quality.
Supervise and perform documentation / reverse engineering / analysis of data mapping using data integration code/tools.
Work with APIs for data wrangling and integrations with other systems data in the EDW.
Perform impact analysis using Data Integration/Data Virtualization tool repositories, DB data dictionary, UNIX scripts and frontend code on versioning systems.
Analyze / research data on multiple platforms as wells as multiple heterogeneous databases including custom developed databases.
Positively impact projects by completing tasks assigned on time.
Communicate technical and domain knowledge as it relates to work, to both technical and non-technical audiences.
Ingest and transform structured, semi-structured, and unstructured data from sources including relational databases, NoSQL, external APIs, JSON, XML, delimited files, and more.
Support business and functional requirements and translate these requirements into robust, scalable, solutions.
Collaborate with engineers to help adopt best practices in data system creation, data integrity, test design, analysis, validation, and documentation.
Help continually improve ongoing reporting and analysis processes, automate, or simplify self-service modelling and production support for customers.
Performs other related duties as assigned.

Benefits

bonuses
medical, dental, vision, telehealth and mental healthcare
health savings account and flexible spending account
basic and voluntary life insurance
disability coverage
accident, critical illness and hospital indemnity supplemental coverages
legal and identity theft coverage
retirement savings plan
wellbeing program
discounted WGU tuition
flexible paid time off for rest and relaxation with no need for accrual, flexible paid sick time with no need for accrual, 11 paid holidays, and other paid leaves, including up to 12 weeks of parental leave