Data Architect

Halvik•Arlington, VA

19d•Hybrid

About The Position

Halvik Corp is seeking an experienced Tech Lead - Principal Solutions Architect to serve as the primary data warehouse architect for a data services/visualization platform for a federal agency. This role involves leading the design of data lakes, data warehouses, and visualization services, and collaborating with data/cloud engineers to design data pipelines for ingesting, cleaning, and transforming both batch and streaming data within an AWS environment. The architect will be responsible for the logical and physical modeling of data warehouses, data lakes, and datamarts, gathering requirements from various stakeholders, optimizing data warehouse performance, managing change control processes for data models, and designing a metadata repository for enterprise-wide data discovery and cataloging services.

Requirements

Data Warehousing/Data Architect Experience (10+ years)
Architecting a data lake and/or data warehouse model including defining the use of standard conventions using cloud components (AWS S3, Databricks, Palantir Foundry, AWS Redshift, AWS Aurora Postgres)
Creating logical and physical data models for data repositories containing a number of heterogenous sources
Optimizing data warehouses for high performance for varying types of use cases (high frequency loads, large loads, high frequency queries)
Implementing various archiving and partitioning approaches to optimize data ingestion, data storage costs and meet data retention requirements
Designing strategies for handling slowly changing dimensions
Bachelor's degree in Computer Science, Information Systems, Software Engineering, or related field
8+ years of experience

Nice To Haves

Ability to communicate effectively with senior leadership including translating complex technical concepts into specific and understandable technology recommendations
Experience working in a Palantir Foundry environment including use of Code Repositories, Ontology, and visualization tools like Contour, Quiver and Workshop
Use of integrating visualization tools, such as Tableau, Qlik, Socrata, with data lakes and data warehouses (2+ years)
Data Cataloging Experience (2+ years)
Architecting a data cataloging strategy for a myriad of data sources pulled into a data lake and warehouse
Implementing a data catalogue on a cloud platform
System Architecture Experience (5+ years)
Architecting and manager the security roles for a data lake and pipelines
Use of Infrastructure as Code (IaC) tools to deploy pipelines and components
Technical Documentation (5+ years)
Developing and delivering quality technical documentation deliverables on designed solutions
Defining, guiding and contributing to complete documentation for development efforts

Responsibilities

Leading the design of data warehouses, data lakes and datamarts including both the logical and physical models.
Assist in soliciting and assessing requirements for the data warehouses/data lakes among data consumers/analysts, visualization specialists, programmers, and engineers.
Optimizing the design and tuning the performance of data warehouses for efficient loading and high performance for data queries.
Facilitating change control processes for the data model within the repositories including integrating with CI/CD pipelines.
Designing and implementing a metadata repository to be used for data discovery/catalog services across the enterprise.