Data Architect - Hybrid

Genesis10•Cleveland, OH

6d•Hybrid

About The Position

Genesis10 is seeking a hands-on Data Architect to support a large-scale data modernization initiative involving the migration of data from Hadoop and Teradata environments into cloud-based object storage. This role will be an individual contributor responsible for helping design and execute the target data architecture, with a strong emphasis on data migration, table design, data loading, data integrity, and validation. The ideal candidate has experience with large-scale data migration implementations and understands the challenges of moving significant data volumes from legacy platforms into modern object-storage environments. Experience with Apache Iceberg is highly preferred.

Requirements

Strong experience as a Data Architect, Data Migration Architect, or Senior Data Engineer with significant architectural responsibilities
Demonstrated experience participating in or leading large-scale data migration implementations
Hands-on experience migrating large datasets from Hadoop and/or Teradata environments
Strong understanding of cloud object storage and modern data lake/data lakehouse architectures
Hands-on experience with Apache Iceberg is highly preferred
Strong understanding of: Data modeling and table design, Schema design and evolution, Partitioning strategies, Data ingestion and loading, Data transformation, Data validation and reconciliation, Large-scale data processing, and Data quality and integrity
Experience with common data formats such as Parquet, Avro, or ORC
Ability to troubleshoot issues involving large datasets, table structures, data loads, and performance
Strong SQL skills
Experience working directly with engineering teams to implement architectural designs
Ability to work as an individual contributor and be hands-on with the technical implementation

Nice To Haves

Experience implementing Apache Iceberg on cloud object storage
Experience with AWS S3, Azure Data Lake Storage (ADLS), or Google Cloud Storage (GCS)
Experience with Spark, PySpark, or other distributed data-processing technologies
Experience migrating Hadoop data to a modern lakehouse architecture
Experience migrating Teradata workloads/data to cloud-based platforms
Experience with technologies such as Databricks, Snowflake, Trino, AWS, Azure, or GCP
Experience with data governance, metadata, lineage, and data quality controls
Experience with large-scale enterprise or financial-services data environments

Responsibilities

Design and implement data migration solutions moving large datasets from Hadoop and Teradata into cloud object storage
Define and implement target table structures, schemas, partitioning strategies, and data layouts
Develop and/or oversee processes for loading large volumes of data into object storage while maintaining data integrity and performance
Implement and work with Apache Iceberg tables in an object-storage environment
Analyze existing Hadoop and Teradata data structures and determine how they should be represented in the target environment
Develop migration strategies for both historical and ongoing data
Perform data profiling, mapping, transformation, reconciliation, and validation as part of migration activities
Ensure data is loaded completely and accurately, with appropriate controls for data quality, completeness, consistency, and reconciliation
Identify and resolve issues related to schema evolution, partitioning, file formats, performance, and large-scale data movement
Work closely with data engineers and other technical teams to implement migration pipelines and troubleshoot migration issues
Help establish standards and patterns for moving additional datasets from legacy platforms to object storage
Document target data structures, migration processes, data mappings, and technical decisions
Participate throughout the implementation lifecycle, from architecture and design through migration, validation, and production implementation

Benefits

Access to hundreds of clients, most who have been working with Genesis10 for 5-20 years.
The opportunity to have a career-home in Genesis10; many of our consultants have been working exclusively with Genesis10 for years.
Access to an experienced, caring recruiting team (more than 7 years of experience, on average.)
Behavioral Health Platform
Medical, Dental, Vision
Health Savings Account
Voluntary Hospital Indemnity (Critical Illness & Accident)
Voluntary Term Life Insurance
401K
Sick Pay (for applicable states/municipalities)
Commuter Benefits (Dallas, NYC, SF, and Illinois)