Snowflake Architect- Minneapolis, MN/ Dallas, TX

Cystems Logic Inc•Minneapolis, MN

7h•Onsite

About The Position

We are seeking an experienced Snowflake Architect to lead enterprise data lake and cloud migration initiatives. The role focuses on migrating from on-prem Cloudera environments to Azure cloud platforms while designing scalable data lake solutions using Snowflake and Databricks. The candidate will ensure strong governance security performance optimization and automation across modern data ecosystems.

Responsibilities

Guide team to migrate from on Prem Cloudera to Azure cloud environment.
Designed and implemented scalable data lake solutions using Snowflake and Databricks.
Developed and optimized data pipelines for ingestion transformation and storage.
Managed data governance quality and security across cloud environments.
Implemented performance tuning automation and CI/CD for data workflows.
Collaborated with cross-functional teams to support cloud migration activities.
Install configure manage and monitor Cloudera Hadoop clusters ensuring high availability performance and security.
Manage HDFS YARN and other ecosystem components.
Tune Hadoop Hive and Spark jobs and configurations for optimal performance efficiency and resource utilization.
Optimize queries manage partitions and leverage in-memory capabilities.
Diagnose and resolve issues related to Linux servers networks cluster health job failures and performance bottlenecks.
Provide on-call support and collaborate with other teams to ensure smooth operations.
Implement and manage security measures within the Cloudera environment including Kerberos Apache Ranger and Atlas to ensure data governance and compliance.
Setup and manage HashiCorp Vault for secure keys and secrets management.
Utilize CyberArk for privileged access management and secure administrative tasks on the cluster.
Migrate Hadoop Hive and Spark data and applications to Azure cloud services such as Azure Synapse Analytics Azure Databricks or Snowflake.
Ensure data integrity performance tuning and validation.
Develop scripts (e.g. shell Ansible Python) for automating administrative tasks deployments and monitoring.
Work with users to develop debug and optimize Hive Spark and Python programs that connect to the Cloudera environment.
Create and maintain documentation for system configurations operational procedures and troubleshooting knowledge bases.
Work closely with the Cloudera vendor to stay current with the latest releases perform upgrades and address vulnerabilities.