AWS and Azure Data Governance Engineer

IntelliDyne Jobs for Veterans • Washington, DC

2h • $116,000 - $146,000 • Hybrid

About The Position

The AWS and Azure Data Governance Engineer is responsible for monitoring, managing, and optimizing the lifecycle migration of data pools across storage tiers in cloud environments. This role focuses on the controlled transition of data from hot to warm, cool, cold, and archive storage classes within AWS S3 and EC2 storage solutions, as well as equivalent tiers in Azure Blob Storage and Azure Data Lake Storage. In this role, you will design and enforce automated data tiering policies, ensure strong data governance and compliance, optimize storage costs, maintain data integrity and accessibility, and use monitoring tools to oversee migration progress, performance, and adherence to retention and security requirements across AWS and Azure platforms.

Requirements

• 5+ years’ experience in cloud data management, storage architecture, data lifecycle management, or data governance (AWS and/or Azure focus strongly preferred).
• Bachelor’s degree in Computer Science, Information Systems, Data Management, or other relevant discipline.
• Must possess an active Secret clearance with the ability to obtain a US TS/SCI clearance
• Hands-on experience with AWS S3 storage classes, lifecycle configuration, and AWS Lake Formation, as well as Azure Blob Storage tiering, lifecycle management policies, and Azure Data Lake Storage, including large-scale data migration processes across both platforms.
• Proficiency in scripting and automation for cloud data operations (Python with boto3, Azure SDK/PowerShell, AWS CLI, etc.), including infrastructure-as-code tools such as Terraform, AWS CloudFormation, or Azure Bicep for policy-as-code deployment.
• Experience with cloud monitoring, reporting, analytics, and cost optimization for storage resources.
• Strong knowledge of data governance principles, data classification, retention/archival policies, and security/compliance frameworks in regulated environments.
• Familiarity with federal compliance frameworks related to data governance (NIST SP 800-53, OMB Circular A-130, CUI handling requirements).
• Data classification, cataloging, metadata governance, and stewardship, including compliance, retention, and security policy enforcement across AWS/Azure environments
• Cloud storage cost optimization and FinOps practices
• Must have an active professional certification such as AWS Certified Data Engineer – Associate, AWS Solutions Architect – Associate or Professional, Azure Data Engineer Associate, Azure Administrator Associate, or an equivalent data governance or cloud storage certification.

Responsibilities

• Analyze data access patterns, usage frequency, and business requirements to design and implement data lifecycle management policies and automated tier transitions for AWS S3 storage classes (Standard, Intelligent-Tiering, Standard-IA, Glacier, Glacier Deep Archive) and Azure Blob Storage tiers (Hot, Cool, Cold, Archive), including data residing on EC2 instances and associated storage (EBS volumes and snapshots), to identify tiering opportunities and coordinate secure, efficient migrations to lower-cost storage classes.
• Configure, deploy, monitor, and maintain automated data migration workflows using AWS S3 Lifecycle policies, S3 Batch Operations, and Azure Blob Storage lifecycle management rules.
• Establish and enforce data governance standards, including data classification, metadata management, retention policies, access controls, encryption, and compliance requirements across AWS and Azure environments.
• Utilize cloud-native monitoring, analytics, and cost management tools (AWS CloudWatch, Storage Lens, Cost Explorer; Azure Monitor, Azure Advisor, Cost Management) to track migration status, performance, cost savings, and compliance.
• Collaborate with data owners, architects, and stakeholders to assess data sensitivity and value, recommend optimal storage tiers, and resolve issues related to accessibility, performance, or policy compliance during tier transitions.
• Provide recommendations for improving data governance processes, increasing automation of migrations, achieving storage cost optimization, and integrating with enterprise monitoring and service management platforms.

Benefits

• Inclusive and supportive work environment
• Competitive compensation package
• Professional growth through annual subsidy for trainings, certifications, professional memberships as well as mentorships and job shadowing
• Medical, dental, vision, 401(K) with company match
• Flexible Paid Time Off Program, 11 holidays, paid parental leave, military leave, and government shutdown leave
• Rewards and recognition through peer awards, service year awards, spot bonuses, and annual company awards
• Wellness and mental health benefits
• Commuter benefits
• Flexible work options

What This Job Offers

• Job Type: Full-time
• Career Level: Senior