Cognizant Technology Solutions-posted 2 months ago
$116,000 - $135,000/Yr
Hybrid • Parsippany, NJ
5,001-10,000 employees
Professional, Scientific, and Technical Services

Data Engineer for a critical cloud-to-cloud migration project, specifically focusing on the parallel run and validation phase. The ideal candidate will be responsible for building, monitoring, and executing data validation and reconciliation processes to ensure the accuracy, completeness, and performance parity of data pipelines and data stores migrated to the new cloud environment. This role requires deep expertise in data engineering, cloud platforms (both source and target), and rigorous quality assurance processes for large-scale data systems.

  • Data Validation and Reconciliation (Primary Focus)
  • Monitoring, Troubleshooting, and Issue Resolution
  • Pipeline and Platform Optimization
  • Documentation and Reporting
  • 4+ years of hands-on experience with AWS and specific experience in cloud-to-cloud migration projects
  • High proficiency in Python (Pandas, PySpark) and SQL for data manipulation, scripting, and complex querying
  • Strong experience with cloud-native processing services
  • Expertise in cloud data warehouse technologies (e.g., Amazon Redshift) and Data Lake storage (e.g., S3 in AWS)
  • Experience with modern workflow schedulers like Apache Airflow or cloud-native equivalents (e.g., AWS Step Functions)
  • Experience with data quality tools, data diffing techniques, and developing custom data reconciliation utilities
  • Meticulous approach to data comparison and troubleshooting data integrity issues
  • Strong analytical and diagnostic skills for identifying and resolving data discrepancies in complex, distributed environments
  • Excellent verbal and written communication skills for reporting validation results to both technical and non-technical stakeholders
  • Medical/Dental/Vision/Life Insurance
  • Paid holidays plus Paid Time Off
  • 401(k) plan and contributions
  • Long-term/Short-term Disability
  • Paid Parental Leave
  • Employee Stock Purchase Plan
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service