Sr. Azure Data Engineer - DataStage

Cognizant Technology SolutionsLouisville, KY
98d$64,000 - $94,000Remote

About The Position

In this role, you will design and develop scalable data pipelines leveraging Azure Data Factory, Azure Synapse, and Databricks to build, optimize, and maintain robust ETL/ELT pipelines for large-scale data processing and analytics. You will manage and monitor cloud-based data solutions, overseeing the deployment, performance, and security of cloud applications, ensuring compliance with best practices in network security and cloud governance. Collaboration across teams for data integration is essential, as you will work closely with data engineers, analysts, and business stakeholders to gather requirements, design solutions, and ensure seamless data integration across platforms. You will implement CI/CD and version control practices utilizing Git repositories and release pipelines to manage code versioning, automate deployments, and maintain high-quality development standards. Additionally, you will ensure data quality and performance optimization by writing efficient SQL and PySpark code, conducting performance tuning, and troubleshooting issues to ensure data accuracy, reliability, and optimal system performance.

Requirements

  • 8 plus years of technical and development experience.
  • 3 plus years of experience with Azure Data Factory, Azure Synapse, and Databricks.
  • Experience with ETL, SQL, and PySpark.
  • Experience managing cloud applications, with a focus on network security.
  • Experience with Git repositories and release pipelines.
  • Ability to communicate effectively.
  • Ability to manage multiple tasks and deadlines with attention to detail.
  • 1 or more professional Azure certifications.
  • Prior work experience in DataStage.

Responsibilities

  • Design and develop scalable data pipelines using Azure Data Factory, Azure Synapse, and Databricks.
  • Manage and monitor cloud-based data solutions, ensuring compliance with network security and cloud governance best practices.
  • Collaborate with data engineers, analysts, and business stakeholders for data integration.
  • Implement CI/CD and version control practices using Git repositories and release pipelines.
  • Ensure data quality and performance optimization through efficient SQL and PySpark coding.

Benefits

  • Medical/Dental/Vision/Life Insurance
  • Paid holidays plus Paid Time Off
  • 401(k) plan and contributions
  • Long-term/Short-term Disability
  • Paid Parental Leave
  • Employee Stock Purchase Plan
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service