AWS Data Engineer

Cognizant Technology SolutionsMettawa, IL
89d$115,500 - $135,500

About The Position

Artificial intelligence (AI) and the data it collects and analyzes will soon sit at the core of all intelligent, human-centric businesses. By decoding customer needs, preferences, and behaviors, our clients can understand exactly what services, products, and experiences their consumers need. Within AI & Analytics, we work to design the future—a future in which trial-and-error business decisions have been replaced by informed choices and data-supported strategies. By applying AI and data science, we help leading companies to prototype, refine, validate, and scale their AI and analytics products and delivery models. Cognizant's AIA practice takes insights that are buried in data and provides businesses a clear way to transform how they source, interpret and consume their information. Our clients need flexible data structures and a streamlined data architecture that quickly turns data resources into informative, meaningful intelligence.

Responsibilities

  • Develop, maintain, and optimize data pipelines using PySpark and Python to process large volumes of data efficiently.
  • Utilize Shell scripting to automate data processing tasks and manage workflows.
  • Work with various data engineering services in AWS, such as Amazon Redshift, Amazon S3, Amazon EMR to design scalable and robust data solutions.
  • Write complex SQL queries to extract, manipulate, and analyze data from multiple sources.
  • Collaborate with cross-functional teams to understand data requirements and translate them into efficient data models and solutions.
  • Monitor and troubleshoot data pipelines and workflows, ensuring data integrity and timely delivery of processed data.

Benefits

  • Medical/Dental/Vision/Life Insurance
  • Paid holidays plus Paid Time Off
  • 401(k) plan and contributions
  • Long-term/Short-term Disability
  • Paid Parental Leave
  • Employee Stock Purchase Plan
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service