Senior AWS Data Engineer

CGIWestlake, TX
398d$68,700 - $146,800

About The Position

CGI is seeking a passionate and innovative Senior AWS Data Engineer to join our team. The ideal candidate is a skilled technologist with a proven track record in designing, developing, and optimizing complex data solutions. This role involves expanding and optimizing data and data pipeline architecture, supporting cross-functional teams, and ensuring optimal data architecture for the Enterprise Analytics platform.

Requirements

  • At least 15+ years of relevant experience.
  • Strong hands-on experience with AWS cloud services: EC2, EMR, EKS, Snowflake, Elastic-Search.
  • Experience with stream-processing systems: Storm, Spark-Streaming, Kafka.
  • Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala.
  • Experience with big data tools: Hadoop, Spark, Kafka, Kubernetes.
  • Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
  • Experience with DevOps, data pipeline and workflow management tools: Concourse, Terraform, Luigi, Airflow.
  • Experience with data management tools: Collibra, Alation, BigID, Alex Solutions.
  • Experience building and optimizing big data pipelines, architectures, and data sets.
  • Advanced working SQL knowledge and experience with relational databases.
  • Strong analytic skills related to working with unstructured datasets.
  • Experience in cloud services such as AWS EMR, EC2, EKS, Jupyter notebooks.
  • Experience performing root cause analysis on internal and external data and processes.
  • Build processes supporting data transformation, data structures, metadata management, dependency, and workload management.
  • Successful history of manipulating, processing, and extracting value from large, disconnected datasets.
  • Working knowledge of message queuing, stream processing, and highly scalable big data data stores.
  • Strong project management and organizational skills.

Nice To Haves

  • Knowledge of agile methods.
  • Experience leading a team of data engineers.

Responsibilities

  • Expand and optimize data and data pipeline architecture.
  • Optimize data flow and collection for cross-functional teams.
  • Support the Operational Excellence Squad in standardizing toolsets for the Enterprise Analytics platform.
  • Ensure optimal data architecture is formulated and delivered.
  • Support the data needs of multiple teams, systems, and products.
  • Optimize or redesign the company's data architecture to support next-generation products and data initiatives.

Benefits

  • Competitive compensation
  • Comprehensive insurance options
  • Matching contributions through the 401(k) plan and the share purchase plan
  • Paid time off for vacation, holidays, and sick time
  • Paid parental leave
  • Learning opportunities and tuition assistance
  • Wellness and Well-being programs.

Stand Out From the Crowd

Upload your resume and get instant feedback on how well it matches this job.

Upload and Match Resume

What This Job Offers

Job Type

Full-time

Career Level

Senior

Industry

Professional, Scientific, and Technical Services

Education Level

No Education Listed

© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service