AWS Data Engineer

Symphony Solutions • Austin, TX

19h • $50 - $60 • Hybrid

About The Position

We are seeking an experienced AWS Data Engineer to join our team. This role involves developing and executing a strategic roadmap for data processing, storage, and analytics, aligned with organizational goals. You will be responsible for designing, implementing, and maintaining robust data pipelines using Python and Airflow, ensuring efficient data flow and transformation for analytical and operational purposes. The position requires strong expertise in various AWS services, real-time data processing, data warehousing, and integration of diverse systems.

Requirements

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
• 8-10 years of experience in data engineering
• Proficient in Python programming and experience with Airflow for workflow management.
• Strong expertise in AWS cloud services, particularly in data storage, processing, and analytics (S3, Glue, EMR, etc.).
• Experience with real-time streaming technologies like Kafka, SQS, and Event Bridge.
• Solid understanding of API based integrations and familiarity with integration tools such as AppFlow.
• Deep knowledge of data warehousing concepts, data modelling techniques, and experience in implementing large-scale data warehousing solutions.
• Demonstrated ability to lead and mentor technical teams, with excellent communication and project management skills.

Responsibilities

• Develop and execute a strategic roadmap for data processing, storage, and analytics aligned with organizational goals.
• Design, implement, and maintain robust data pipelines using Python and Airflow, ensuring efficient data flow and transformation for analytical and operational purposes.
• Utilize AWS services, including S3 for data storage, Glue and EMR for data processing, and orchestrate data workflows that are scalable, reliable, and secure.
• Implement real-time data processing solutions using Kafka, SQS, and Event Bridge, addressing high-volume data ingestion and streaming needs.
• Oversee the integration of diverse systems and data sources through AppFlow, APIs, and other integration tools, ensuring seamless data exchange and connectivity.
• Develop data warehousing solutions, applying best practices in data modelling to support efficient data storage, retrieval, and analysis.
• Continuously monitor, optimize, and troubleshoot data pipelines and infrastructure to ensure optimal performance and scalability.
• Ensure adherence to data governance, privacy, and security policies, implementing measures to protect sensitive data and comply with regulatory requirements.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior