Senior Data Engineer

The Weather CompanyAtlanta, GA
4hHybrid

About The Position

We’re seeking a Senior Data Engineer to design, build, and operate large-scale, data-intensive platforms in the cloud. In this role, you’ll be responsible for developing reliable data pipelines, scalable data processing systems, and high-availability architectures that support analytics, machine learning, and data science use cases. You’ll work with modern big data technologies and AWS services, contribute hands-on code, lead smaller data initiatives, and mentor junior engineers. This is an ideal role for someone who thrives in complex data environments, values strong engineering fundamentals, and enjoys turning raw data into dependable, production-ready systems.

Requirements

  • Bachelor's or Master's in a related field, or commensurate experience
  • 5+ years in Computer Science, with a proven track record of successful projects.
  • 5+ years of experience operating and deploying solutions using AWS Service including S3, EMR, SQS, SNS, Lambdas, Athena, Glue, Kinesis, and MSK.
  • 5+ years of experience with one or more of the following programming languages: Python, Scala, or Java
  • 5+ years of experience with SQL.
  • 5+ years of experience with big data technologies such as Cassandra, Spark, Hadoop, Parquet, Redash, etc.
  • Advanced proficiency in building data integrations using both API and file-based protocols.
  • Advanced proficiency with test-driven development and unit testing.
  • Experience with Git Version Control or similar
  • Experience with CI/CD pipeline patterns and best practices
  • Proficiency with alerting and monitoring tools like Grafana
  • Demonstrated ability to learn new technologies and languages.
  • Able to put together process documentation concisely and clearly.
  • Excellent written and verbal communication skills.
  • Able to work closely and effectively with peer developers and work on several active projects simultaneously, including leading small projects.
  • Solid experience implementing high-availability, scalable cloud solutions
  • Strong understanding of data structures and algorithms
  • Solid knowledge of functional programming languages and techniques, and object-oriented programming languages and techniques
  • Solid knowledge of concurrency and concurrent programming techniquess and distributed computing techniques
  • Knowledge and understanding of operating with data in large scale, including Machine Learning and Data Science concepts

Responsibilities

  • Designs and implements sophisticated software systems using either object-oriented or functional programming techniques implemented in Python, Scala or Java languages.
  • Participate in, and adhere to, professional software engineering practices using such tools and methodologies as Agile Software Development, Test Driven Development, Continuous Integration, Source Code Management (git), Jira, and Stash
  • Maintain an advanced level of proficiency with Computer Science/Software Engineering knowledge.
  • Work well independently and as part of a team, mentoring junior engineers in routine, less-complex tasks, and leading small projects
  • Other duties as assigned.

Benefits

  • Flexible Time Off program
  • Hybrid work model
  • Variety of medical insurance options, including a $0 cost premium employee coverage
  • Benefits effective day 1 of employment include a competitive 401K match with no vesting requirement, national health, dental, and vision plans
  • Progressive family plan benefits
  • An opportunity to work for a global and industry-leading technology company
  • Impactful work in a collaborative environment
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service