Sr Data Engineer

BeyondTrust • Johns Creek, GA

6d • Hybrid

About The Position

Data Engineers at BeyondTrust are the backbone of the company’s core data infrastructure that powers all analytics products running on our SaaS platform. Leverage AWS expertise to manage a wide array of cloud compute services like AWS Lambda as well as managing database solutions like AWS DynamoDB and AWS Neptune in order to compute results quickly. Extensive Datadog and AWS Cloudwatch monitoring to ensure that all aspects of infrastructure stays running as expected and niche data governance methods are applied to ensure that data outcomes remain consistent. Perform data modelling and database structuring. Create highly scalable and efficient ETL pipelines to populate our advanced data lake. Position is a fixed location based in Johns Creek office; however, telecommuting from a home office may also be allowed.

Requirements

• Master’s degree (or foreign equivalent) in Information Systems or a directly related field
• Four (4) years of experience in a Data Engineering role
• Petabyte-sized Data Lakes
• Deep AWS experience building end-to-end data applications
• Spark experience (RDDs, DataFrames, low-level optimizations)
• Spark optimization tools (Ganglia, Log4J, Spark UI)
• Data warehousing
• Data modeling experience
• SQL development
• Python
• Snowflake experience
• AWS Athena serverless data warehousing
• Hadoop ecosystem
• Hive and Presto
• YARN resource management

Nice To Haves

• Extensive Datadog and AWS Cloudwatch monitoring

Responsibilities

• Manage a wide array of cloud compute services like AWS Lambda
• Manage database solutions like AWS DynamoDB and AWS Neptune
• Perform data modelling and database structuring
• Create highly scalable and efficient ETL pipelines to populate our advanced data lake
• Ensure all aspects of infrastructure stays running as expected
• Apply niche data governance methods to ensure that data outcomes remain consistent

What This Job Offers

• Job Type: Full-time
• Career Level: Senior