Associate Data Engineer

BeyondTrust

1d

About The Position

As an Associate Data Engineer at BeyondTrust, you will contribute to building and enhancing a data lake that consumes billions of events each day. You will use data engineering tools to help develop cost-effective cloud solutions that enable cybersecurity research. The role involves maintaining and optimizing existing infrastructure, building new data assets, and collaborating with experienced engineers to deliver reliable data solutions that drive business value.

Requirements

• Knowledge of programming and technology for cloud data processing.
• Experience with Spark.
• Ability to learn quickly and a strong desire to develop.
• Understanding of software engineering principles, data structures, and distributed data processing concepts.
• Experience working with distributed systems and data processing on object stores.
• Ability to work autonomously and collaboratively.
• Data warehousing knowledge for analytics use cases.
• Proficiency in Python or another object-oriented language.
• Experience with a distributed processing framework.

Nice To Haves

• Knowledge of Databricks.
• Interest in cybersecurity; interest in identity security is preferred.
• Realtime processing experience.
• Some experience with graph data stores.

Responsibilities

• Contribute to data modeling efforts supporting identity security use cases and analytical requirements.
• Develop and maintain data pipelines that bring together complex information from disparate systems for security analysis in the data lake.
• Optimize data workloads at the software level by improving processing efficiency.
• Work with senior engineers to identify process improvements and help implement solutions.
• Use monitoring and observability best practices to ensure optimal pipeline performance.
• Assist with ML Operations to ensure optimal model efficiency.
• Use CI/CD best practices to develop and release source code.
• Participate in code reviews and collaborate with team members to improve engineering practices.

What This Job Offers

• Job Type: Full-time
• Career Level: Entry Level
• Education Level: No Education Listed