Senior Data Engineer

Beyond Finance - Chicago, IL

Full-time - Senior

Chicago, IL

Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services

About the position

As a Senior Data Engineer at Beyond Finance, you will be responsible for developing a modern data pipeline that integrates data from various sources into the analytics platform. This role involves owning small to medium-sized projects that contribute to business growth and informed decision-making. The position requires collaboration in a Chicago-based office, with a hybrid work model of 2-3 days in the office, promoting team collaboration and mentorship.

Responsibilities

• Research various data tools and gain consensus on a tool for current and future use cases.
• Build data pipelines while standardizing processes and minimizing customization.
• Self-manage projects, plan ahead, and consider second and third order consequences while creating project milestones.
• Design solutions and develop data pipelines to integrate data from sources to targets.
• Develop automated test cases to validate data integrity and consistency.
• Be on-call to troubleshoot issues and understand root causes.
• Address security issues surrounding access, PII, and business-sensitive data.
• Design for scalability and robustness of availability in data pipelines.
• Contribute thoughts and ideas to the overall goals of the team.

Requirements

• Bachelor's degree in Computer Science or other technical field or equivalent work experience.
• At least 5 years of experience in development, data pipelines, or DevOps, with at least 2 years in a cloud environment.
• 3+ years of experience with data tools such as Airflow, Lambda's, Kafka, Spark, Presto, MapReduce, AWS Glue, or similar platforms.
• Experience with cloud analytics platforms like Google Big Query, AWS Redshift, or Snowflake, and relational databases such as Postgres or MySQL.
• Exposure to developing batch systems and real-time streaming platforms.
• Excellent SQL experience with complex queries.
• Solid skills in Python or Java; UNIX shell scripting is a plus.
• Experience with configuration-as-code tools like Ansible, Terraform, or Chef.
• Experience with continuous integration, testing, and deployment using tools like Git and Jenkins; Docker experience is a plus.
• Expertise in managing large datasets and their business use.
• Excellent organizational, interpersonal, analytical, and problem-solving skills.
• Strong multitasking skills and ability to balance competing priorities.
• Ability to work in a fast-paced environment with continuous innovation and ambiguity.
• Experience with agile or rapid application development methods.
• Demonstrated experience in coaching and mentoring team members.
• Willingness to participate in an on-call rotation.

Nice-to-haves

• Experience with Docker.
• Experience in coaching and mentoring other team members.

Benefits

• Considerable employer contributions for health, dental, and vision programs.
• Generous PTO, paid holidays, and paid parental leave.
• 401(k) matching program.
• Merit advancement opportunities.
• Career development & training.