Staff Data Engineer

BlackLine • New York, NY

3d • Hybrid

About The Position

We’re looking for a Lead Data Engineer to design, build, and optimize data pipelines that power our next-generation AI-driven accounting agents. You’ll lead the development of scalable, high-performance data infrastructure while collaborating closely across teams.

Requirements

• 3+ years of experience as a Data Engineer or a similar role
• Bachelor’s degree in Computer Science, Engineering or a related field
• Expertise in PySpark and data transformation pipelines. Familiarity with AI technologies and cloud platforms (AWS, Azure) is a plus
• Strong communication skills and a proactive, ownership-driven mindset
• Thrive in a fast-paced, in-office-first startup environment

Nice To Haves

• Understanding of data privacy and security best practices particularly in the age of AI
• Strong analytical and problem-solving skills
• Experience in fin-tech or financial services industry a plus

Responsibilities

• Lead data pipeline development: Build and maintain PySpark ETL pipelines with high data quality and performance
• Manage integrations: Establish robust connections to client data sources via APIs and tools like FiveTran, Plaid, and BlackLine’s own internal connector ecosystem
• Ensure reliability: Monitor pipeline performance, automate testing, and validate data accuracy
• Optimize for scale: Implement performance improvements (e.g., CDC mechanisms, indexing strategies) for large-scale datasets
• Collaborate & innovate: Work with business stakeholders to refine data requirements and integrate cutting-edge AI and big data technologies

Benefits

• BlackLine offers a wide variety of professional development seminars and inclusive affinity groups to celebrate and support our diversity.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Number of Employees: 1,001-5,000 employees