Sr. Data Engineer (AWS/Databricks)

Onebridge • New York, NY

111d

About The Position

Onebridge, a Marlabs Company, is a global AI and Data Analytics Consulting Firm that empowers organizations worldwide to drive better outcomes through data and technology. Since 2005, we have partnered with some of the largest healthcare, life sciences, financial services, and government entities across the globe. We have an exciting opportunity for a highly skilled Sr. Data Engineer (AWS/Databricks) to join our innovative and dynamic team. This is a hybrid role requiring onsite presence 3 days per week at an office location in either New York, NY or Lawrence Township, NJ.

Requirements

• 10+ years of experience in data engineering, with proven expertise in building and optimizing large-scale data pipelines.
• Deep proficiency in AWS cloud services (Redshift, Glue, Athena, EMR, ECS, Lambda) and Databricks.
• Strong hands-on skills with PySpark, SparkSQL, and advanced SQL for performance tuning and optimization.
• Experience with Hadoop ecosystems and ETL tools such as Talend.
• Demonstrated ability to architect end-to-end data solutions, ensuring scalability, data quality, and system reliability.
• Excellent communication skills with the ability to provide technical leadership and influence best practices across teams.

Responsibilities

• Architect and maintain scalable data pipelines leveraging AWS (Glue, EMR, Lambda, Redshift, Athena) and Databricks.
• Optimize data workflows to improve performance, reliability, and data quality across diverse data sources.
• Drive best practices in data engineering, including code quality, automation, and CI/CD processes.
• Collaborate with data science, product, and business teams to translate requirements into technical solutions.
• Evaluate and integrate big data tools and frameworks (Hadoop, Talend, SparkSQL) to enhance the data ecosystem.
• Provide technical guidance and establish engineering standards to ensure scalable, maintainable solutions.

What This Job Offers

• Career Level: Senior
• Number of Employees: 101-250 employees