Data Solution Engineer

ChubbJersey City, NJ
23h$88,000 - $138,000

About The Position

We are seeking an experienced Data Solution Engineer to join our team. This critical role will focus on designing and implementing automated data solutions, driving operational efficiency, and enhancing data scalability across the organization. The ideal candidate will possess a deep understanding of data engineering principles, experience in developing flexible and scalable data frameworks, and a commitment to best practices in data management.

Requirements

  • Bachelor’s degree in computer science, Information Technology, Engineering, or a related field.
  • More than 7 years of experience as a Data Engineer or in a related role, with a focus on automation and data process improvement.
  • Demonstrated experience in designing and implementing automation frameworks and solutions for data pipelines and transformations using data workflows, especially with Azure Data Factory (ADF).
  • Strong understanding of data processing frameworks (e.g., Apache Spark, Apache Kafka) and database technologies (e.g., SQL, NoSQL).
  • Expertise in programming languages relevant to data engineering (e.g., Python, SQL).
  • Excellent problem-solving skills and ability to think strategically about data and its role in improving organizational efficiency.

Nice To Haves

  • Familiarity with cloud data platforms (e.g., AWS, Azure, Google Cloud) is a plus.

Responsibilities

  • Collaborate with stakeholders to devise solutions and designs for upcoming projects associated with any 360(SMART DATA) expansion initiatives.
  • Evaluate project requirements and develop architecture designs that support the specific needs of these regions and expansion efforts.
  • Ensure that solutions are scalable and adaptable to diverse business environments.
  • Evaluate current manual data processes to uncover opportunities for automation within the Smart Data Management ecosystem.
  • Develop optimized automated data pipelines and workflows to streamline data integration, transformation, and availability.
  • Ensure efficient monitoring and notification systems for data pipeline success or failure to enhance operational efficiency.
  • Create a common, flexible, and scalable data framework applicable to various data projects and analytics initiatives.
  • Establish standardized data components, design patterns, and methodologies to enhance data engineering project delivery speed and efficiency.
  • Collaborate with data analysts and scientists to adapt the framework to meet unique data requirements while maintaining scalability.
  • Leverage extensive experience to enforce data engineering best practices throughout the development lifecycle.
  • Ensure that data solutions are standardized, maintainable, and reliable for long-term operational support.
  • Conduct code reviews and provide technical guidance to data engineering teams on best practices.
  • Assess existing data processes and workflows to identify limitations and areas for improvement.
  • Recommend actionable solutions to optimize data efficiency, enhance data quality, and reduce operational costs.
  • Promote a culture of innovation by exploring emerging technologies and methodologies that can enhance data engineering practices.
  • Propose and pilot innovative data solutions that challenge conventional data management approaches and enable new ways of leveraging data.
  • Collaborate with cross-functional teams to drive the adoption of innovative technologies across the data landscape.
  • Continuously research and stay updated on the latest data engineering technologies and industry trends.
  • Evaluate and integrate suitable technologies into existing data solutions to enhance organizational competitiveness and adaptability.

Benefits

  • This role may also be eligible to participate in a discretionary annual incentive program.
  • Chubb offers a comprehensive benefits package, more details on which can be found on our careers website .
  • The disclosed pay range estimate may be adjusted for the applicable geographic differential for the location in which the position is filled.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service