Sr Analyst, Data Engineer

Scotts Miracle-GroMarysville, OH
2d

About The Position

Here at Scotts Miracle-Gro there is no such thing as a typical day. Our culture is constantly energized by new and exciting growth opportunities and at a rapid pace. Below are details on an open job. If the role interests you and you would like to be considered we encourage you to apply! The Senior Analyst in Data Engineering is a technical role that supports data processing and integration efforts. You'll use your advanced analytical skills to improve data pipelines and ensure data delivery is consistent across projects. This role bridges the gap between data engineers and data analysts/scientists to optimize data-driven initiatives. In this role you will : Data Processing and Transformation: - Perform data extraction, transformation, and loading (ETL) processes. - Design and implement complex data transformation logic to meet business requirements. - Ensure the accuracy and reliability of data processing tasks. Data Quality and Validation: - Implement and execute data quality checks to identify and address anomalies. - Collaborate with stakeholders to define and enforce data quality standards. - Monitor and troubleshoot data quality issues to maintain high standards. Database Management: - Manage and optimize databases to support efficient data storage and retrieval. - Implement database schemas, indexes, and structures for optimal performance. - Collaborate with database administrators to ensure database integrity and security. Reporting and Analytics Support: - Support data analysts and data scientists in creating reports and analytics solutions. - Collaborate with business intelligence teams to integrate data for reporting purposes. - Ensure data availability and accuracy for analytical purposes. Collaboration with Data Scientists: - Work closely with data scientists to understand their data requirements and provide support. - Assist in the integration of machine learning models into data engineering pipelines. - Optimize data processing for machine learning tasks. Process Automation: - Identify opportunities for process automation within data engineering workflows. - Implement automation scripts and tools to streamline repetitive tasks. - Enhance operational efficiency through the use of automation. Documentation and Knowledge Sharing: - Document data engineering processes, workflows, and best practices. - Share knowledge and provide training to team members and other stakeholders. - Maintain up-to-date documentation for reference and training purposes. What you'll need to be successful: -Bachelors Degree in Computer Science in Engineering, mathematics, or related technical field Required : Databricks, python, Spark SQL, Airflow Desired : AWS Certified Data Engineer -4-7 years of experience preferred -6+ years of experience in Data Engineering -Strong communication skills to timely and effectively convey information and consult with others

Requirements

  • Bachelors Degree in Computer Science in Engineering, mathematics, or related technical field
  • Databricks
  • python
  • Spark SQL
  • Airflow
  • 6+ years of experience in Data Engineering
  • Strong communication skills to timely and effectively convey information and consult with others
  • 6+ years of developing and maintaining data pipelines (ETL/ELT)
  • 6+ years of programming experience in Databricks, Python, and Apache Spark
  • Experience with Apache Airflow
  • Experience in deploying solution in AWS Cloud with emphasis on Amazon S3, Glue, Athena, EMR, RDS, and lake formation
  • Experience in data modelling and writing complex SQL queries

Nice To Haves

  • AWS Certified Data Engineer
  • 4-7 years of experience preferred

Responsibilities

  • Perform data extraction, transformation, and loading (ETL) processes.
  • Design and implement complex data transformation logic to meet business requirements.
  • Ensure the accuracy and reliability of data processing tasks.
  • Implement and execute data quality checks to identify and address anomalies.
  • Collaborate with stakeholders to define and enforce data quality standards.
  • Monitor and troubleshoot data quality issues to maintain high standards.
  • Manage and optimize databases to support efficient data storage and retrieval.
  • Implement database schemas, indexes, and structures for optimal performance.
  • Collaborate with database administrators to ensure database integrity and security.
  • Support data analysts and data scientists in creating reports and analytics solutions.
  • Collaborate with business intelligence teams to integrate data for reporting purposes.
  • Ensure data availability and accuracy for analytical purposes.
  • Work closely with data scientists to understand their data requirements and provide support.
  • Assist in the integration of machine learning models into data engineering pipelines.
  • Optimize data processing for machine learning tasks.
  • Identify opportunities for process automation within data engineering workflows.
  • Implement automation scripts and tools to streamline repetitive tasks.
  • Enhance operational efficiency through the use of automation.
  • Document data engineering processes, workflows, and best practices.
  • Share knowledge and provide training to team members and other stakeholders.
  • Maintain up-to-date documentation for reference and training purposes.

Benefits

  • Our Live Total Health program provides you with options to align to your personal needs. Selections range from medical, dental and vision coverage for you, your spouse/domestic partner and dependents to an outstanding wellness reimbursement program to an unbelievable 401K match (up to 7.5%) as well as a 15% discount on company stock and much more
  • We know our talent is our most precious asset and your unique development contributes to our organization’s success now and in the future. Career growth at our company is not always a ladder. It’s much more like a rock climbing adventure. Grow through exploration and experiences rather than a predictable linear path.
  • We value the importance of family. We provide access to Maven Family Planning and up to $30,000 to accommodate for adoption, fertility and surrogacy.
  • Be part of something bigger by joining one of our Employee Resource Groups focusing on diversity and inclusion, family, education and sustainability: Scotts Women’s Network, Scotts Black Employees’ Network, Scotts Veterans Network, Scotts Young Professionals, Scotts Pride Network (GroPride), Scotts Associates for a Greener Earth (SAGE), Scotts Family TREE and our Associate Boards.
  • Join a company with a strong belief in giving back to the communities where we live and work. We have a shared passion for service and volunteerism and believe participating in community service benefits our communities and strengthens our team.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service