Data Engineer III

MAPFREWebster, MA
319d

About The Position

MAPFRE USA is seeking a Data Engineer to join our Data Engineering team. This role involves building data products for sophisticated data consumers and requires a passion for solving complex problems while maintaining a fun and collaborative work environment. The Data Engineer will work closely with the data architect and stakeholders to help transform MAPFRE USA into a data-driven organization.

Requirements

  • Bachelor's Degree with 6+ years of experience.
  • Advanced knowledge and experience using Python, Airflow, Spark, AWS, and Snowflake.
  • Experience with database architectures: SQL, NoSQL, and graph databases.
  • Familiarity with CI/CD and orchestration tools such as Jira, Jenkins, Bit Bucket, Terraform, and Airflow.
  • Experience with data modeling tools and ETL tools (e.g., Informatica Power Center).
  • Proficiency in computer languages and data query tools: AWS Athena, Jupyter notebooks, Spark, Pyspark, Python, and EMR Studio.
  • Understanding of algorithm analysis for collaboration with Data Scientists.
  • Knowledge of multidimensional modeling for quantitative and fact-related data storage.
  • Familiarity with operating systems: Linux and MS Windows.
  • Experience with code IDEs: Microsoft Visual Code and Jupyter notebooks.

Nice To Haves

  • Experience with artificial intelligence, machine learning, and deep learning.

Responsibilities

  • Augment and maintain existing repositories and data structures within AWS.
  • Experience with various formats and means for data ingestion, including structured, semi-structured, and unstructured data from on-premise and cloud sources.
  • Expand and enhance data models utilizing best practices regarding data organization and relationships.
  • Optimize models for fast and scalable queries while maintaining performance and cost thresholds.
  • Define, construct, and maintain self-service dashboards for Business and Advanced Analytics teams within PowerBI.
  • Implement scalable and flexible, high-performance data pipelines for AWS to support analytics.
  • Develop and maintain data maps and their relationships.
  • Generate technical documentation including follow-up reports.
  • Work with Data Governance to implement quality rules and data governance measures such as data dictionaries and metadata.
  • Propose improvements and actions based on provided results.
  • Communicate results effectively with required teams.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service