Data Engineer III

MAPFREWebster, MA
81d

About The Position

Do you think in Python and speak in SQL? Do you appreciate a good data model as much as a good painting in a museum? Are you excited by an opportunity to solve complex problems while also having fun? Are you a team player? Do you strive for simplicity and elegance in your solutions? If so, MAPFRE USA is looking for a data engineer who will be part of the Data Engineering team building data products for our sophisticated data consumers. As a data Engineer you will be a part of an agile team delivering value. Using modern tools and technologies. You will work closely with the data architect and stakeholders and help MAPFRE USA transform to a data driven organization.

Requirements

  • Bachelor's Degree with 6+ years of experience
  • Advanced knowledge and experience using Python, Airflow, Spark, AWS, and Snowflake
  • Database architectures: SQL, NoSQL, graph databases
  • CI/CD and Orchestration: Jira, Jenkins, Bit Bucket, Terraform, and Airflow
  • Past experience with data modeling tools, ETL tools (e.g. Informatica Power Center)
  • Computer languages, data query and transformation tools: AWS Athena, Jupyter notebooks, Spark, Pyspark, Python, and EMR Studio
  • Algorithm analysis (for working with our Data Scientists)
  • Understanding of multidimensional modeling for quantitative and fact related data storage
  • OS: Linux, and MS Windows
  • Code IDE: Microsoft Visual Code, Jupyter notebooks

Nice To Haves

  • Artificial intelligence, machine learning, and deep learning are a plus

Responsibilities

  • Augment and maintain the existing repositories and data structures within AWS (used to process and store large amounts of data from unrelated sources)
  • Experience with several formats and means for data ingestion, including data types (structured, semi-structured, and unstructured), and sources (on premise, and in the cloud) using the most appropriate techniques in each case
  • Continue to expand and enhance the model, utilizing best practices, in regards to the organization of data and the various relationships
  • Optimize existing and future models for fast and scalable queries (while maintaining performance and related price thresholds)
  • Work with the team to define, construct, and maintain self-service dashboards for the Business and Advanced Analytics teams within PowerBI
  • Implement scalable and flexible, high performance data pipelines for AWS to support analytics
  • Develop and maintain data maps and their relationships
  • Generate associated technical documentation including follow-up reports
  • Work with Data Governance to implement quality rules and data governance measures (data dictionary, metadata, traceability, ...)
  • Propose improvements and actions based on provided results
  • Communicate results effectively with required teams

Benefits

  • Inspiring and dynamic workplace
  • Collaboration and innovation
  • Community engagement and environmental initiatives

Stand Out From the Crowd

Upload your resume and get instant feedback on how well it matches this job.

Upload and Match Resume

What This Job Offers

Job Type

Full-time

Career Level

Mid Level

Education Level

Bachelor's degree

Number of Employees

5,001-10,000 employees

© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service