AWS Data engineer + Databricks AWS Realty Data

Cloudious • Quincy, MA

8h

About The Position

We are seeking a Data Engineer to help design, build, and scale a modern Realty Data Platform on AWS and Databricks. This role will be responsible for developing data pipelines, integrating data from multiple internal and external sources, and creating trusted datasets that support analytics, reporting, and AIML-driven insights across the Real Estate organization. The ideal candidate combines strong hands-on data engineering skills with experience in cloud-native architectures, large-scale data processing, and modern lakehouse platforms.

Requirements

• Strong experience building ETL/ELT pipelines.
• Proficiency in Python, PySpark, and SQL.
• Experience working with Apache Spark and distributed data processing frameworks.
• Knowledge of data modeling, data quality, and data transformation techniques.
• Hands-on experience with the Databricks Lakehouse Platform.
• Experience with Delta Lake, Databricks Workflows, and Unity Catalog.
• Ability to develop, optimize, and troubleshoot Databricks notebooks and jobs.
• Experience with AWS data services such as Amazon S3, AWS Glue, Lambda, IAM, event-driven integrations, and APIs.
• Understanding of cloud-native data architecture patterns.
• Experience integrating data through REST APIs, JDBC connections, batch file transfers, or streaming mechanisms.
• Familiarity with structured, semi-structured, and unstructured data formats including JSON, CSV, and Parquet.
• Experience preparing and engineering datasets for machine learning and AI workloads.
• Understanding of AIML concepts, feature engineering, and model lifecycle processes.
• Mandatory Skills: Databricks

Nice To Haves

• Exposure to Databricks ML, MLflow, vector search, or Generative AI capabilities is a plus.

Responsibilities

• Design, build, and scale a modern Realty Data Platform on AWS and Databricks.
• Develop data pipelines.
• Integrate data from multiple internal and external sources.
• Create trusted datasets that support analytics, reporting, and AIML-driven insights across the Real Estate organization.
• Prepare and engineer datasets for machine learning and AI workloads.
• Collaborate with business teams to identify opportunities for predictive analytics, trend analysis, document intelligence, and operational insights.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed