Senior Data Engineer/Architect - Databricks

Greystar•Columbia, SC

3d•Remote

About The Position

We are looking for a skilled Data Engineer to join our engineering team, focusing on leveraging Azure SQL, Cosmos DB & DataBricks to meet our growing data demands. As a Sr. data engineer in the Apex organization, you will be part of the Scrum team, developing data capabilities powering customer-facing applications used by thousands of residents. You will play a critical role in supporting the data needs of the engineering team as you develop and optimize the backend for customer-facing real estate applications.

Requirements

6+ years relevant and progressive data engineering experience
Deep Technical knowledge and experience in Microsoft Azure architecture, including Azure PaaS databases, Synapse, ADF pipelines, Azure functions, Event Grids etc.
3+ Years of Experience with Cosmos DB
3+ Years of Experience with Data Bricks
Hands-on skills working with data pipelines using SQL and No-SQL databases
Minimum of 1 year of relevant experience working with Azure Data Lakes Gen 2.
Experience with Power Platform / Power BI
Experience in engineering practices such as code refactoring, design patterns, CI/CD, and highly scalable data applications
Experience developing batch ETL pipelines; real-time pipelines are a plus
Knowledge of advanced data engineering concepts such as dimensional modeling, ETL, data governance, data warehousing, structured and unstructured data
Good Experience with Python, machine learning frameworks and statistics.
Knowledge of Agile software development process
Excellent problem-solving skills and experience
Strong communication and collaboration skills
"Self-starter" attitude and the ability to make decisions with minimal guidance from others
Innovative and passionate about your work and the work of your teammates
Ability to comprehend and analyze operational systems and ask appropriate questions to determine how to improve, migrate or modify the solution to meet business needs
Bachelor’s Degree in computer science, information technology, business management, information systems, or equivalent experience.

Nice To Haves

Experience / Familiarity with D365 Customer Insights platform / Dataverse is a plus
Databricks or other Certifications are nice to have but not required.
Advanced degree preferred

Responsibilities

100% hands-on development – Azure SQL, Cosmos DB, DataBricks: develop and unit test database code, including but not limited to T-SQL, stored procedures, functions and views.
Own/Maintain the DataBricks data ingestion & output for our Microsoft Customer Insights CDP platform
Create and maintain database structures.
Participate in the design of databases, using first, second or third normalized form as needed to support business requirements.
Create, deploy, and maintain ADF pipelines, adhering to Greystar’s standards and documented best practices.
Monitor database performance, identify bottlenecks and implement improvements to ensure scalable and reliable database operations in a production environment.
Perform analysis of complex data and document findings.
Prepare data for prescriptive and predictive modeling.
Combine raw data from different external sources and build and support complex ingestions
Collaborate with application developers/data analysts who will be consuming the data.
Play a direct role in the maintenance, technical support, documentation, and administration of databases.
Ensure standards are followed by participating in code reviews
You are a thought leader who will bring up new ideas or methods and deliver awesome code

Benefits

100% Remote flexibility!
Competitive pay, benefits, and overall compensation packages.
The chance to be part of a technology team for a thriving organization that prioritizes accountability, respect, and operational excellence!
The opportunity to join a thriving, highly visible organization during its technology transformation!
Competitive Medical, Dental, Vision, and Disability & Life insurance benefits.
Low (free basic) employee Medical costs for employee-only coverage; costs discounted after 3 and 5 years of service.
Generous Paid Time off.
All new hires start with 15 days of vacation, 4 personal days, 10 sick days, and 11 paid holidays.
Plus your birthday off after 1 year of service!
Additional vacation accrued with tenure.
For onsite team members, onsite housing discount at Greystar-managed communities are available subject to discount and unit availability.
6-Week Paid Sabbatical after 10 years of service (and every 5 years thereafter).
401(k) with Company Match up to 6% of pay after 6 months of service.
Paid Parental Leave and lifetime Fertility Benefit reimbursement up to $10,000 (includes adoption or surrogacy).
Employee Assistance Program.
Critical Illness, Accident, Hospital Indemnity, Pet Insurance and Legal Plans.
Charitable giving program and benefits.