Greystar-posted 3 months ago
Full-time • Mid Level
Columbia, SC
5,001-10,000 employees

The Sr. Data Engineer is responsible for designing, developing, and maintaining scalable data pipelines and systems. This role requires deep knowledge of data engineering, programming, and coding using PySpark and Object Oriented technique. The Sr Data Engineer will work on the data to ingest, transform and load into a dimensional model to be able to run any type of Analytics. The ideal candidate will have a strong understanding of data modeling, data quality, data pipelining, and other areas related to data engineering.

  • Design, develop, and maintain scalable and highly optimized data pipelines using PySpark to support data integration, transformation, and storage.
  • Design, develop and maintain data models based on the business and functional requirements for optimal reporting and analytics.
  • Ensure data quality, consistency, and accuracy within the design and development of the data pipelines.
  • Design and develop data security solution on the data models based on the legal, compliance and business needs.
  • Collaborate with the DataOps team to maintain and execute the data pipelines to ensure accuracy and timely delivery of the data to the business.
  • Collaborate with cross-functional teams, including BI/Analytics, data scientists, business analysts, product owners and business stakeholders, to understand data requirements and deliver solutions.
  • Ensure data quality and integrity through the implementation of data validation and monitoring processes.
  • Troubleshoot and resolve data-related issues in collaboration with the DataOps team and act as the L3 support for any data product delivery.
  • Stay current with industry trends and advancements in data engineering and apply best practices to improve data management processes.
  • Mentor other team members to continuously upskill the team of Data Engineers.
  • Bachelor's or advanced degree in Computer Science or Computer Engineering.
  • 5+ years of experience in data engineering, with a focus on designing and developing data pipelines and systems.
  • Proficiency in programming and coding with PySpark, Python, and SQL.
  • Expertise in Databricks and other databases.
  • Strong understanding of data modeling, data quality, and data governance practices.
  • Experience with data integration, ETL processes, and data warehousing.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication and collaboration skills, with the ability to work effectively in a team environment.
  • Experience with cloud platforms such as AWS, Azure, or Google Cloud.
  • Knowledge of MLOps and DataOps practices.
  • Familiarity with Agile software development methodologies.
  • Experience with data visualization tools and techniques.
  • Competitive Medical, Dental, Vision, and Disability & Life insurance benefits.
  • Low (free basic) employee Medical costs for employee-only coverage; costs discounted after 3 and 5 years of service.
  • Generous Paid Time off. All new hires start with 15 days of vacation, 4 personal days, 10 sick days, and 11 paid holidays.
  • Plus your birthday off after 1 year of service! Additional vacation accrued with tenure.
  • For onsite team members, onsite housing discount at Greystar-managed communities are available subject to discount and unit availability.
  • 6-Week Paid Sabbatical after 10 years of service (and every 5 years thereafter).
  • 401(k) with Company Match up to 6% of pay after 6 months of service.
  • Paid Parental Leave and lifetime Fertility Benefit reimbursement up to $10,000 (includes adoption or surrogacy).
  • Employee Assistance Program.
  • Critical Illness, Accident, Hospital Indemnity, Pet Insurance and Legal Plans.
  • Charitable giving program and benefits.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service