Senior Data Engineer - Apartments.com
About The Position
Apartments.com is seeking a Senior Data Engineer to help accelerate its growth by building sitewide tracking architecture and turning collected data into user-friendly KPI dashboards that track site performance and product usage and provide insights into consumer behavior. The role contributes to Apartments.com’s data engineering architecture and works across departments to deliver analysis and insights that support future growth. It spans data management, including designing and maintaining automated data infrastructure, delivering data engineering and analytics solutions, and facilitating data access and analysis for key teams. The role designs and oversees dimensional modeling, database design, and cloud data platform structures; builds secure data warehouses and lakehouses; and develops scalable pipelines and ETL processes using Databricks, Snowflake, and AWS services. It also involves implementing Spark workflows and AI/ML models, applying AI-assisted software development practices, integrating data from disparate domains, and implementing governance, lineage, testing, and monitoring. The engineer collaborates with software engineering, product, DBA, DevOps, and SecOps teams, mentors engineers and analysts, and delivers projects to specification, schedule, and budget. CoStar Group expects successful candidates to be willing to learn, adopt, and responsibly apply AI technologies to engineering and business challenges. The position is based in Irvine, California, with an in-office schedule Monday through Thursday and work from home on Fridays.
Requirements
- Bachelor's degree from an accredited, not-for-profit, in-person college or university.
- Track record of commitment to prior employers.
- At least 6 years of hands-on software development experience delivering high-quality solutions.
- Strong data engineering skills and proficiency in Python, PySpark, and SQL.
- Solid foundation in object-oriented programming principles and best practices.
- Demonstrated success building and launching data-driven products at terabyte scale.
- Proven experience designing and implementing enterprise-level secure and accurate data platforms.
- Ability to translate technical requirements into robust architecture, data models, and ETL strategies.
- Practical experience with cloud-based relational and non-relational databases.
- Knowledge of business intelligence software such as Power BI or similar tools.
- Understanding of AI technologies and hands-on experience using AI tools in development, such as Claude Code, GitHub Copilot, Cursor, Gemini, or Grok.
- Ability to retrieve, synthesize, and present critical data in structures that answer specific ad hoc questions.
- Hands-on experience with data optimization, data quality checks, data accuracy, and query performance improvement.
- Currently eligible to work full-time in the United States; visa sponsorship is not available.
Nice To Haves
- Hands-on experience or familiarity with big data platforms such as Databricks or Snowflake.
- Proficiency with cloud platforms, including AWS or Azure.
- Experience with NoSQL databases such as DynamoDB and object storage systems such as Amazon S3 or GCS.
- Practical knowledge of event streaming technologies, especially Kafka.
- Experience leveraging AWS compute and container services for scalable solutions.
- Familiarity with large language models, prompt engineering, or agent-based architectures.
- Strong analytical and problem-solving skills for complex technical challenges.
- Ability to understand complex technical challenges and designs and communicate them as clear business ideas or solutions to senior management and stakeholders.
Responsibilities
- Design and oversee implementation of dimensional modeling, database design, and cloud data platform structures, such as Databricks, Snowflake, and BigQuery.
- Develop data platform frameworks for secure data warehouses and data lakehouses using Medallion Architecture principles.
- Design, develop, and maintain scalable data pipelines and ETL processes using Databricks, Snowflake, and AWS services.
- Implement and optimize Spark jobs, data transformations, and data processing workflows in Databricks.
- Build and deploy AI/ML models, integrating machine learning into data pipelines and using Databricks ML and AWS ML to develop predictive models and business insights.
- Define and apply AI-assisted software development practices to improve engineering productivity and code quality.
- Understand data domains and translate them through data transformations to serve business needs.
- Oversee automated data infrastructure and collaborate with software engineering and product teams to streamline data tracking in products.
- Integrate data from disparate sources across domains into existing data models.
- Implement data governance, lineage tracking, testing, and monitoring frameworks to ensure data integrity.
- Optimize data and improve query performance.
- Work with DBA, DevOps, SecOps, and other company teams to support data accessibility and analysis.
- Mentor and manage engineers and analysts in their regular responsibilities.
- Implement software development projects to specification and within scheduled timelines and budget parameters.
- Use AWS DevOps and CI/CD best practices, including Terraform, to automate deployment and management of data pipelines and infrastructure.
Benefits
- Generous compensation and performance-based incentives.
- Internal training and tuition reimbursement.
- Medical, vision, dental, and prescription drug coverage.
- Life, legal, and supplementary insurance.
- Virtual and in-person mental health counseling for individuals and families.
- Commuter and parking benefits.
- 401(k) retirement plan with matching contributions.
- Employee stock purchase plan.
- Paid time off.
- On-site fitness center and/or reimbursed fitness center membership costs, depending on location; amenities may include a yoga studio, Pelotons, personal training, and group exercise classes.
- Access to Diversity, Equity, & Inclusion Employee Resource Groups.
- Complimentary gourmet coffee, tea, hot chocolate, fresh fruit, and other healthy snacks.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
