Senior Data Engineer

ACV Auctions•Buffalo, NY

63d•$130,000 - $170,000

About The Position

We are seeking a talented data/database professional as a Senior Data Engineer to join our Data Engineering team. This role requires a strong focus and experience in software development, cloud based technologies and a strong desire to learn complex systems and new technologies. It requires a sound foundation in database and infrastructure architecture, deep technical knowledge, excellent communication skills, and an action-based philosophy to solve hard software engineering problems. As part of the Data Engineering team you will be responsible for maintaining and extending our database options, optimizing SQL queries, collaboration with teams on database support, and designing scalable data services. You will solve complex database challenges, be a key player in continually improving our databases, and work well in a rapidly growing changing engineering workplace.

Requirements

Ability to read, write, speak and understand English.
Bachelor's degree in computer science, Information Technology, or a related field (or equivalent work experience)
5+ years of experience building & supporting the database tier of SaaS web applications
2+ years of experience with Cloud platforms preferably in AWS
In-depth knowledge of database architecture, performance tuning, and optimization techniques.
Hands-on experience with database replication, clustering, and high availability solutions.
Strong proficiency in SQL query writing and optimization.
Familiarity with database security principles and best practices.
Experience with database monitoring and diagnostic tools, preferably Data Dog.
Strong hands-on skills and the ability to drill deep into the complex system design and implementation.
Strong communication and collaboration skills, with the ability to work effectively in a fast paced global team environment.
ETL workflow implementation (Airflow, Python)
Experience working with: SQL data-layer development experience; OLTP schema design
Using and integrating with cloud services, specifically: AWS RDS, Aurora, S3, GCP
Github, Jenkins,BigQuery, Redis, Python

Nice To Haves

Experience with Airflow, Docker, Visual Studio, Pycharm
Experience with database management/administration with Postgres and/or MySQL
Knowledge of data warehousing concepts and technologies, including dimensional modeling and ETL frameworks

Responsibilities

Actively and consistently support all efforts to simplify and enhance the customer experience.
Maintain and extend (as required) existing database operations solutions for backups, index defragmentation, data retention, etc.
Influence company wide engineering standards for tooling, languages, and build systems.
Design, implement, and maintain scalable and high-performance data infrastructure solutions, with a primary focus on data.
Contribute, influence, and set standards for all technical aspects of a product or service including but not limited to, testing, debugging, performance, and languages.
Troubleshoot any Web Service or ETL stack (Python, Web APIs) outages during our operational support window.
Leverage monitoring tools to ensure high performance and availability; work with operations and engineering to improve as required.
Ensure existing HADR (availability groups) solution is functional and meets requirements.
Support development stages for application development and data science teams, emphasizing in Postgres database development.
Ensure that data development meets company standards for readability, reliability, and performance.
Collaborate with software and DevOps engineers to design scalable services, plan ature roll-out, and ensure high reliability and performance of our products.
Collaborate with internal teams on transactional and analytical schema design.
Conduct code reviews, develop high-quality documentation, and build robust test suites.
Own the overall performance of products and services within a defined area of focus.
Respond-to and troubleshoot highly complex problems quickly, efficiently, and effectively. This may include being part of the emergency after-hours on-call rotation.
Mentor junior data engineers.
Perform additional duties as assigned.