Sr Software Engineer - BigQuery

PayPalChicago, IL
1d

About The Position

Delivers complete solutions spanning all phases of the Software Development Lifecycle (SDLC) (design, implementation, testing, delivery and operations), based on definitions from more senior roles. Advises immediate management on project-level issues Guides junior engineers Operates with little day-to-day supervision, making technical decisions based on knowledge of internal conventions and industry best practices Applies knowledge of technical best practices in making decisions Own BigQuery-backed datasets and pipelines used for reporting, reconciliation, and external data delivery Design data models and access patterns that support accurate, auditable representation of credit assets Optimize BigQuery performance, cost, and reliability using partitioning, clustering, and query tuning Build and operate real-time and near-real-time pipelines using Pub/Sub, batch or streaming frameworks, and Java services Leverage Dataproc for large-scale data processing and synchronization across BigQuery tables Build Java-based backend services and RESTful APIs supporting credit and asset externalization workflows Ensure strong observability, data quality controls, and operational readiness across services and data workflows Partner with product, finance, risk, compliance, and engineering teams to deliver secure and compliant solutions Influence platform architecture and best practices through design reviews and technical leadership

Requirements

  • 3+ years relevant experience and a Bachelor's degree OR Any equivalent combination of education and experience.
  • Query execution plans and performance tuning
  • Table partitioning and clustering strategies
  • Partition sizing and cost versus performance tradeoffs
  • Bulk updates, real-time updates and deletes, and materialized views
  • Experience designing and operating real-time and near-real-time data pipelines
  • Proficiency in Java, including designing and building RESTful APIs using Spring Boot or similar frameworks
  • Strong experience with logging, monitoring, and observability, including dashboards, alerting, and production troubleshooting
  • Proficiency with IAM, service accounts, and data access controls, including data localization and compliance requirements
  • Ability to design scalable, reliable systems with a strong focus on correctness, performance, and operational excellence
  • Strong communication skills and the ability to collaborate across engineering and cross-functional teams
  • Experience building systems that support financial reporting, reconciliation, or external data sharing
  • Familiarity with regulated environments and auditability requirements
  • Experience with modern data architectures such as Data Lakes, Data Mesh, or Data Fabric
  • Background in payments, credit, or financial services

Responsibilities

  • Own BigQuery-backed datasets and pipelines used for reporting, reconciliation, and external data delivery
  • Design data models and access patterns that support accurate, auditable representation of credit assets
  • Optimize BigQuery performance, cost, and reliability using partitioning, clustering, and query tuning
  • Build and operate real-time and near-real-time pipelines using Pub/Sub, batch or streaming frameworks, and Java services
  • Leverage Dataproc for large-scale data processing and synchronization across BigQuery tables
  • Build Java-based backend services and RESTful APIs supporting credit and asset externalization workflows
  • Ensure strong observability, data quality controls, and operational readiness across services and data workflows
  • Partner with product, finance, risk, compliance, and engineering teams to deliver secure and compliant solutions
  • Influence platform architecture and best practices through design reviews and technical leadership
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service