Data Warehouse Software Engineer III
About The Position
Babel Street is seeking an experienced Data Warehouse Software Engineer III to own, scale, and optimize their core Google Cloud Platform (GCP) data warehousing and ingestion ecosystem. This role involves architecting high-volume data ingestion pipelines into Google BigQuery, orchestrating complex workflow topologies in Apache Airflow (Cloud Composer), and maintaining the performance and reliability of the enterprise data warehouse. The engineer will collaborate with cross-functional teams to integrate diverse data sources into clean, highly available, and query-optimized data models. This is an experienced engineering role requiring strong Python skills, deep expertise across the GCP analytics stack, and hands-on experience managing and upgrading production Airflow environments.
Requirements
- Must be a U.S. Citizen due to federal government contract requirements.
- 4–7+ years of professional software development experience, with at least 3+ years focused heavily on data warehousing, cloud data pipelines, and data platform operations.
- Production-grade Python development skills for data processing, custom pipeline tooling, and API integrations.
- Hands-on experience with Apache Airflow (Cloud Composer preferred), including DAG architecture, troubleshooting, environment configuration, and platform version upgrades.
- Deep experience with the Google Cloud analytics suite—specifically BigQuery, Cloud Storage (GCS), Cloud Composer, Pub/Sub, and Cloud Functions/Run.
- Advanced understanding of BigQuery architecture, DDL/DML, partitioning, clustering, slot allocation, and query cost-control strategies.
- Proficient with Git, CI/CD pipelines, and modern software development workflows.
Nice To Haves
- Google Cloud Certified Professional Data Engineer (highly preferred).
- Experience working with multi-terabyte or billion-row datasets, unstructured web-scraped data, or streaming architectures.
- Familiarity with government compliance frameworks, IAM policy design, and data encryption standards.
Responsibilities
- Architect, build, and maintain production-grade ELT/ETL data pipelines that stream and batch high-volume, complex datasets into Google BigQuery.
- Manage, monitor, and upgrade the Apache Airflow / Cloud Composer platform. Write clean, modular, and maintainable DAGs in Python, implement custom operators/hooks, and optimize cluster performance.
- Maintain and optimize core GCP data services (BigQuery, Cloud Storage, Cloud Functions/Run, Pub/Sub, IAM). Implement advanced BigQuery performance tuning (partitioning, clustering, slot management, and query cost control).
- Develop high-performance Python scripts, API connectors, and automation tools for data extraction, schema validation, and third-party data integrations.
- Enforce strict data quality frameworks, monitoring, and automated alerting across all ingestion pipelines to ensure zero data loss and minimal latency.
- Maintain infrastructure-as-code and CI/CD deployment pipelines for data workloads using Git. Assist in architectural reviews and mentor junior engineers on data warehousing best practices.
Benefits
- Babel Street covers 85-100% monthly premium costs for Medical, Dental, Vision, Life & Disability insurances – for you and your family!
- Babel Street offers both a Traditional and Roth 401(K) with a very competitive match.
- Unlimited Flexible Leave: We trust our employees to manage their own time and balance their personal and work lives.
- Babel Street provides employees with 12 paid Federal Holidays
- Tuition Reimbursement Program for continuing education.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
