Big Data Developer

San R&D Business Solutions LLC • Milton, GA

1d • Hybrid

About The Position

We are seeking an experienced Big Data Developer with strong expertise in Google Cloud Platform (GCP) and Dataflow to design, develop, and maintain scalable data processing systems. The ideal candidate will have around 8+ years of experience in Big Data technologies and a strong background in building high-performance data pipelines and distributed systems.

Requirements

• 8+ years of experience in Big Data development.
• Strong hands-on experience with: Google Cloud Platform (GCP) Cloud Dataflow Apache Beam BigQuery Cloud Storage Pub/Sub
• Strong programming skills in Java or Python.
• Experience with Apache Spark, Hadoop, Hive, or similar Big Data frameworks.
• Experience building ETL/ELT pipelines.
• Knowledge of SQL and NoSQL databases.
• Understanding of data modeling and data warehousing concepts.
• Experience with CI/CD pipelines and DevOps practices.
• Strong problem-solving and analytical skills.
• Only USC / GC
• Open to local GA candidates only

Nice To Haves

• GCP certifications (Professional Data Engineer preferred).
• Experience with Kubernetes and containerization.
• Experience in streaming technologies.
• Knowledge of Airflow or other workflow orchestration tools.
• Experience working in Agile/Scrum environments.

Responsibilities

• Design and develop scalable Big Data solutions using GCP services.
• Build and optimize data pipelines using Google Cloud Dataflow (Apache Beam).
• Work with large datasets in distributed environments.
• Develop batch and real-time data processing workflows.
• Integrate data from multiple sources (structured and unstructured).
• Optimize data processing performance and cost efficiency in GCP.
• Collaborate with data engineers, architects, and business stakeholders.
• Implement data quality checks, monitoring, and logging frameworks.
• Ensure data security, governance, and compliance standards are met.
• Troubleshoot and resolve performance bottlenecks.

What This Job Offers

• Career Level: Mid Level
• Education Level: No Education Listed