Big Data Developer
About The Position
We are seeking a skilled Big Data Developer with 2–8 years of experience to design, develop, and maintain scalable data processing systems. The role involves building data pipelines and processing solutions with big data technologies, distributed computing, cloud platforms, and data integration tools. Work mode may be remote, hybrid, or on-site, depending on the employer. The listed job locations are Austin, Texas; Dallas, Texas; Seattle, Washington; Chicago, Illinois; and New York, New York. Candidates should have programming skills and hands-on experience with big data technologies, ETL/ELT pipelines, databases, and cloud data platforms. A bachelor's degree in a related field is preferred, though equivalent professional experience, certifications, and demonstrated technical skills may be considered. The estimated annual salary is $85,000–$160,000, depending on experience and other factors; estimates vary by employer, location, industry, and technical expertise. The employer offers competitive salary and performance-based incentives, health, dental, and vision insurance where offered, paid time off and company holidays, professional development and certification opportunities, and opportunities to work on large-scale data engineering projects. Qualified applicants from diverse backgrounds are welcome. Candidates must meet applicable U.S. work authorization requirements.
Requirements
- 2–8 years of experience.
- Proficiency in Python, Java, Scala, or SQL.
- Experience with Apache Spark, Hadoop, Hive, or Kafka.
- Understanding of distributed computing and big data architecture.
- Hands-on experience with ETL/ELT pipelines and data integration.
- Knowledge of relational and NoSQL databases.
- Familiarity with cloud data platforms and data warehouses.
- Experience with data modeling, performance tuning, and data quality.
- Strong analytical, problem-solving, and communication skills.
- Meet applicable U.S. work authorization requirements.
Nice To Haves
- Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a related field; equivalent professional experience, relevant certifications, and demonstrated technical skills may be considered.
- Experience with AWS EMR, Azure Databricks, or Google Cloud Dataproc.
- Familiarity with Apache Airflow, Delta Lake, or cloud data warehouses.
- Knowledge of real-time streaming, data lakes, and distributed storage.
- Experience with Git, Docker, CI/CD, and automated testing.
- Understanding of data governance, security, and privacy standards.
Responsibilities
- Design, develop, and maintain scalable big data applications and processing pipelines.
- Build ETL/ELT workflows to process structured and unstructured data.
- Develop data processing solutions using Apache Spark, Hadoop, and related technologies.
- Write optimized SQL queries and data transformation scripts.
- Integrate data from databases, APIs, and external sources.
- Develop real-time data streaming solutions using Apache Kafka or similar technologies.
- Work with AWS, Microsoft Azure, or Google Cloud Platform.
- Optimize data processing performance, scalability, and reliability.
- Collaborate with data engineers, data scientists, analysts, and software developers.
- Implement data quality checks, security controls, and monitoring.
- Troubleshoot data processing issues and maintain technical documentation.
Benefits
- Competitive salary and performance-based incentives.
- Health, dental, and vision insurance, where offered.
- Paid time off and company holidays.
- Professional development and certification opportunities.
- Opportunities to work on large-scale data engineering projects.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Entry Level
