Big Data Engineer - Python/Scala, Spark, Hadoop
About The Position
Wipro Limited is a leading technology services and consulting company focused on building innovative solutions that address clients’ most complex digital transformation needs. Leveraging our holistic portfolio of capabilities in consulting, design, engineering, and operations, we help clients realize their boldest ambitions and build future-ready, sustainable businesses. With over 230,000 employees and business partners across 65 countries, we deliver on the promise of helping our customers, colleagues, and communities thrive in an ever-changing world. The Big Data Engineer role requires the ability to easily move between business, data management, and technical teams, quickly intuiting business use cases and identifying technical solutions. The role involves building robust and efficient data pipelines end-to-end with a strong focus on data quality, and utilizing Python or Scala, Spark, Hadoop platforms & tools (Hive, Airflow, NiFi, Scoop), and SQL to build Big Data products & platforms. Experience in building and deploying production-level data-driven applications and data processing workflows/pipelines, and/or implementing machine learning systems at scale in Java, Scala, or Python is also part of the role. Cloud knowledge (Databricks or AWS ecosystem) is a plus but not required.
Requirements
- Python/Scala
- Spark
- Hadoop platforms & tools (Hive, Airflow, NiFi, Scoop)
- SQL
- Hadoop Cloudera
- 3-5 Years of experience
Nice To Haves
- Cloud knowledge (Databricks or AWS ecosystem)
Responsibilities
- Ability to easily move between business, data management, and technical teams; ability to quickly intuit the business use case and identify technical solutions to enable it
- Experience building robust and efficient data pipelines end-to-end with a strong focus on data quality
- High proficiency in using Python or Scala, Spark, Hadoop platforms & tools (Hive, Airflow, NiFi, Scoop), SQL to build Big Data products & platforms
- Experience in building and deploying production-level data-driven applications and data processing workflows/pipelines
- Implementing machine learning systems at scale in Java, Scala, or Python and deliver analytics involving all phases like data ingestion, feature engineering, modeling, tuning, evaluating, monitoring, and presenting
Benefits
- Full range of medical and dental benefits options
- Disability insurance
- Paid time off (inclusive of sick leave)
- Other paid and unpaid leave options
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Education Level
No Education Listed
