This job is no longer available
There are still lots of open positions. Let's find the one that's right for you.
As a Software Engineer at UBS Business Solutions US LLC in Morrisville, NC, you will be responsible for designing and developing large-scale data models and data pipelines leveraging Apache Spark, Scala, Pyspark on Cloudera Hadoop big data environment and Azure cloud. You will build and maintain data pipelines and ETL workflows using Spark Core, Spark SQL, and Spark Streaming. Additionally, you will implement data processing solutions utilizing Hive, Impala, and Sqoop on Hadoop Distributed File System (HDFS). Your role will also involve optimizing data storage and retrieval using various file formats (Parquet, ORC, Kudu, and Avro) and data compression techniques. You will utilize Agile methodologies and Atlassian tools (Jira, Confluence, and Bitbucket) to manage and version control big data projects, perform advanced data analysis using complex SQL queries and data visualization techniques, and architect data pipelines on cloud-based platforms (Microsoft Azure) using respective data technologies (Azure Data Factory, Data Lake Storage, and Data Bricks). Furthermore, you will integrate applications on Azure cloud, leverage Azure Data Bricks for data processing and analytics, utilize PySpark for scalable data processing, and work with Apache Airflow for workflow orchestration and scheduling. Your expertise will also include data modeling and big data engineering, DevOps and Automation tools (Terraform, OpenShift, Jenkins, Git, and Apache Airflow), and Python.
