As a Senior Data Engineer at xScion, you will design, develop, and operationalize large-scale enterprise data solutions using AWS services such as S3, Glue, Athena, Lambda, RedShift, EMR, Spark, and DynamoDB. You will analyze, redesign, and re-platform on-premise data solutions from Cloudera Hadoop platforms to AWS native data stack. Your role will involve designing, developing, and deploying data pipelines from ingestion to consumption within a big data architecture using Java, Python, or Scala. You will participate in discussions related to architecture, design, and product development to understand business requirements and translate them into technical solutions. Additionally, you will take responsibility for complete user stories through analysis, design, development, and testing as per project timelines, develop and maintain scripts to automate batch jobs, and support and maintain existing applications, troubleshooting and resolving technical issues. You will also follow appropriate technical best practices and internal processes while complying with various information security controls, and maintain existing data solutions running on Hadoop stack using HDFS, Oozie, Impala, and Hive, handling some enhancements until the cloud migration.