Senior Big Data Operations Engineer (002482)
About The Position
Wells Fargo Bank N.A. is seeking a Senior Big Data Operations Engineer to support Risk Data Services (RDS), an on-premises Hortonworks multi-tenant big data platform. RDS provides integrated data and compute, storage, tools, and capabilities for tenants supporting risk management, monitoring, and reporting across multiple risk areas. The engineer will lead moderately complex technical initiatives and deliverables, contribute to strategy planning, and design, code, test, debug, and document technology projects, upgrades, and deployments. The role reviews and resolves technical challenges, leads projects, serves as an escalation point, and provides guidance to less experienced staff. It supports tenant teams with compute queues, storage, data onboarding, and job processing, and provides end-to-end support for platform processes and services. The engineer will also support migration from existing infrastructure to new data centers, coordinating tenant-team designs and migrations to meet timelines while supporting legacy environments. The position is based in Charlotte, North Carolina. Telecommuting is permitted up to two days per week, but the employee must appear in person at the listed work address. Travel is not required.
Requirements
- Bachelor's degree in Electronic Engineering or a related technical field.
- Four years of experience in the job offered or in a related position involving software engineering.
- Four years of hands-on experience with Hadoop.
- Four years of experience with MongoDB.
- Three years of experience with Python, Unix/Shell scripting, or Spark.
- Three years of experience with Autosys.
- Two years of experience with Dremio.
- Two years of experience setting up monitoring dashboards through Grafana or Prometheus.
- One year of experience with Kubernetes.
- One year of experience with Azure or GCP.
Responsibilities
- Lead moderately complex initiatives and deliverables within technical domain environments.
- Contribute to large-scale strategy planning.
- Design, code, test, debug, and document technology projects and programs, including upgrades and deployments.
- Evaluate and resolve moderately complex technical challenges involving technologies and procedures.
- Lead a team to address existing or potential client needs while applying relevant functional knowledge, policies, procedures, and compliance requirements.
- Collaborate with peers, colleagues, and mid-level managers to resolve technical challenges and achieve goals.
- Lead projects, act as an escalation point, and guide less experienced staff.
- Support application tenant teams in setting up compute queues and storage, bringing in data, and processing it through jobs.
- Provide end-to-end support for processes and services in the big data environment.
- Support migration from current infrastructure to new data centers, including designing and migrating tenant teams within specified timelines and supporting legacy environments.
- Execute applicable risk programs and obligations, follow policies and procedures, escalate and remediate issues, and make sound risk decisions.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
