Lead Software Engineer in Irving, TX

U.S. Bank•Irving, TX

3d•Hybrid

About The Position

U.S. Bank is seeking the position of Lead Software Engineer in Irving, TX. The Lead Software Engineer will be responsible for architecting and designing data products for Customer 360 users; partnering with the Product team to understand new analytics needs and design, build data pipelines; coaching team in building data pipelines in Scala Spark as per engineering standards; identifying data classification of a given project and work with BISO in define security strategy of the application and data; building CICD pipelines for Customer 360 Projects using GitLab CI and Jenkins; building Build Data pipeline in On-prem Hadoop platform using spark (scala , python & SQL) based pipelines with Dataframe APIs and spark-SQL; and developing Azure Cloud based data pipelines using Spark on Kubernetes, storing the data in delta tables, and orchestrating them using Airflow or Azure Synapse as a Semantic layer. Migrate mainframe application to Azure platforms by leveraging technologies (e.g., COBOL, JCL, VSAM, DB2). Implement data quality checks, monitoring, and alerting mechanisms using Datadog, Splunk, Grafana, InfluxDB, and ServiceNow. Build test suites and make sure coverage is minimum 90% and keep code smells under 5 thru sonarQube. Perform POCs on Gen-AI implementation such as gitlab co-pilot, RAG and Agentic AI. Position may allow working from home within commuting distance of worksite location. Multiple positions.

Requirements

Requires a Bachelor’s degree (or foreign equivalent) in Computer Science, Computer Information Systems, or Electrical and Electronic Engineering, plus 5 years of progressive, post-baccalaureate experience as a Data Engineer, Software Engineer, or related
5 years of experience with: architecting and designing data pipelines and application and build integration between mainframe and spark/Hadoop echo system
5 years of experience with: creating reusable components to be used in multiple pipelines
5 years of experience with: developing application health check dashboard and monitors using Datadog, Splunk & Grafana
5 years of experience with: defining Metadata of a given dataset
5 years of experience with: building CICD pipelines for TLRC projects using Jenkins/Drone
5 years of experience with: data quality checks and processes created for every pipeline
5 years of experience with: performing Code reviews on pull requests
5 years of experience with: implementing data quality monitors and creating automated alert on Service-now
5 years of experience with: Performance tuning on spark data pipelines
Utilizing the following tools and technologies: Spark; Scala; Python; ADLS Gen2; ADF; Delta-tables; Databricks; Synapse (Dedicated/ Serverless); HiveQL; SparkSQL; HadoopMapReduce; HDFS; GIT; Airflow; Jira; Sqoop; Postgres; Shell Script; Influx DB; DataDog; Splunk sonarQube; Grafana;Gen-AI; Agentic AI; RAG; COBOL; JCL; DB2; and VSAM
Experience may be gained concurrently
This position is not eligible for visa sponsorship

Responsibilities

Architecting and designing data products for Customer 360 users
Partnering with the Product team to understand new analytics needs and design, build data pipelines
Coaching team in building data pipelines in Scala Spark as per engineering standards
Identifying data classification of a given project and work with BISO in define security strategy of the application and data
Building CICD pipelines for Customer 360 Projects using GitLab CI and Jenkins
Building Build Data pipeline in On-prem Hadoop platform using spark (scala , python & SQL) based pipelines with Dataframe APIs and spark-SQL
Developing Azure Cloud based data pipelines using Spark on Kubernetes, storing the data in delta tables, and orchestrating them using Airflow or Azure Synapse as a Semantic layer
Migrate mainframe application to Azure platforms by leveraging technologies (e.g., COBOL, JCL, VSAM, DB2)
Implement data quality checks, monitoring, and alerting mechanisms using Datadog, Splunk, Grafana, InfluxDB, and ServiceNow
Build test suites and make sure coverage is minimum 90% and keep code smells under 5 thru sonarQube
Perform POCs on Gen-AI implementation such as gitlab co-pilot, RAG and Agentic AI

Benefits

Healthcare (medical, dental, vision)
Basic term and optional term life insurance
Short-term and long-term disability
Pregnancy disability and parental leave
401(k) and employer-funded retirement plan
Paid vacation (from two to five weeks depending on salary grade and tenure)
Up to 11 paid holiday opportunities
Adoption assistance
Sick and Safe Leave accruals of one hour for every 30 worked, up to 80 hours per calendar year unless otherwise provided by law
incentive and recognition programs
equity stock purchase
401(k) contribution and pension (all benefits are subject to eligibility requirements)