Lead Software Engineer in Irving, TX
About The Position
U.S. Bank is seeking the position of Lead Software Engineer in Irving, TX. The Lead Software Engineer will be responsible for architecting and designing data products for Customer 360 users; partnering with the Product team to understand new analytics needs and design, build data pipelines; coaching team in building data pipelines in Scala Spark as per engineering standards; identifying data classification of a given project and work with BISO in define security strategy of the application and data; building CICD pipelines for Customer 360 Projects using GitLab CI and Jenkins; building Build Data pipeline in On-prem Hadoop platform using spark (scala , python & SQL) based pipelines with Dataframe APIs and spark-SQL; and developing Azure Cloud based data pipelines using Spark on Kubernetes, storing the data in delta tables, and orchestrating them using Airflow or Azure Synapse as a Semantic layer. Migrate mainframe application to Azure platforms by leveraging technologies (e.g., COBOL, JCL, VSAM, DB2). Implement data quality checks, monitoring, and alerting mechanisms using Datadog, Splunk, Grafana, InfluxDB, and ServiceNow. Build test suites and make sure coverage is minimum 90% and keep code smells under 5 thru sonarQube. Perform POCs on Gen-AI implementation such as gitlab co-pilot, RAG and Agentic AI. Position may allow working from home within commuting distance of worksite location. Multiple positions.
Requirements
- Requires a Bachelor’s degree (or foreign equivalent) in Computer Science, Computer Information Systems, or Electrical and Electronic Engineering, plus 5 years of progressive, post-baccalaureate experience as a Data Engineer, Software Engineer, or related
- 5 years of experience with: architecting and designing data pipelines and application and build integration between mainframe and spark/Hadoop echo system
- Creating reusable components to be used in multiple pipelines
- Developing application health check dashboard and monitors using Datadog, Splunk & Grafana
- Defining Metadata of a given dataset
- Building CICD pipelines for TLRC projects using Jenkins/Drone
- Data quality checks and processes created for every pipeline
- Performing Code reviews on pull requests
- Implementing data quality monitors and creating automated alert on Service-now
- Performance tuning on spark data pipelines
- Utilizing the following tools and technologies: Spark; Scala; Python; ADLS Gen2; ADF; Delta-tables; Databricks; Synapse (Dedicated/ Serverless); HiveQL; SparkSQL; HadoopMapReduce; HDFS; GIT; Airflow; Jira; Sqoop; Postgres; Shell Script; Influx DB; DataDog; Splunk sonarQube; Grafana;Gen-AI; Agentic AI; RAG; COBOL; JCL; DB2; and VSAM
Responsibilities
- Architecting and designing data products for Customer 360 users
- Partnering with the Product team to understand new analytics needs and design, build data pipelines
- Coaching team in building data pipelines in Scala Spark as per engineering standards
- Identifying data classification of a given project and work with BISO in define security strategy of the application and data
- Building CICD pipelines for Customer 360 Projects using GitLab CI and Jenkins
- Building Data pipeline in On-prem Hadoop platform using spark (scala , python & SQL) based pipelines with Dataframe APIs and spark-SQL
- Developing Azure Cloud based data pipelines using Spark on Kubernetes, storing the data in delta tables, and orchestrating them using Airflow or Azure Synapse as a Semantic layer
- Migrate mainframe application to Azure platforms by leveraging technologies (e.g., COBOL, JCL, VSAM, DB2)
- Implement data quality checks, monitoring, and alerting mechanisms using Datadog, Splunk, Grafana, InfluxDB, and ServiceNow
- Build test suites and make sure coverage is minimum 90% and keep code smells under 5 thru sonarQube
- Perform POCs on Gen-AI implementation such as gitlab co-pilot, RAG and Agentic AI
Benefits
- Healthcare (medical, dental, vision)
- Basic term and optional term life insurance
- Short-term and long-term disability
- Pregnancy disability and parental leave
- 401(k) and employer-funded retirement plan
- Paid vacation (from two to five weeks depending on salary grade and tenure)
- Up to 11 paid holiday opportunities
- Adoption assistance
- Sick and Safe Leave accruals of one hour for every 30 worked, up to 80 hours per calendar year unless otherwise provided by law
- incentive and recognition programs
- equity stock purchase
- 401(k) contribution and pension
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
