Data Bricks & Pyspark Software Engineer II

JPMorgan Chase

87d

About The Position

We have an exciting and rewarding opportunity for you to take your software engineering career to the next level. As a Software Engineer III at JPMorganChase within the ENTERPRISE TECHNOLOGY(EMPLOYEE DIGITAL AND SERVICE EXP), you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a secure, stable, and scalable way. You are responsible for carrying out critical technology solutions across multiple technical areas within various business functions in support of the firm's business objectives.

Requirements

• Formal training or certification in software engineering concepts with 2+ years of applied experience.
• 3+ years in data engineering, including design, application development, testing, and operational stability.
• Advanced proficiency in data processing frameworks and tools, including Parquet, Iceberg, PySpark, Glue, Lambda, Databricks, and AWS data services like EMR, Athena, and Redshift.
• Proficiency in programming languages like Python, Java, or Scala for data processing and application development.
• Proficiency in automation and continuous delivery methods, utilizing CI/CD pipelines with tools like Git/Bitbucket, Jenkins, or Spinnaker for automated deployment and version control.
• Hands-on practical experience delivering system design, application development, testing, and operational stability.
• Understanding of agile methodologies, application resiliency, and security.
• Demonstrated proficiency in software applications and technical processes within technical disciplines like cloud, artificial intelligence, machine learning, and mobile.
• Proficiency in database management and data modeling, working with relational databases like Oracle or SQL Server.

Nice To Haves

• AWS Certification
• Databricks Certification
• Experience with scheduling tools like Autosys & Airflow to automate and manage job scheduling for efficient workflow execution.
• In-depth knowledge of the financial services industry and their IT systems.

Responsibilities

• Execute creative software and data solutions, including design, development, and technical troubleshooting, by thinking beyond routine approaches to build solutions or break down technical problems.
• Develop secure, high-quality production code and data pipelines, reviewing and debugging processes implemented by others.
• Identify opportunities to eliminate or automate remediation of recurring issues to improve operational stability of software applications and systems.
• Work with business stakeholders to understand requirements and design appropriate solutions, producing architecture and design artifacts for complex applications.
• Implement robust monitoring and alerting systems to proactively identify and address data ingestion issues, optimizing performance and throughput.
• Implement data quality checks and validation processes to ensure accuracy and reliability of data.
• Help design and implement scalable data frameworks to manage end-to-end data pipelines for workforce data analytics.
• Gather, analyze, and synthesize large, diverse data sets to continuously improve capabilities and user experiences, leveraging data-driven insights.

What This Job Offers

• Career Level: Mid Level
• Industry: Credit Intermediation and Related Activities