Software Engineer II - Data Engineer
About The Position
This job is responsible for developing and delivering complex requirements to accomplish business goals. Key responsibilities of the job include ensuring that software is developed to meet functional, non-functional and compliance requirements, coding solutions, unit testing, and ensuring the solution can be integrated successfully into the overall application/system with clear, robust, and well-tested interfaces. Job expectations include an awareness of development and testing practices in the industry. This is a Data Streaming and Engineering role supporting a new initiative. The Platform Engineering team will be building a streaming Platform for Consumer, Small Business, Wealth Management and Fraud use cases and partners. Candidate must possess a passion for producing high quality software and solutions, be ready to jump in and solve complex problems, and interact with users to understand the requirements and deliver solutions as a design-build-run engineer.
Requirements
- 5+ years of hands-on experience in Kafka, Streaming and Hadoop ecosystem
- Strong understanding of OOP fundamentals in either Java or Python
- Experience managing and leading Agile development teams in an Agile environment
- Drive and maintain a culture of quality, innovation and experimentation
- Collaborate with product teams, data analysts and data scientists to design and build data-forward solutions
- Provide the prescriptive point-solution architectures and guide the descriptive architectures within assigned modules.
- Accountable for the availability, stability, scalability, security, and recoverability enabled by the designs
- Own technical decisions for the solution and application developers in the creation of architectural decisions and artifacts.
- Ability to clearly communicate with team & stakeholders
- Experience working on Agile teams
- Excellent verbal and written communication skills
Nice To Haves
- Extensive hands on experience in designing, developing, and maintaining software solutions in Big Data and Streaming Platforms using Kafka and Spark.
- Knowledge of processing and deployment technologies such YARN, Linux and Containers
- Experience programming and building full stack solutions utilizing distributed computing
- Hands on experience in designing, developing, and maintaining nRT software frameworks using, Spark, Hadoop MR, Kafka, Java/Scala/Python etc.
Responsibilities
- Codes solutions and unit test to deliver a requirement/story per the defined acceptance criteria and compliance requirements
- Utilizes multiple architectural components (across data, application, business) in design and development of client requirements
- Performs Continuous Integration and Continuous Development (CI-CD) activities
- Contributes to story refinement and definition of requirements
- Participating in estimating work is necessary to realize a story/requirement through the delivery lifecycle
- Contributes to existing test suites (integration, regression, performance), analyze test reports, identify any test issues/errors, and triage the underlying cause
- Performs spike/proof of concept as necessary to mitigate risk or implement new ideas
- Develop high end Streaming solution
- Resolve production issues on time
- Coordinate with partner teams and LOB
- Participating in architectural sessions
- Provide Deployment support
- Manage Risks
Benefits
- affordable, competitive and flexible benefits
- competitive benefits to support their physical, emotional, and financial well-being
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
