Sr, Data Engineer

Yusen Logistics • Memphis, TN

2h

About The Position

We are seeking a talented and highly motivated SQL and NoSQL Developer/Data Streaming Engineer to join our dynamic team. The ideal candidate should have a strong background in software development experience with SQL Server, PostgreSQL, non-SQL DB systems and data streaming technology. As a Sr. SQL Developer/Data Engineer, you will be responsible for designing, developing, and maintaining the company's data systems including data replications and data streaming pipelines, as well as supporting ongoing data integration and analysis efforts, to ensure the availability and consistent performance of our corporate applications. This is a “hands-on” position requiring solid technical skills to build our next-generation messaging capabilities to deliver business events with low-latency to support near real-time processing and distribution of data.

Requirements

• Bachelor's Degree or higher in an Information Technology discipline or related field of study and minimum of eight years of work experience designing, programming, and supporting software programs or applications.
• 6 years of experience in database development and data streaming.
• Exceptional technical expertise in architectural design, development, and implementation with specialization in multiple technology disciplines, platforms, and applications
• Experience developing streaming application solutions.
• Strong experience with SQL Server, PostgreSQL, and proficiency with T-SQL
• Experience with NoSQL DB system, such as Cassandra is a plus.
• Knowledge and experience with open stack technologies, have prior experience in working with Kafka, Spark/Flink, NiFi, HDFS, Hive, Cassandra, Druid, and other big data projects
• Proficiency with Python is a plus.
• Deep understanding of Private and Public Cloud Architectures
• Experience with data integration and ETL processes.
• Strong problem-solving skills and attention to detail.
• Excellent communication and interpersonal skills.
• Ability to work independently and as part of a team.

Responsibilities

• Collaborate with DBA team and other IT teams, perform data modeling and stream design to ensure that databases and data streams meet data needs of our applications and integrations.
• Implement scalable integrations with third party systems to be able to support a high volume real- time streaming data ingestion platform.
• Develop generic and custom parsers to ingest data from different platforms
• Develop data streaming pipelines using technologies such as Apache Kafka, Apache NiFi, and Apache Spark.
• Monitor and maintain data streaming pipelines, ensuring high availability and timely delivery of data.
• Troubleshoot and resolve issues with databases and data streams.
• Stay up to date with new technologies and best practices in database development and data streaming.
• Write code for new features or/and feature enhancement, including SQL server stored procedures, views, functions, triggers, queries, SQL scripts and ETL processes.
• Improve existing code to fix defects, improve DB performance, ensure data security & integrity, and eliminate technical debt.
• Thrive in a DevOps culture environment with frequent releases where developers are responsible from requirements analysis to production deployment and production support.
• Develop high-quality code, define best engineering practice, perform peer code reviews to ensure successful deliverable with engineering excellence.
• Monitor System health and proactively correct any potential issues.
• Monitor Job activity and provide prompt production support.
• Create and maintain SQL server replication chains on multiple servers, and debug replication errors.
• Document the process using the company standard.

Benefits

• Yusen offers a generous Employee Benefits Package including:
• Medical, Dental, and Vision beginning the 1st of the month following start date
• 401k with a company match
• Standard 10 days PTO
• Eligible for bonus plan
• 7 Paid Holidays
• Eligble for OT pay if applicable
• Flexible Spending Accounts, Life and Accidental Death & Dismemberment Insurance, Short & Long Term Disability, Tuition Assistance Program, Commuter Benefits, vacation, and much more
• Any and all benefits offered are subject to the eligibility requirements, terms, and provisions set forth in the respective policies and plan documents, which you may request from Human Resources.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level