Senior Specialist - Data Engineering

LTIMindtree • Dallas, TX

69d

About The Position

Seeking a Senior Specialist with 7 to 11 years of experience in Python and data technologies including Flask, Apache Spark, Scala, and Nginx to design and implement scalable data-driven solutions. Develop and maintain high-performance data processing applications using Apache Spark and Scala. Build and deploy RESTful APIs and web services using the Flask framework. Utilize Python extensively for data manipulation, automation, and integration tasks. Configure and optimize Nginx as a reverse proxy and load balancer for web applications. Collaborate with cross-functional teams to design scalable data architectures within the Python Data skill cluster. Ensure code quality, performance, and reliability through rigorous testing and best practices. Stay updated with the latest trends and advancements in data engineering and Python ecosystems. Lead the design and development of data processing pipelines leveraging Apache Spark and Scala. Architect and implement backend services and APIs using Flask to support data-driven applications. Manage deployment and configuration of Nginx servers to ensure high availability and security. Mentor junior developers and provide technical guidance in Python and related technologies. Work closely with data scientists, analysts, and product teams to translate requirements into technical solutions. Optimize existing data workflows for performance and scalability. Participate in code reviews, troubleshooting, and resolving complex technical issues.

Requirements

• 7 to 11 years of experience in Python and data technologies.
• Proficiency in Flask, Apache Spark, Scala, and Nginx.
• Experience in building and deploying RESTful APIs.
• Strong knowledge of data manipulation and automation using Python.
• Ability to configure and optimize Nginx for web applications.
• Experience in collaborating with cross-functional teams.
• Strong understanding of data architectures and workflows.

Nice To Haves

• Experience with Django.
• Familiarity with Jupyter Notebook.
• Knowledge of data science principles.

Responsibilities

• Develop and maintain high-performance data processing applications using Apache Spark and Scala.
• Build and deploy RESTful APIs and web services using Flask framework.
• Utilize Python extensively for data manipulation, automation, and integration tasks.
• Configure and optimize Nginx as a reverse proxy and load balancer for web applications.
• Collaborate with cross-functional teams to design scalable data architectures.
• Ensure code quality, performance, and reliability through rigorous testing and best practices.
• Lead the design and development of data processing pipelines leveraging Apache Spark and Scala.
• Architect and implement backend services and APIs using Flask.
• Manage deployment and configuration of Nginx servers.
• Mentor junior developers and provide technical guidance.
• Work closely with data scientists, analysts, and product teams.
• Optimize existing data workflows for performance and scalability.
• Participate in code reviews and troubleshoot complex technical issues.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Industry: Professional, Scientific, and Technical Services
• Number of Employees: 5,001-10,000 employees