Architect

Incedo • Austin, TX

8d

About The Position

Incedo is a US-based consulting, data science and technology services firm with over 3000 people helping clients from our six offices across US, Mexico and India. We help our clients achieve competitive advantage through end-to-end digital transformation. Our uniqueness lies in bringing together strong engineering, data science, and design capabilities coupled with deep domain understanding. We combine services and products to maximize business impact for our clients in telecom, Banking, Wealth Management, product engineering and life science & healthcare industries. Working at Incedo will provide you an opportunity to work with industry leading client organizations, deep technology and domain experts, and global teams. Incedo University, our learning platform, provides ample learning opportunities starting with a structured onboarding program and carrying throughout various stages of your career. A variety of fun activities is also an integral part of our friendly work environment. Our flexible career paths allow you to grow into a program manager, a technical architect or a domain expert based on your skills and interests. Our Mission is to enable our clients to maximize business impact from technology by Harnessing the transformational impact of emerging technologies Bridging the gap between business and technology. As a Senior Principle Engineer - Cloud Data Platform (Databricks) at Incedo, you will be responsible for managing and optimizing the Databricks environment, ensuring its performance, scalability, and security. You will work closely with data analysts and data scientists to develop data pipelines and run data science experiments. You will be skilled in big data technologies such as Spark and have experience with cloud computing platforms such as AWS or Azure. You will be responsible for configuring and optimizing the Databricks environment, ensuring that data pipelines are efficient and accurate, and troubleshooting any issues that arise. You will also work with the security team to ensure that the Databricks environment is secure and complies with relevant regulations.

Requirements

• Proficiency in Databricks platform, including Databricks Runtime, Databricks Delta, and Databricks MLflow
• Experience in building scalable and reliable data pipelines using Databricks, Spark, and related big data technologies
• Familiarity with cloud-based infrastructure and deployment, specifically on Azure or AWS
• Strong knowledge of programming languages such as Python, Scala, Java, and SQL
• 13-15 years of work experience in relevant field
• B.Tech/B.E/M.Tech or MCA degree from a reputed university.
• Computer science background is preferred

Responsibilities

• Designing, developing and deploying cloud-based data platforms using Databricks
• Integrating and processing large amounts of structured and unstructured data from various sources
• Managing and optimizing Spark clusters for efficient data processing
• Implementing and maintaining data pipelines and ETL processes
• Troubleshooting and resolving data platform issues
• Collaborating with data scientists and analysts to deliver insights and solutions
• Foster a collaborative and supportive work environment, promoting open communication and teamwork.
• Demonstrate strong leadership skills, with the ability to inspire and motivate team members to perform at their best.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior