Data Architect (ETL, Python, Spark)

InterContinental Recruiting • Iselin, NJ

20h • Onsite

About The Position

We are seeking a Data Architect with expertise in ETL, Python, and Spark to join our US-based consulting, analytics, and technology services firm. This role is crucial for designing, developing, integrating, and maintaining Modern Data Management systems, with a focus on Shared Disk versus Shared Nothing use cases. You will be instrumental in building and designing Modern Digital Data Platforms in accordance with DataOps best practices and architectural guidance. This position requires a deep understanding of Big Data, Data-on-cloud, and real-time streaming data technologies, and the ability to design and implement enterprise-grade Data Platforms deployed in production environments. You will also be responsible for designing and building performant data tiers that support scaled AI and Analytics using various cloud-native data stores and NoSQL/Graph Stores.

Requirements

• Experience with Snowflake, AWS Redshift like similar MPP Databases.
• Experience with tools like Markit, Business objects, Informatica, MS SQL, PL/SQL.
• Deep knowledge of Big Data, Data-on-cloud, Real time streaming data technologies.
• Designed and implemented enterprise-grade Data Platforms, deployed in production environments.
• Expertise in designing, implementing large scale real-time data pipelines for data curation, feature engineering and machine learning, using technologies like Kafka, Kafka Streams, Spark Streaming and similar cloud native technologies; either on premise or on Cloud (AWS, Google or Azure).
• Expertise in designing and building performant data tiers (or refactoring existing ones), that supports scaled AI and Analytics, using different Cloud native data stores on AWS, Azure and Google (Redshift, S3, BigQuery etc.) as well as using NoSQL and Graph Stores.
• AWS
• Python
• Data Modelling
• Spark
• 4 or more years programming in SQL, R and/or Python.
• Strong mathematical skills, analytical skills and mastery of web analytics techniques.
• Expertise in data collection, development, and reporting.
• Highly organized and rigorous thinking, able to solve problems diligently and creatively.
• Strong quantitative and qualitative skills with proven data interpretation abilities and technical skills.
• Knowledge of multi-site website functionality, tracking, concepts and tagging infrastructure.
• Experience with statistical analysis methods and tools (e.g. A/B testing, t-tests, z-tests).
• Genuine team player, able to work well and pleasantly in a team and work independently for the team.
• Strong time management skills with a track record of consistently meeting deadlines.
• Ability to communicate effectively with technical and non-technical audiences.
• Detail oriented.

Nice To Haves

• Experience with R and/or Python is strongly desired.
• Experience with Spark is desired.
• Familiarity with data warehousing concept.
• Expert in Microsoft Office suite, especially Word, Excel and Powerpoint.
• Familiarity with IBM DB2 and SQL Server (SSRS, SSIS, SSAS) databases.

Responsibilities

• Design, development, integration, and maintenance of Modern Data Management systems, primarily focused on Shared Disk versus Shared Nothing use cases.
• Build and design Modern Digital Data Platforms in accordance with DataOps best practices and architectural guidance.
• Design and implement enterprise-grade Data Platforms deployed in production environments.
• Design, implement large scale real-time data pipelines for data curation, feature engineering and machine learning, using technologies like Kafka, Kafka Streams, Spark Streaming and similar cloud native technologies; either on premise or on Cloud (AWS, Google or Azure).
• Design and build performant data tiers (or refactoring existing ones), that supports scaled AI and Analytics, using different Cloud native data stores on AWS, Azure and Google (Redshift, S3, BigQuery etc.) as well as using NoSQL and Graph Stores.
• Transform raw data into insights and recommendations that will effectively support decision making processes.
• Develop data-driven insights and recommendations.
• Record, organize and track content from meetings and discussions.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: Associate degree