Data Engineer + Gen AI (In-Person @ NYC)
About The Position
NucleusTeq is a global leader in software services, specializing in Generative AI, Machine Learning, Data Modernization, Cloud Computing, and Enterprise Automation. Headquartered in Phoenix, Arizona, the company empowers Fortune 100 enterprises with innovative, AI-driven solutions, scalable architectures, and comprehensive data transformation services. Leveraging its proprietary platform, NuoData, NucleusTeq delivers cutting-edge capabilities in data governance, real-time analytics, and enterprise AI/ML frameworks. With advanced automation, scalable cloud solutions, and robust security integrations, NucleusTeq drives digital transformation for businesses worldwide. The role is for a Data Engineer with Generative AI expertise, located in NYC, with a duration of 12+ months and an in-person interview mode. The tech stack includes Data Engineering with PySpark, data pipeline orchestration tools like Airflow & Glue, AI/Agentic AI, FastAPI, Google Cloud Platform, Flask, Python, SQL, Docker & Kubernetes.
Requirements
- Bachelor's degree in computer science, Engineering, or a related field.
- 6+ years of software development experience with hands-on expertise in coding in Java/Python/Scala.
- 3+ years of experience in creating low code/no code ETL tool for setting up large scale data transformation on Google Cloud Platform Cloud.
- Strong SQL, RDBMS skills. Expert in writing complex SQLs for different databases such as Hive, MySQL, Postgres etc.
- Proficiency in working with NoSQL databases as well.
- Experience working with Spark, Big Data and Hive.
- Experience in Git Management including PR reviews, maintaining code hygiene.
- In-depth understanding of data warehousing concepts, dimensional modelling, and data integration techniques.
- Experience in optimizing high volume data processing jobs.
- 3+ years experience in writing APIs.
- Knowledge of High availability and DR setup.
- Understanding of Generative AI concepts, including LLMs (Large Language Models), prompt engineering, embeddings, and vector databases.
- Excellent communication and analytical skills.
- Excellent team-player with ability to work with global team.
Nice To Haves
- Master's degree would be a plus.
- Google Cloud Platform professional certification - Data Engineer/Cloud Architect will be preferable.
- Experience with Google Cloud Platform services (Big Query, Dataflow, Dataproc, Pub/Sub, Cloud Storage, Composer, etc.).
- Hands-on experience on CICD pipelines, Automated test frameworks, DevOps and source code management will be a big plus (XLR, Jenkins, Git, Stash, Jira, Confluence, Splunk etc.).
- Experience working in Agile/SAFe framework for development.
Responsibilities
- Designing and building high performance, and scalable data platforms.
- Leading a team of multiple enthusiastic and skilled engineers to drive product development and adoption.
- Collaborating with product teams from business groups to understand the product roadmap and vision and translate that into engineering artifacts.
- Working with a variety of teams and individuals, including platform engineers, use case owners, and analytical users to understand their needs and come up with innovative solutions.
- Following the Amex-way of building engineering products that leads to engineering excellence by adopting DevOps principles.
- Integrating GenAI capabilities into data platforms (e.g., semantic search, AI-driven analytics, automated data insights).
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
