Data Platform Engineer
About The Position
Data Platform Engineer 7+ Month W2 Contract San Jose, CA Benefits You’ll Love: NextDeavor offers health, vision and dental benefits for contract employees Paid sick leave eligibility is contingent on state of residence Optional 401k Plan (excludes employer match) Here’s how you’ll make an impact on the team: Setup and maintain production scale Databricks environment on public cloud such as Microsoft Azure and AWS Handle production-scale data storage platforms like ADLS and S3 for multiple tenant teams within our Data Platform Coordinate production-scale microservices that support the daily operations of our data platform, including job scheduling, security, financial, and administrative services Maintain enterprise-scale SQL Server and SSAS environments Provide triage and mentorship to the team on various support issues raised by our tenants Develop tools and automation solutions for configuration management, service deployments, monitoring, and alerting Ensure security and privacy compliance, implementing Adobe Security & Compliance solutions to secure data in our data lake Explore GenAI technologies to integrate technical improvements and improve user experience Collaborate with various 3rd party vendors to resolve issues, conduct proof of concepts, and improve our product Here’s what you’ll need to be successful in this role: BS in Computer Science, Computer Engineering, or similar Cloud Infrastructure Administration and Automation: AWS Azure Proficiency in Storage Technologies: ADLS Gen2 S3 MongoDB Vector Databases AI Agent Development and Maintenance: Langchain Setup and Operation: Databricks SQL Server & SSAS Airflow Azure Kubernetes Service or Elastic Kubernetes Service Monitoring and Alerting: DBX System Tables Prometheus Splunk MLFlow Maintenance: Linux Servers Kubernetes Environment Operational Tools: Jira Service Now Pay Range: $70.00 - $79.56 /hour Ready to make your mark? Take the leap and apply directly here: https://nextdeavor.thepioneers.ai/jobs/d8b304ee--data-platform-engineer – your application is in good hands.
Requirements
- BS in Computer Science, Computer Engineering, or similar
- Cloud Infrastructure Administration and Automation: AWS Azure
- Proficiency in Storage Technologies: ADLS Gen2 S3 MongoDB Vector Databases
- AI Agent Development and Maintenance: Langchain
- Setup and Operation: Databricks SQL Server & SSAS Airflow Azure Kubernetes Service or Elastic Kubernetes Service
- Monitoring and Alerting: DBX System Tables Prometheus Splunk MLFlow
- Maintenance: Linux Servers Kubernetes Environment
- Operational Tools: Jira Service Now
Responsibilities
- Setup and maintain production scale Databricks environment on public cloud such as Microsoft Azure and AWS
- Handle production-scale data storage platforms like ADLS and S3 for multiple tenant teams within our Data Platform
- Coordinate production-scale microservices that support the daily operations of our data platform, including job scheduling, security, financial, and administrative services
- Maintain enterprise-scale SQL Server and SSAS environments
- Provide triage and mentorship to the team on various support issues raised by our tenants
- Develop tools and automation solutions for configuration management, service deployments, monitoring, and alerting
- Ensure security and privacy compliance, implementing Adobe Security & Compliance solutions to secure data in our data lake
- Explore GenAI technologies to integrate technical improvements and improve user experience
- Collaborate with various 3rd party vendors to resolve issues, conduct proof of concepts, and improve our product
Benefits
- health
- vision
- dental benefits
- Paid sick leave
- Optional 401k Plan (excludes employer match)
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Career Level
Mid Level
