Data Engineer (Data Bricks)
3Cloud
·
Posted:
June 2, 2023
·
Remote
About the position
3Cloud is seeking motivated individuals who are ready for growth and thrive in a challenging environment. They value teamwork and encourage employees to provide direct and candid feedback. With a focus on Azure technology, the company offers exciting opportunities for skill development and access to cutting-edge Azure work. They provide a competitive compensation package and a flexible work environment, fostering a great company culture. The key responsibilities include supporting the development of reliable and scalable solutions, communicating technical details effectively, designing and developing database solutions, and assisting with pre-sales activities. The qualifications include a bachelor's degree in a related field, experience with database design and Azure technologies, and expertise in various technologies such as Apache Spark and Azure Data Factory.
Responsibilities
- Support the development of high performing, reliable and scalable solutions
- Clearly communicate technical details to business and management personnel
- Work independently or on a team to design and develop database solutions
- Assist business development team with pre-sales activities and RFPs
Requirements
- Bachelor's degree in computer science, engineering, data science or a related field
- Minimum of 5 years of experience with database design, at least 2 years with Azure technologies, and previous Consulting experience
- Knowledge of Databricks development, including Scala, Python, and Spark
- Advanced knowledge of SQL, including ability to write stored procedures, triggers, analytic functions, and performance tuning for Synapse
- Ability to develop utilizing Data Movement (Apache Spark, plus Azure Data Factory and legacy SSIS), Data Warehousing (Azure Synapse, CosmosDB), and Azure Storage Technologies (Data Lake, Blob Storage)
- Expertise in Spark DataFrames API and architecture to ingest and manipulate data, including exploring, preprocessing, joining, filtering, dropping sorting, partitioning, and renaming/manipulating columns in the dataset
- Understanding of network infrastructure
Benefits
- Competitive compensation package, salary, allowance, and standard benefits including quarterly and annual performance-based cash bonus and other remuneration.
- Great working environment and company culture with flexible work location.
- Opportunity for growth and development.
- Access to cutting-edge Azure work opportunities and Microsoft partnerships.
- Technical excellence and client experience in a specific, defined space.
- Six months of experience on the team is worth years somewhere else.
- Supportive and collaborative team environment.
- Opportunity to work on high-performing, reliable, and scalable solutions.
- Clear communication of technical details to business and management personnel.
- Opportunity to design and develop database solutions.
- Assistance with pre-sales activities and RFPs.
- Opportunity to work with Azure technologies and gain experience in Databricks development, SQL, and Spark.
- Exposure to various technologies including Data Movement, Data Warehousing, and Azure Storage Technologies.
- Expertise in Spark DataFrames API and architecture.
- Understanding of network infrastructure and security.
- Opportunity to work with Informatica and Azure ML Studio/Services.
- Passionate about learning new technologies.
- Analytical approach to problem-solving.
- Ability to work in a fast-paced environment.
- Diverse and inclusive workplace.