Data Engineer
About The Position
The Surplus & Specialty Digital Data Services team leverages agile software development principles to achieve success in its support of the business. We are a dynamic organization always on the lookout for intelligent, capable employees who are passionate about their career. We seek a Data Engineer to join our team and help us continue to provide a high level of support to our business partners, while planning for our exciting future in the cloud. If you are interested in contributing to the transformation of an IT organization utilizing innovative tools then this is the place for you! The Digital Data Services Data Engineer will work with a group of highly motivated and experienced technologists who work to create innovative tools to the C&F Surplus & Specialty Organization for quick and scalable business solutions. This position is to support and develop in-house, cloud-based, data-driven solutions and initiatives, which involve:
Requirements
- Degree or certification in Computer Science, Mathematics, Statistics, Econometrics, Business, or equivalent
- 3-4+ years working proficiently with SQL, Python and DataFrames.
- 2+ years of experience with the Snowflake Data Cloud, preferably worked on Data Pipes, Streams, Streamlit, Dynamic Tables, and Snowpark.
- Familiarity with the AWS ecosystem, preferably the Analytics services and common utilities such as S3, SNS, SQS, Lambda Functions, Cloudwatch, etc.
- Good knowledge of working with semi-structured data, particularly JSON
- Strong in writing complex queries that involve nested joins, derived tables and common table expressions.
- Capable of performing technical root cause analysis and delivering corrective action.
- A passion for learning
- Great communication, note taking, and organizational skills
- An ability to leverage web searches and online training to obtain new skills quickly
- An ability to present to all levels of audience
- Experience with Production Support and Troubleshooting
- An enthusiastic and positive attitude
- Ability to take ownership and see tasks through to completion
- Will abide by departmental policies and procedures, including authority levels, to comply with C&F’s management control
Nice To Haves
- Experience working with APIs a plus
- Experience working with external vendors a plus
Responsibilities
- Build and maintain the pipelines that move and process data from disparate sources into our data lakehouse platform
- Facilitate data preparation for use cases involving internal reporting, data lakehouse integrations, and predictive analytics
- Work closely with our analytics and reporting team to create and maintain curated data marts.
- Leverage agile software development methods to make iterative enhancements to the data lakehouse infrastructure and ETL processes
- Working with the Snowflake Platform (Horizon Catalog, Snowpark, Cortex AI, etc)
- Data ingestion tools such as Fivetran, CData, AWS Glue, or Apache Kafka
- Working with the full suite of AWS Services (S3, Lambda, Glue, Athena, Lake Formation, etc)
- Working with relational databases such as Microsoft SQL Server and PostgreSQL
- Working with version control software such as Git and Bitbucket
- Working with the various business units to analyze need, recommend solutions, and work with the team to prioritize, plan, and execute on deliverables
- Communicate with other Digital teams and Business Units to clearly define project goals, discuss timelines, and provide input on solutions
- Become an agent of change and use your creativity and skills to implement new technology and skills
Benefits
- Competitive compensation package
- Generous 401K employer match
- Employee Stock Purchase plan with employer matching
- Generous Paid Time Off
- Excellent benefits that go beyond health, dental & vision. Our programs are focused on your whole family’s wellness, including your physical, mental and financial wellbeing
- A core C&F tenet is supporting your career development, so we provide a wealth of ways for you to keep learning, which may include tuition reimbursement, industry-related certifications and professional training to keep you progressing on your chosen path
- A dynamic, ambitious, fun and exciting work environment
- We believe you do well by doing good and want to encourage a spirit of social and community responsibility, matching donation program, volunteer opportunities, and an employee-driven corporate giving program that lets you participate and support your community
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
