Senior Data Engineer (Warehousing Support)
About The Position
Ingram Content Group (ICG) is seeking a Senior Data Engineer to design, build, and optimize systems for data gathering, ingestion, storage, analysis, transformation, and distribution. This role involves managing the entire lifecycle of data pipelines, from ingestion to the creation of Operational Data Stores (ODS). The Senior Data Engineer will act as a senior/lead technical programmer, owning the solution stack, problem-solving, and delivering results through independent contributions and mentoring junior engineers. They will collaborate with data architects, CI/CD architects, and other data engineers to build world-class data platforms. This is a hybrid position requiring work from the Ingram headquarters 4 days per week. Ingram's Technology team focuses on providing content distribution services with initiatives in business intelligence, machine learning, continuous integration, and omnichannel, utilizing SaaS platforms, metadata, cloud, and containerization. The company aims to connect people with content in the simplest ways and seeks IT professionals who are collaborative, business-driven, and enjoy a connected culture.
Requirements
- Bachelor's or master's degree in computer science, Computer Engineering, IT, or a closely related technical field.
- 6 years of ETL, development, and /or database architectural design experience.
- 2 years of experience with writing and optimizing existing complex SQL queries.
- 2 years of database application development experience.
Nice To Haves
- Technical expertise in a core technology area Data and Software engineering.
- Knowledge of external technologies within domain of expertise.
- Knowledge of all phases of applications systems analysis and programming.
- Demonstrated expert experience in Development Tools including Python and data manipulation packages of Python.
- Working knowledge of client-server architectures and RESTFul APIs.
- Knowledge of software collaboration platforms like GitHub, Azure DevOps, and JIRA.
- Ability to communicate effectively across the organization and with leadership.
- Ability to apply new knowledge, technology, and procedure to job responsibilities.
- Ability to be flexible/multi-task based on workflow demands.
Responsibilities
- Design and implement robust ETL/ELT data pipelines using Apache Kafka for streaming and batch processing.
- Architect and maintain both Relational (MySQL, SQL Server) and Non-relational (NoSQL) database environments to ensure high performance and scalability.
- Manage SQL server related tasks including Transact-SQL, ETL and Data warehousing, SQL server management studio, maintaining and optimizing stored procedures, and maintaining and monitoring background jobs.
- Build and manage Operational Data Stores (ODS) to integrate data from disparate sources for real-time and batched operational reporting.
- Write complex, optimized SQL queries, develop Python scripts using libraries like Pandas, NumPy, and PySpark, and integrate Kafka for sophisticated data transfer, manipulation and cleansing.
- Monitor and tune database performance, ensuring data integrity and security across all platforms.
- Lead and execute testing to ensure data validation and data integrity.
- Drive solutions and guide the work of others to provide full application development life cycle support including specifications, prototypes, development, quality assurance, and deployment.
- Work with user/customer community, business analysts, and architects to capture system requirements and design.
- Leverage a technical network to collaborate across the organization's units.
Benefits
- A highly competitive compensation package with generous benefits beginning first day of employment for Medical/Prescription Drug plans, HSA, Vision, Dental and Health Care FSA.
- 15 vacation days & 12 sick days accrued annually and 3 personal days.
- 401K match, Life and AD&D, Employee Assistance programs, Group Legal, & more.
- Wellness program with access to onsite gym and basketball court for associates.
- Encouraged continued education with our tuition reimbursement program.
- Financial and in-kind opportunities to engage with non-profits in your community.
- Company match program for United Way donations.
- Volunteer opportunities and in-kind drives for non-profits throughout the year.
- Take breaks or brainstorm in our game room with ping pong & foosball.
- Casual Dress Code & Flexible Schedules (per team).
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
