Senior Data Engineer
About The Position
The Codest is an international technology software company with partner tech hubs in Poland, delivering global IT solutions and projects. The company focuses on web development, cloud engineering, DevOps, and quality, and supports technology companies in building products and scaling IT teams. The Senior Data Engineer will contribute to a banking platform for one of Japan’s leading financial groups. The platform includes banking modules, data management features, and customer-facing applications. Within the Fund Administration domain, the Data Flow Team integrates internal, vendor-hosted, and third-party systems. Data flows are triggered by specific rules or events and run at frequencies ranging from every ten minutes to monthly.
Requirements
- Advanced spoken and written English for collaboration within an international team.
- At least 5 years of hands-on experience with ETL tools and data engineering processes in a professional environment.
- Strong SQL skills and experience working with databases and data integration workflows.
- Commercial experience with Python for data processing and scripting.
- Experience designing, developing, and maintaining data pipelines across multiple sources and destinations.
- Ability to understand complex data flows, coding structures, and logical workflows.
- Experience collaborating with developers and business stakeholders in an international environment.
- High attention to detail and commitment to data accuracy and reliability.
- Strong communication skills and ability to engage with stakeholders at different organizational levels.
Nice To Haves
- Experience with Apache NiFi for building and maintaining data flows.
- Familiarity with Databricks, particularly for implementing new data integrations.
- Familiarity with cloud-based data storage and services, including AWS S3.
Responsibilities
- Design and implement data processing pipelines based on business and technical requirements, including data transformation, validation, and mapping.
- Build and maintain integrations between data sources and destinations, including APIs, SQL databases, S3 buckets, and SFTP servers.
- Develop and modify existing ETL workflows and data flows.
- Process and synchronize data across different systems and formats.
- Conduct testing and validation to ensure data accuracy, integrity, and reliable delivery.
- Provide post-deployment support and troubleshoot data integration issues.
- Collaborate with business stakeholders to gather requirements and support production processes when needed.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
