Data Engineer Seniors III (Databricks)
About The Position
FIS Management Services, LLC seeks Data Engineer Seniors III (Databricks) in Jacksonville, FL to design, develop, and enhance applications and data solutions in collaboration with product managers, clients, and engineering teams. Analyze requirements, defining technical specifications, participating in design reviews, and implementing software enhancements. Code, debug, test, and prepare documentation for installation and maintenance. Train internal teams and external clients on system functionality and supporting project planning, scheduling, and reporting. Develop Python based validation scripts to ensure data quality, schema conformity, and completeness prior to ingestion. Utilize PySpark within Databricks to read, cleanse, transform, and integrate large scale datasets, while Unity Catalog enables secure, governed access to ADLS. Develop Spark notebooks to optimize data structures and support parameter driven execution. Design a reusable Delta Live Tables framework to standardize ingestion and transformation across bronze, silver, and gold layers, improving consistency, reliability, and operational efficiency. Create a centralized error logging framework to capture standardized exceptions, enhance observability, support compliance, and strengthen overall data platform resilience.
Requirements
- Bachelor’s degree or foreign equivalent in Applied Computer Science, Computer Engineering, or a related field and four (4) years of experience in the job offered or a related occupation.
- Working with Azure and AWS cloud based data engineering platforms.
- Utilizing python data processing frameworks, including MPP engines and ELT/ETL transformation frameworks including DBT and PySpark.
- Performing ETL/ELT development, data modeling, and working with optimized data formats including Parquet and Delta technologies.
- Implementing version control and collaborative development practices using Git and code reviews.
- Working with CI/CD pipelines and automated testing methodologies, including TDD and unit testing approaches.
- Master’s degree in the above listed fields and two (2) years of experience in the above listed skills.
Responsibilities
- Design, develop, and enhance applications and data solutions.
- Analyze requirements and define technical specifications.
- Participate in design reviews and implement software enhancements.
- Code, debug, test, and prepare documentation for installation and maintenance.
- Train internal teams and external clients on system functionality.
- Support project planning, scheduling, and reporting.
- Develop Python based validation scripts for data quality, schema conformity, and completeness.
- Utilize PySpark within Databricks to read, cleanse, transform, and integrate large scale datasets.
- Develop Spark notebooks to optimize data structures and support parameter driven execution.
- Design a reusable Delta Live Tables framework for ingestion and transformation.
- Create a centralized error logging framework.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
