Information Technology_USA - USA_Engineer

Real Soft • Jacksonville, FL

5d • Onsite

About The Position

We are seeking a skilled Data Engineer with strong expertise in Azure Databricks, Apache Spark, SQL, and Java to design, build, and maintain scalable data pipelines and data processing solutions. The ideal candidate will work closely with business stakeholders, data architects, and analytics teams to support enterprise data initiatives and enable data-driven decision-making.

Requirements

• Azure Databricks
• Apache Spark
• Data pipeline design, development, and maintenance
• ETL/ELT processes
• Large-scale structured and unstructured data processing
• Java
• Data transformation and processing frameworks using Java and Spark
• SQL
• Complex SQL queries
• Stored procedures
• Performance-tuned data solutions
• Integration of data from multiple sources
• Enterprise data lakes
• Enterprise data warehouses
• Data processing job monitoring
• Troubleshooting
• Performance optimization
• Reliability optimization
• Data quality standards
• Data governance standards
• Data security standards
• CI/CD deployment
• Automation of data engineering workflows
• Collaboration with business stakeholders
• Collaboration with data architects
• Collaboration with analytics teams
• Translation of business requirements into technical solutions
• Microsoft Azure
• Databricks
• Core Java
• 6-8 years of experience

Responsibilities

• Design, develop, and maintain scalable data pipelines using Azure Databricks and Apache Spark.
• Build and optimize ETL/ELT processes for large-scale structured and unstructured data.
• Develop data transformation and processing frameworks using Java and Spark.
• Write complex SQL queries, stored procedures, and performance-tuned data solutions.
• Integrate data from multiple sources into enterprise data lakes and data warehouses.
• Monitor, troubleshoot, and optimize data processing jobs for performance and reliability.
• Implement data quality, governance, and security standards.
• Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
• Support CI/CD deployment and automation of data engineering workflows.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed