Lead Data Engineer - Remote (US)

Greenbox Capital • Miami, FL

5d • Remote

About The Position

At Greenbox Capital, we help small businesses thrive by giving them fast, accessible funding. As a Lead Data Engineer at Greenbox Capital, you will own, design, develop, and maintain the data engineering foundation on an Azure technology stack. You will be hands-on and delivery-focused, accountable for the data engineering architecture, frameworks, and patterns across Azure Data Factory and Databricks (in alignment with our Enterprise Architecture).
You will design, build, and maintain scalable, reliable, and governed data pipelines while defining and enforcing standards that enable consistency, performance, and long-term scalability. You will work closely with data science, analytics, and software engineering partners to ensure data products are production-grade and support business-critical decisioning.

Requirements

• Bachelor’s degree in computer science, Information Technology, or a related field.
• 5+ years of experience in data engineering, with demonstrated ownership of production systems.
• 3+ years of experience in the Azure ecosystem. Proficiency in Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Data Lake Storage, Azure Cosmos DB, Databricks Unity Catalog.
• Execution-oriented mindset with a strong sense of ownership and accountability
• Able to make sound technical decisions in ambiguous environments
• Comfortable setting standards and holding the line on quality and maintainability
• Strong communicator who can explain technical concepts to both technical and non-technical stakeholders
• Highly organized and able to manage multiple priorities without sacrificing delivery quality
• Strong collaboration skills, and ability to operate autonomously in a Kanban-style team
• Material experience interacting with relational and NoSQL, JSON, XML, and interacting with REST APIs
• Deep hands-one experience with: Azure Data Factory (orchestration, patterns, parameterization) Azure Databricks / Apache Spark (PySpark, performance tuning, cluster design) Azure Data Lake Storage and Azure SQL
• Advanced experience in programming in Python & SQL.
• Solid understanding of data modeling, ETL/ELT design, and analytical data platforms
• Experience with Azure DevOps or GitHub and CI/CD pipelines.
• Experience designing and deploying data governance frameworks from the ground up.
• Proven experience owning data engineering frameworks, not individual pipelines

Nice To Haves

• Certification in Microsoft Azure (e.g., Azure Data Engineer Associate).
• Experience designing platforms in regulated or highly data-sensitive or regulated environments (Finance, Healthcare, Government, etc.

Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL processes using Azure Data Factory, Azure Databricks, and other Azure services
• Own the data engineering framework, including pipeline patterns, orchestration standards, and reusable components
• Collaborate with data scientists, Software engineers, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions
• Define, document, and enforce best practices for ADF, Databricks, Spark, and data modeling
• Implement and maintain data storage solutions using Azure SQL Database, Azure Data Lake Storage, and Azure Cosmos DB
• Ensure data quality and integrity by implementing data validation, cleansing, and transformation processes
• Implement data quality checks, validation frameworks, and monitoring for critical data assets
• Design and support governance patterns leveraging Databricks Unity Catalog and Azure-native controls
• Develop and maintain documentation for data engineering processes and solutions

Benefits

• Competitive Pay - We know your worth and we pay accordingly.
• Flexible PTO - Work hard, rest well. Take the time you need to recharge.
• Remote - Fully remote within the U.S., working Eastern Time hours to keep everyone aligned.
• Full Benefits Package - Health, dental, vision
• Smart, Supportive Teammates - Collaborate with sharp minds who are kind, driven and uphold our core values: Commitment, Communication, Teamwork, Service and Integrity!

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Number of Employees: 51-100 employees