Sr. Manager, Data Engineering

TradeStation • Plantation, FL

23h • $168,000 - $187,000 • Remote

About The Position

TradeStation is seeking a Senior Manager of Data Engineering to lead their Data Engineering team. This role is crucial for ensuring the secure, efficient, and seamless handling of the organization's data assets. The primary focus will be on managing the Databricks environment, designing and implementing robust data infrastructure, including Databricks AI capabilities and AI/BI Genie apps, to support business operations, analytics, and innovation. The Senior Manager will collaborate with business and product management to define and drive the technical and business data roadmap. This position requires strong leadership, deep knowledge of data and AI infrastructure, and a commitment to enhancing the company's data-driven nature. The role combines technical expertise with strategic oversight to deliver scalable, high-performing data solutions aligned with organizational goals.

Requirements

• Proven experience running projects and managing direct reports.
• Knowledge of data governance practices, business and technology issues related to managing enterprise information assets, and approaches related to data protection.
• Knowledge of industry-leading data quality and data protection management practices.
• Strong analytical, technical, oral, and written communication skills.
• Strong knowledge of database design, data warehousing, and ETL processes.
• Ability to present projects to technical and non-technical staff.
• Team player who can work flexible hours.
• Expertise in Databricks and its ecosystem (Delta Lake, Spark, Databricks SQL, MLflow, etc.).
• Hands-on experience with Databricks AI, including Mosaic AI, model serving, and generative AI/agent solutions.
• Experience building and deploying AI/BI Genie spaces and Genie apps to deliver natural-language, self-service analytics to business users.
• Experience administering and managing a Databricks environment, including workspace/cluster management, Unity Catalog, security, and cost governance.
• Proficiency in programming languages such as Python, Scala, or SQL.
• Experience with cloud platforms (AWS, Azure, or GCP) and associated data services.
• Strong understanding of ETL processes, data pipelines, and real-time data streaming.
• Knowledge of data modeling, database design (relational and non-relational), and optimization techniques.
• Comfortable with writing scripts and using command-line interfaces.
• Knowledge of full-stack monitoring concepts and tooling from code to system resources.
• Programming Skills – knowledge of statistical programming languages like R, and Python and database query languages like SQL.
• Data Wrangling – proficiency in handling imperfections in data.
• Strong software engineering background.
• Experience in Databricks AI capabilities and AI/BI Genie solutions into a production environment.
• Prior experience owning a data platform roadmap in partnership with product management in a financial services or brokerage environment.
• Bachelor’s degree in computer science/Engineering or equivalent work experience.
• Must have 5+ years of technology industry experience.

Nice To Haves

• Databricks certification(s), such as Databricks Certified Data Engineer Professional or a Databricks Generative AI / Machine Learning certification.
• 7+ years of technology industry experience with prior people-management experience leading a data engineering team.

Responsibilities

• Manage, mentor, and inspire a team of skilled data engineers to deliver high-quality work.
• Provide direction, performance feedback, and career development opportunities.
• Foster a culture of collaboration, innovation, and continuous learning.
• Manage the design and implementation of scalable and efficient data pipelines on Databricks.
• Define and implement data architecture to support both batch and real-time data processing.
• Leverage Databricks features (e.g., Delta Lake, Databricks SQL, MLflow) to optimize infrastructure for performance and cost.
• Own, administer, and continuously optimize the end-to-end Databricks environment, including workspace administration, cluster and compute management, Unity Catalog governance, and cost/performance monitoring.
• Build and operationalize Databricks AI capabilities (Mosaic AI, model serving, and generative AI/agent workflows) to power intelligent, data-driven products.
• Design, deploy, and maintain AI/BI Genie spaces and Genie-powered apps that enable business users to explore data and get answers through natural-language conversation.
• Implement and maintain data governance frameworks to ensure data integrity, security, and compliance.
• Partner with data scientists, analysts, and business teams to enable data-driven decision-making.
• Work closely with business and product management to define, prioritize, and own both the technical and business data roadmap, aligning platform investments with organizational strategy.
• Translate business needs into technical requirements and scalable data solutions.
• Communicate technical plans, challenges, and achievements to stakeholders at all levels.
• Prioritize and manage multiple data engineering projects, ensuring timely delivery.
• Define success metrics and continuously track progress to achieve desired outcomes.
• Stay informed on industry trends, particularly advancements in Databricks, Databricks AI (Mosaic AI, AI/BI Genie), generative AI, and cloud-based data platforms.
• Establish and enforce best practices for coding, testing, and deploying data engineering solutions.

Benefits

• Comprehensive benefits for you and your family starting Day 1
• Unlimited Paid Time Off
• Flexible working environment
• TradeStation Account employee benefits, as well as full access to trading education materials

What This Job Offers

• Job Type: Full-time
• Career Level: Manager
• Education Level: Associate degree