Data Engineer II

Dallas College•Mountain View, CA

4d•Onsite

About The Position

The Data Engineer II is responsible for designing, building, and maintaining data architecture and pipelines to support advanced analytics and AI/ML initiatives. This role requires moderate technical proficiency, strong problem-solving skills, and the ability to work independently while collaborating with engineers, data scientists, analysts, and product teams. The position includes troubleshooting complex issues and mentoring junior team members.

Requirements

Principles of data architecture and engineering best practices.
Moderate understanding of programming languages and relational databases.
Familiarity with cloud-based data platforms and governance frameworks.
Ability to design and maintain complex data architectures and pipelines.
Skill in troubleshooting and optimizing workflows.
Proficiency in Microsoft Fabric and Power BI tools.
Strong analytical and problem-solving skills.
Effective written and verbal communication skills.
Ability to build pipelines independently and document processes thoroughly.
Ability to mentor junior team members.
Ability to collaborate across technical and non-technical teams.
Ability to support AI/ML initiatives and follow governance policies.
Bachelor’s degree in Computer Science, Data Engineering, or related field.
Two (2) plus years of relevant experience in data engineering or related field.
Moderate proficiency in data processing frameworks, programming languages (e.g., SQL, Python), and databases.
Strong analytical and problem-solving abilities.

Nice To Haves

Bilingual or multilingual preferred.
Effective communication skills.
Ability to maintain the security or integrity of the critical infrastructure of Dallas College.

Responsibilities

Design and implement scalable, extensible data architectures and pipelines using Microsoft Fabric components (OneLake, Data Factory, Synapse Data Engineering, Synapse Data Warehouse).
Build pipelines independently and optimize for performance and reliability.
Troubleshoot and resolve complex data workflow issues.
Document architecture, processes, and data lineage for compliance and transparency.
Develop Power BI semantic models, dataflows, and paginated reports.
Partner with analysts and product teams to deliver actionable insights.
Enforce data governance policies and ensure compliance.
Maintain accurate lineage documentation in Microsoft Purview for all assigned pipelines.
Architect and implement data pipelines specifically tailored for machine learning workflows, ensuring scalability and performance.
Collaborate with data scientists to prepare high-quality datasets, perform feature engineering, and validate data integrity for model training.
Assist in operationalizing AI/ML models by integrating them into production environments and monitoring performance.
Establish structured documentation for experiments, including versioning and reproducibility standards.
Work with Azure OpenAI and Copilot Studio to enable intelligent automation and conversational AI solutions.
Work closely with engineers, data scientists, and analysts to meet evolving data needs.
Begin mentoring junior engineers and share best practices.
Perform other duties not listed as assigned.