Prompt Engineer / LLM Specialist, AVP

Mitsubishi UFJ Financial Group•Jersey City, NJ

11d•$108,000 - $146,000•Hybrid

About The Position

Join our innovative AI/DX Accelerator Integration team and play a key role in advancing artificial intelligence within the financial services sector. As a Prompt Engineer / LLM Specialist, you will design, optimize, and implement prompts, tools, and guardrails to support robust, compliant, and efficient AI solutions. You will contribute to the development of retrieval-augmented generation (RAG) systems and fine-tune large language models (LLMs), ensuring alignment with industry regulations and best practices for risk management, customer experience, and data security.

Requirements

3+ years of hands-on experience with LLMs/NLP, including Python and modern machine learning tooling.
Proven track record in deploying AI solutions within highly regulated environments.
Strong understanding of data privacy, security, and ethical AI practices.

Nice To Haves

In-depth familiarity with banking terminology, document types, and regulatory requirements (e.g., BSA/AML, PCI DSS).
Experience building defensible AI systems with grounding, citations, and dynamic guardrails.
Demonstrated ability to develop policy-aware retrieval and automated PII/PCI redaction patterns.
Experience collaborating with compliance, risk, and audit teams in financial institutions.

Responsibilities

Prompting & Evaluation Develop and refine prompt architectures tailored to financial use cases, ensuring regulatory compliance and minimizing operational risk.
Conduct A/B testing and automated evaluations using golden datasets representative of banking and financial scenarios.
Collaborate with compliance and risk teams to validate prompt effectiveness and safety.
RAG & Safety Design advanced retrieval systems (chunking, embeddings, rerankers) for secure and accurate information access in regulated environments.
Implement policy-aware filters and automated redaction mechanisms for PII/PCI, adhering to FINRA, SEC, and GDPR standards.
Work closely with cybersecurity and legal teams to ensure data protection and auditability.
Model Operations Fine-tune LLMs for financial applications, optimizing for performance, compliance, and cost-effectiveness.
Implement robust guardrails to mitigate hallucinations and ensure outputs are defensible and grounded in verified sources.
Monitor and report on model performance, integrating feedback from end-users and compliance teams.