Experience

AI Operations Engineer (RPA & Model Evaluation)

Handshake - Contract

November 2025 – Present

• Evaluated multimodal AI agents against structured rubrics to assess response quality, reasoning accuracy, and domain understanding across generalist tasks.
• Built AutoHandshake!, a Selenium-based RPA suite that eliminated 95% of manual annotation and triage effort across 400+ contractor hours with unattended execution, failure recovery, and full audit trails.
• Mentored contractors on platform operations, rubric interpretation, and efficient evaluation workflows.
• Evaluate LLM quality on coding and knowledge-based tasks using head-to-head comparisons, benchmark evaluations, and structured quality criteria. Analyze correctness, reasoning, and failure modes to inform model-quality improvements.

AI Evaluation Engineer

Snorkel AI - Contract

December 2025 – June 2026

• Authored adversarial programming and logic reasoning tasks for Claude and ChatGPT across 2 contracted projects, applying strict schema and formatting constraints to surface model blindspots and reasoning failure modes.
• Designed rigorous evaluation rubrics and grading criteria that translated subjective model failures into structured, reproducible assessments of code correctness and logical deduction accuracy.
• Built Docker-based reproducible evaluation sandboxes to validate task solutions and enforce training-set integrity pre-release, feeding red-team findings back into model alignment.

Search Quality Evaluator

RWS Group - Contract

April 2025 – August 2025

• Assessed search relevance and LLM output quality against detailed rubrics across Google query simulations and third-party models, identifying failure patterns that informed ranking and UX improvements.

Biochemistry Intern

Columbus Alternative High School - Internship

October 2023 – June 2024

• Managed safety data sheets (SDS/MSDS) and lab compliance documentation across roughly 12 science classes, ensuring materials met district and state safety standards.
• Prepared lab materials and set up experiments for chemistry and biology courses, supporting hands-on instruction across multiple grade levels.
• Assisted with grading assignments, lab reports, and exams using structured rubrics.
• Built C# automation tools to help teachers manage class transitions when periods were starting or alternating, and desktop organization tools to keep shared classroom workstations organized across multiple classes.

Freelance Software Engineer

July 2021 – Present

• Developed workflow automation tools and SDKs for web API integration and device I/O, eliminating repetitive manual processes for individual clients.
• Built an AI-assisted grading platform with LMS OAuth integration and automated rubric application, achieving ~95% accuracy in real-world classroom use and cutting instructor grading time by half.