Hi, I'm

Matt
Korybski

|

19 years shipping quality software across games, e-commerce, legal tech, and fintech. I care about the whole product — not just the bugs. Based in Oakland, CA.

See My Work Get in Touch
mkorybski@gmail.com LinkedIn GitHub

About

Quality is a mindset.

Matt Korybski

I'm a quality engineering leader who has spent nearly two decades making sure software ships in the right shape. I've founded QA departments, built test infrastructure from scratch, scaled teams, and embedded with engineers early enough to prevent problems — not just catch them.

Most recently I've expanded into AI quality: designing evaluation frameworks, building rubrics, automating evals at scale, and contributing to LLM-as-a-judge systems for ambiguous generative AI outputs. Quality thinking translates directly to the AI era. If anything, it's more important.

I've shipped across games, e-commerce, legal tech, and fintech — which means I know what quality looks like in radically different contexts, user bases, and risk profiles. I bring a developer's mindset to quality work, including building iOS apps and tooling on my own.

Download Resume

Expertise

What I do.

AI Quality & Evaluation

LLM-as-a-judge system design, rubric development, ground truth labeling, and automated evaluation frameworks for generative AI outputs.

Test Strategy & Planning

Shifting quality left — embedding with engineering teams early to define test strategy, prevent defects, and build confidence before code is written.

Test Automation & Infrastructure

Selenium & Appium (Ruby), Cypress (TypeScript), Jenkins CI pipelines, reporting dashboards, and Slack integrations that surface results to stakeholders.

Team Leadership & Mentoring

Founded and scaled QA departments from zero, mentored engineers through technical and career growth, and directed outsourced QA teams across platforms.

Cross-Platform Coverage

iOS, Android, Web, macOS, Windows, Xbox 360, PSP — quality thinking that adapts to the platform, the user, and the certification requirements.

Data-Driven Quality

Analytics-informed release decisions, defect tracking with Jira, CI reporting dashboards, and using quality data to target systemic issues — not just individual bugs.

Experience

Where I've been.

Staff Test Infrastructure Engineer

Intuit Credit Karma

Apr 2016 – Jun 2026

Spent a decade across four roles, growing from Test Engineer II to Staff. Embedded with engineering teams early in the design process to shape test strategy and prevent defects before they were written — building out automated suites, CI pipelines, and reporting dashboards along the way. Most recently contributed to LLM-as-a-judge evaluation systems for AI-driven features, defining rubrics and ground truth for generative AI outputs.

AI Evaluation Automation CI/CD Fintech

Quality Assurance Analyst

Litify Contract

Apr 2016 – Jul 2016

Brought in to stand up quality processes from scratch ahead of Litify's public launch. Partnered with developers to build test plans and execute test cases on their web-based legal referral platform.

Test Planning Legal Tech

Senior Mobile Quality Assurance Engineer

Shutterfly

Oct 2012 – Apr 2016

Owned quality for Shutterfly's flagship iOS and Android apps — test plans, bug tracking, and customer feedback triage. Wrote automated tests in Ruby, directed junior QA engineers and outsourced teams, and partnered cross-functionally to maintain consistent standards across the org.

iOS Android E-Commerce

Director of QA → Live Producer

Freeverse

Mar 2007 – Aug 2012

Founded and ran Freeverse's QA department from scratch, testing over 60 titles across every major platform of the era — Xbox 360, iOS, Android, PSP, OS X, and PC. Later transitioned to Live Producer, using analytics and player feedback to tune content and balance across 10+ live mobile games.

QA Leadership Games iOS Android Live Ops

Selected Work

Projects & highlights.

Steve Jobs demoing a Freeverse game at WWDC 2008
Watch the moment
WWDC 2008

On Stage at the Keynote

A game I tested at Freeverse, Wingnuts Moto Chaser, was demoed by Steve Jobs at Apple's Worldwide Developers Conference in 2008. Seeing the software you helped ship appear on that stage is an incredible feeling.

Watch the keynote →
Intuit Assist AI chatbot screenshot
AI Quality · Credit Karma

Intuit Assist & Analyze My Wallet

Worked on quality and evaluation for two flagship AI features at Credit Karma. Intuit Assist is a generative AI chatbot integrated across the product. Analyze My Wallet uses AI to review your connected cards and surface the one that fills a benefits gap you didn't know you had. I contributed to the LLM-as-a-judge evaluation framework, rubric design, and ground truth labeling that kept these features trustworthy at scale.

LLM Evaluation Rubric Design Generative AI
Shutterfly iOS app storefront
Mobile · Shutterfly

Shutterfly

Joined a startup that had just been acquired by Shutterfly. Shutterfly's existing iOS and Android app did one thing: upload photos. We transformed it into a fully functional digital storefront — browse, customize, and order products directly from your phone. The app earned press writeups and recognition from both Apple and Google.

iOS Android E-Commerce
Skee-Ball iOS game screenshot
QA · Freeverse

Skee-Ball

One of the early App Store's breakout hits and, as someone that spent their youth on the Jersey Shore boardwalks playing Skee-Ball, a game I'm personally proud of having tested. Skee-Ball was formally named by Apple to the Top 10 Paid iPhone Apps of All-Time charts during the early App Store era.

iOS Games Early App Store
Matt speaking at TestBash Philadelphia
Speaking

TestBash Philadelphia

Gave a talk at TestBash Philly, one of the quality engineering community's leading conferences. My talk was part of the 99 Second Talks series and I discussed the importantce of asking questions.

Quality Engineering Public Speaking
Crota Timer app screenshot
Solo Project · iOS

Crota Timer

Built and shipped an iOS app solo for the Destiny community. Crota is a raid boss whose movements follow a strict timing window — knowing it is the difference between a wipe and a clear. Crota Timer was the first app of its kind, and became a staple tool for raid teams.

Swift iOS Gaming
Cinemoji app screenshot
Collaboration · iOS

Cinemoji

Co-developed an asynchronous emoji guessing game covering thousands of movies, TV shows, and games from the 80s to present. I built the prototype, gameplay logic, animations, and Game Center achievements. We also shipped a custom emoji keyboard before Apple introduced one natively.

Game Center iOS Multiplayer
View on App Store →
Featured in Apple's "There's an App for That"
Postman Watch the ad →
Top Gun on display at the Apple Store NYC, 2009
Top Gun Watch AP coverage →

Contact

Let's work
together.

I'm currently open to new opportunities in quality engineering, AI evaluation, or test infrastructure leadership. If you're building something that should work well, let's talk.

mkorybski@gmail.com
LinkedIn GitHub