The Supplier Reliability Score: How to Know Which Vendors Are Actually Worth Keeping

Why "they always reply" isn't the same as "they're reliable"

Ask most distributors to rank their suppliers by reliability, and they'll rank them by how fast they answer email. It's an understandable shortcut, a supplier who goes quiet for three days feels less trustworthy than one who confirms within the hour. But responsiveness and reliability aren't the same thing, and treating them as interchangeable is exactly how a "good" supplier ends up costing you a customer.

A supplier can confirm every purchase order the same day it's sent, sound cooperative on every call, and still push the ship date back two or three times before the order actually leaves their warehouse. If your mental scorecard only tracks who answers, that supplier looks identical to one who commits to a date and holds it. The gap between the two only shows up once you're measuring something more specific than "did they respond."

The one number that tells you the most, on its own

If you formalize supplier reliability with a single metric, this is the one to start with: what percentage of this supplier's purchase orders actually made it to confirmed, shipped, or received, out of everything you've ordered from them. It's the core number TraxSail calculates for every supplier automatically, and it's a strong signal on its own, a supplier sitting at 60% completion is a supplier with a real problem, full stop, no further math required.

Where a single completion-rate number falls short is that it doesn't care how many times the date moved on the way to "confirmed." A supplier who commits to March 1st and ships March 1st, and a supplier who commits to March 1st, pushes to March 10th, pushes again to March 20th, and finally ships, can land on the exact same completion rate if both orders eventually closed out. One of those suppliers is reliable. The other one is teaching you to build in weeks of slack every time you order from them.

The number that catches what completion rate misses

The fix is tracking date pushes as their own signal, counted separately from whether the order eventually completed. Every time a supplier's committed ship date changes after the PO was sent, that's a data point, and it's the data point that catches the "confirms fast but doesn't hold the date" pattern a completion-rate number alone will miss. A supplier with a 95% completion rate and zero date pushes is genuinely reliable. A supplier with that same 95% and a habit of pushing dates three or four times per order is a supplier you should be quoting longer lead times for, whether or not their paperwork ever technically shows a miss.

Picture two suppliers side by side over a quarter of orders. Supplier A: 95% completion rate, dates pushed on 1 out of 20 orders. Supplier B: also 95% completion rate, but dates pushed on 9 out of 20, nearly half. Read as a single number, they're identical. Read with date-push frequency layered in, Supplier B is the one quietly costing you planning time and customer goodwill on almost every other order, and it's the number most manual tracking never captures.

Put together, completion rate and date-push frequency are what a real supplier reliability scorecard needs. Either one alone tells you something. Together, they tell you which suppliers you can plan tightly around and which ones need a buffer built into every order.

How to build one by hand

You don't need software to start tracking this. A spreadsheet with the following columns, updated as orders move, gets you most of the way there:

Metric	How to calculate it
Total POs	Total orders placed with this supplier in the period you're measuring
Completion rate	POs reaching confirmed, shipped, or received ÷ total POs
Date-push frequency	Orders where the ship date changed after commitment ÷ total POs

Quarterly is usually enough to see a real pattern. The honest limitation of the spreadsheet version is that it only works if someone consistently logs date changes the moment they happen, which is the same discipline problem that makes manual PO tracking break down in the first place once you're past a handful of suppliers.

When to actually act on the score

A reliability scorecard is only useful if it changes a decision. In practice, that means three thresholds worth watching for: a completion rate that's trending down over consecutive quarters, a date-push frequency that's climbing even while the completion rate looks fine, and any supplier where both numbers are bad at once. The first two are early warnings, worth a direct conversation with the supplier or a longer lead-time buffer on future orders. The third is usually a sign it's time to start qualifying a backup vendor before you're forced to switch under pressure, which is always the more expensive way to do it.