A useful bulk tea supplier scorecard does not reduce every issue to one percentage. First apply non-negotiable safety, legality, identity and approval gates. Then calculate a small set of defined metrics for the same supplier, manufacturing site, tea family and review period. Link each result to evidence, trend, cause and a prewritten action: continue approval, increase verification, require improvement, reapprove or suspend.
Separate approval gates from performance scores
A supplier can deliver on time and still fail a pesticide limit, ship from an unapproved site or break lot traceability. High service scores must never cancel a critical failure. Put legal and food-safety conformity, authorised facility identity, prohibited substitutions and unresolved critical findings into a gate section. A failed gate triggers the applicable hold, investigation and lot-disposition plan; it is not averaged with delivery or price.
The scored section asks how consistently the approved arrangement performed. Compare evidence with the written purchase specification, approved sample, order and contract. Do not score undisclosed requirements or events outside the supplier's control.
Build one evidence-based scorecard
| Measure | Define the numerator and denominator | Evidence and action link |
|---|---|---|
| Critical gate status | Pass, open or failed for legality, safety, identity, approved site and traceability | Rule/source, affected lots, hold or approval decision |
| Lot conformity | Lots accepted first time / lots with complete release decisions | Representative results, sensory decision, approved deviations |
| Document accuracy | Complete correct packs at first review / packs due | COA, lot codes, packing list, origin and required certificates |
| Delivery reliability | Orders received in full and within the agreed window / orders due | Confirmed date, quantity basis, agreed exclusions and receipt record |
| Packaging performance | Units conforming at receipt / units inspected under the plan | Liner, closure, marks, damage map and transport condition |
| Issue response | Cases meeting acknowledgement, containment and final-response times / cases opened | Dated case log and severity-specific deadlines |
| Corrective-action effectiveness | Actions closed with passing effectiveness evidence / actions due for verification | Cause, implementation, recurrence check and buyer decision |
| Change notification | Material changes notified and approved before use / changes requiring notice | Site, source, process, test, packing and subcontractor records |
Define every term before the period begins. “Accepted first time” might exclude a buyer-approved trial lot but include a lot released under concession; another company may classify it differently. Either approach can work if the rule is written, applied consistently and visible beside the result.
Use formulas without manufacturing precision
For a proportion, use eligible conforming events divided by eligible total events x 100. Show the count: 1/1 and 20/20 are both 100% but carry different evidence. Record “not applicable” when no event occurred. Put cancelled orders, buyer-caused delays and approved changes in a visible exclusions log.
Use severity-specific response clocks. Report median and worst-case time when volume allows; an average can hide one dangerously late case. Retain raw records so the score can be reconstructed.
Weights are a buyer choice, not a legal formula. Fix them before seeing results and show each component. Critical gates remain outside the total. Avoid ranking unlike sites or product routes through identical denominators.
Run an eight-step performance review
1. Freeze the scorecard unit
Identify the legal supplier, manufacturing site, tea family or SKU group, destination, intended use and period. Do not combine factories under one company name. FDA's FSVP framework is food-and-foreign-supplier specific; the same discipline prevents one strong route from masking another.
2. Copy requirements from controlled sources
Map each metric to the current contract, specification, approved sample, destination rule and buyer procedure. Record document versions and effective dates. A sales promise or historic email is not a stable scoring rule. Use the supplier change-control plan when the approved baseline changes.
3. Prewrite gates, targets and actions
Define green, review-required and unacceptable results without copying universal percentage bands. Reflect risk, volume and failure consequence. State who can approve an exception and which failures cannot receive a concession.
4. Reconcile the event population
List all orders, lots, document packs, inspected units, complaints, actions and notified changes in the period. Reconcile them to receiving, laboratory and quality systems. Let the supplier challenge factual omissions while the buyer retains decision authority.
5. Validate evidence before scoring
Confirm lot identity, sampling, method, units and decision rule before counting an analytical pass. The COA evidence guide explains why a report may still be outside the required lot, matrix or method scope. Match delivery and packing documents with receipt records.
6. Review trend and severity, not only totals
Separate critical, major and minor events using definitions written in advance. Plot results by lot or month and note repeated failure modes. Three similar liner failures deserve attention even if the overall package-conformity percentage looks high. A change in denominator can also explain an apparent improvement.
7. Link the result to risk-based control
Choose actions that address the weak measure: more representative testing for analytical uncertainty, tighter pre-shipment checks for pack defects, shorter document review cycles for repeated errors, or reapproval after a site change. For repeat problems, use the corrective-action effectiveness check rather than closing on a supplier promise.
8. Approve and communicate the decision
Record the reviewer, date, status, conditions, verification frequency, open actions and next trigger. Send the supplier the cases and calculation rules, not merely a coloured dashboard. Remedies, costs and suspension rights should come from the signed agreement.
Turn evidence into a controlled decision
| Finding pattern | Buyer response | Approval position |
|---|---|---|
| Gates pass; metrics stable; no material adverse trend | Maintain planned verification and routine review | Continue approval for the defined scope |
| Gates pass; one measure weak or data incomplete | Correct data, investigate cause, set a dated improvement action | Continue or condition approval under written authority |
| Repeated major failures or ineffective action | Increase verification, audit the relevant process and set reapproval evidence | Conditional approval or restricted scope |
| Critical gate failure or uncontrolled hazard | Hold affected lots, investigate scope, take required legal action and verify correction | Suspend or stop the affected supply route until authorised |
| New site, process, source or relevant risk information | Reevaluate the supplier-food combination and verification plan | Reapprove before relying on the changed arrangement |
Understand what the references do—and do not require
For importers covered by U.S. FSVP, 21 CFR 1.505 requires documented evaluation of the food's hazards and foreign-supplier performance, including procedures and practices, compliance information, food-safety history, test and audit results, responsiveness in correcting problems and other relevant factors. It requires prompt reevaluation when new information changes concerns and, absent an earlier reevaluation, at least every three years. Section 117.410 sets comparable risk-based supplier-program duties for covered receiving facilities. These are legal requirements for their defined U.S. operators, not a universal mandate to use this article's table or weights.
FDA's January 2023 final FSVP guidance is nonbinding. It suggests defined performance metrics such as specification compliance, audit scores, recalls, mock recalls, rejections or complaints and issue-response time. The ISO 9001 Auditing Practices Group guidance is also not a certification rule; it helps auditors examine approved-provider information, risk-based controls and effective performance monitoring. Codex CXC 1-1969 remains a voluntary international hygiene reference unless incorporated into law or contract.
- Legal requirement: binding supplier-evaluation and food-safety duties depend on jurisdiction and operator role.
- Voluntary standard: Codex or ISO-based systems can structure control but are not automatically law.
- Trade reference: OTIF, complaint rate and scorecard colour bands need local definitions.
- Buyer specification: defines product criteria, evidence, sampling and acceptance decisions.
- Contract requirement: allocates notice, access, improvement, cost, suspension and remedy rights.
Common buyer mistakes
- Averaging a legal or safety failure into a high total score.
- Combining different factories, products or destinations under one supplier number.
- Scoring only delivered orders and omitting cancelled or rejected events.
- Showing percentages without event counts or review-period dates.
- Changing targets, exclusions or weights after results are visible.
- Giving 100% when no complaint, audit or corrective-action event occurred.
- Counting a supplier COA as independent verification without checking scope.
- Letting minor document errors dominate more consequential recurring failures.
- Using the scorecard as a price-negotiation threat instead of a control record.
- Closing actions without later effectiveness evidence.
Practical conclusion
A defensible supplier review leaves a traceable chain: defined supplier-food scope - controlled requirements - non-negotiable gates - complete event population - transparent formulas - trend and severity review - risk-based action - authorised approval decision. The scorecard should make the next control obvious, not merely produce a ranking. Before starting a programme, use the factory verification checklist, confirm lot-level quality-control needs, and send Yunjing Tea the destination, tea, evidence and review requirements to align a quotation and supply specification.
Sources checked 14 September 2026: 21 CFR 1.505 and 21 CFR 117.410, eCFR Title 21 current through 10 September 2026; FDA Final Guidance for Industry: Foreign Supplier Verification Programs for Importers of Food for Humans and Animals, January 2023; ISO 9001 Auditing Practices Group, Guidance on External Providers, 13 January 2016; and Codex CXC 1-1969, General Principles of Food Hygiene, last modified 2022. Recheck the destination rule, certification scheme and signed contract for the actual importer and supply arrangement.
