It starts with a feasibility gate on your real samples, because some visual tasks are not solvable at your line speed and it is cheaper to know that in week one. What follows is imaging design, annotated data, a validated model and a controlled line test — reported per defect class, with missed defects and false rejects counted separately.
Check my vision use caseTalk to a manufacturing engineerPrimary buyer: Quality Manager · Production Manager · Automation Manager · Engineering Manager · Plant Manager
Durations are typical, not guaranteed. What extends a schedule: missing or incomplete data, security and network approvals, hardware lead times, sample collection, installation access, the production schedule, ERP test access, and the time your team needs to review results.
No unplanned shutdown is expected. Any installation window or controlled interruption is agreed with you in advance and scheduled around production.
| Metric | How it is defined | Where the number comes from | Type |
|---|---|---|---|
| Precision per defect class | Of the parts flagged for a class, the share genuinely belonging to it — reported per class, never averaged into one figure. | Held-back validation set | Technical |
| Recall per defect class | Of the parts genuinely showing a class, the share detected — reported per class and per product variant. | Held-back validation set | Technical |
| False accept rate | Defective parts passed as good. Counted and reported separately from false rejects, because their business cost is completely different. | Held-back validation set | Technical |
| False reject rate | Good parts rejected. The number that decides whether operators will keep the system switched on. | Held-back validation set | Operational |
| Confusion matrix and sample count | Full class-by-class matrix with the number of samples per class, so the reader can judge how much the result is worth. | Held-back validation set | Technical |
| Processing latency and line-speed compliance | Inspection time per part against the available cycle time, measured on the line rather than on a workstation. | MSF platform data | Technical |
| Uncertain classification rate | Share of parts the model could not decide confidently, which is what the operator-confirmation flow has to absorb. | Held-back validation set | Operational |
| Uptime and operator confirmation behaviour | System availability during the line test, and how operators actually handled confirmations and overrides. | MSF platform data | Adoption |
Before implementation, MSF and your team agree how each metric is calculated, where the baseline comes from, what data is excluded, and what result supports a rollout decision. This page lists what gets measured; the actual targets belong in the written PoC scope, not in a marketing claim.
Commercial terms, hardware ownership, travel, integration scope and any rollout credit are defined in the written PoC proposal. They are not the same for every product, and this page does not promise them.
Overall accuracy is never used as the acceptance metric — on an imbalanced defect set it can look excellent while missing every defect that matters. Results are reported per class with sample counts, and no claim is made for defect types, variants or conditions that were not in the validated set.
It depends on how variable the defect and the product are, and the feasibility gate gives a specific number for your case. As a rule the constraint is not OK parts — those are everywhere — but genuine NOK examples per class, especially the rare defects that are the whole reason for the project.
Because on a line producing 2% defects, a model that passes everything scores 98% accuracy and catches nothing. Precision and recall per class, plus false accepts and false rejects separately, are the only numbers that describe what will actually happen on your line.
You get the reasoning, the imaging evidence and, where one exists, an alternative — a different inspection point, a different lighting geometry, or a sensor-based check instead of a visual one. A clear no in week one is a good outcome compared with a failed cell in month nine.
Not automatically, and this is stated in the limitation list rather than glossed over. A model detects what it was trained and validated on. New defect classes need new samples, retraining and a fresh validation — which is a normal, plannable activity, but it is not free.
Tell us the scope you have in mind and we will come back with a written PoC plan: what gets connected, what you provide, how success is measured and what the decision at the end looks like.