Computer Vision Proof of Concept

Prove Automated Inspection on Your Own Products

It starts with a feasibility gate on your real samples, because some visual tasks are not solvable at your line speed and it is cheaper to know that in week one. What follows is imaging design, annotated data, a validated model and a controlled line test — reported per defect class, with missed defects and false rejects counted separately.

Check my vision use caseTalk to a manufacturing engineer
Typical duration4–8 weeks
Pilot scopeOne inspection station, one product family, a bounded defect set
Primary buyerQuality Manager
Decision at the endAcceptance report, hardware design and scale recommendation

Is this the problem you need to solve?

  • Visual inspection depends on a person’s attention at the end of a long shift.
  • The same defect type keeps reaching the customer and nobody can say how often.
  • Inspection is the reason the line cannot run faster.
  • A previous vision project was accepted on an accuracy number and failed on the defects that mattered.

Primary buyer: Quality Manager · Production Manager · Automation Manager · Engineering Manager · Plant Manager

What this PoC will prove

Is the visual task solvable at all at your line speed, field of view and defect size?
What imaging, lighting and optics does it actually need?
What are precision and recall per defect class on samples the model has never seen?
What is the false accept rate — the missed defects — and separately the false reject rate?
Does it hold under your real conditions: vibration, dust, reflection, part position and variant changes?

Recommended pilot scope

  • One inspection station and one product family, including its real variants.
  • A bounded, named set of defect or verification classes — not "any defect".
  • Selected camera, lens and lighting, chosen after the imaging design step.
  • One reject or operator-confirmation flow, so a decision leads to an action.
  • Training, validation and acceptance samples kept strictly separate throughout.

What will be live during the PoC

Live inspection at the station on real parts, at real cycle time.
Per-class classification with the confidence behind each decision.
Reject or operator-confirmation action triggered by the result.
Image and result archive for every inspected part in the test period.

How this PoC runs

Week 1
Site, process and data readinessFeasibility gate on your samples and images: defect visibility, contrast, size relative to field of view, cycle time and the acceptable error levels. A negative result here is a valid and cheap outcome.Exit gate: Feasibility verdict issued before any hardware is specified.
Week 1–2
Imaging and lighting designImaging and lighting design: camera, lens, working distance, illumination geometry and mounting, tested on real parts rather than chosen from a catalogue.Exit gate: Images make the defect reliably visible to a human reviewer first.
Week 2–4
Data collection and annotationCollect and annotate a representative image set across variants, shifts and defect classes, and review the class distribution and the annotation quality honestly.Exit gate: Sample count and class distribution documented; acceptance set held back.
Week 3–5
Model training and offline validationTrain and validate offline on the separated data, reporting precision and recall per class, a confusion matrix and the uncertain-classification rate.Exit gate: Offline results meet the agreed thresholds on the held-back set.
Week 5–7
Controlled live operationControlled line test at real speed with the reject or confirmation flow active, tracking latency, uptime, false accepts and false rejects in production conditions.Exit gate: Line-speed compliance and error rates confirmed on live production.
Week 7–8
Rollout decision and business caseAcceptance report with metrics per class, failure examples, the limitation list, the hardware bill of quantities, integration architecture and scale recommendation.Exit gate: Go, adjust or stop.

Durations are typical, not guaranteed. What extends a schedule: missing or incomplete data, security and network approvals, hardware lead times, sample collection, installation access, the production schedule, ERP test access, and the time your team needs to review results.

No unplanned shutdown is expected. Any installation window or controlled interruption is agreed with you in advance and scheduled around production.

How success will be measured

How success will be measured
MetricHow it is definedWhere the number comes fromType
Precision per defect classOf the parts flagged for a class, the share genuinely belonging to it — reported per class, never averaged into one figure.Held-back validation setTechnical
Recall per defect classOf the parts genuinely showing a class, the share detected — reported per class and per product variant.Held-back validation setTechnical
False accept rateDefective parts passed as good. Counted and reported separately from false rejects, because their business cost is completely different.Held-back validation setTechnical
False reject rateGood parts rejected. The number that decides whether operators will keep the system switched on.Held-back validation setOperational
Confusion matrix and sample countFull class-by-class matrix with the number of samples per class, so the reader can judge how much the result is worth.Held-back validation setTechnical
Processing latency and line-speed complianceInspection time per part against the available cycle time, measured on the line rather than on a workstation.MSF platform dataTechnical
Uncertain classification rateShare of parts the model could not decide confidently, which is what the operator-confirmation flow has to absorb.Held-back validation setOperational
Uptime and operator confirmation behaviourSystem availability during the line test, and how operators actually handled confirmations and overrides.MSF platform dataAdoption

Before implementation, MSF and your team agree how each metric is calculated, where the baseline comes from, what data is excluded, and what result supports a rollout decision. This page lists what gets measured; the actual targets belong in the written PoC scope, not in a marketing claim.

What you need to provide

  • Representative OK and NOK parts or images, covering every variant and every defect class in scope.
  • Defect definitions, severity rules and the acceptable false-accept and false-reject levels.
  • Cycle time, line speed, field of view and the environmental conditions at the station.
  • PLC or reject interface details and any traceability requirement.

Who does what

Meta Smart Factory provides

  • Discovery workshop and scope facilitation
  • Solution configuration for the agreed scope
  • Integration and connection work inside that scope
  • MSF hardware listed in the proposal
  • Training for the pilot users
  • The KPI definitions and validation method
  • Issue tracking and support during the pilot
  • The final result report and rollout design
  • The feasibility verdict, imaging design and a validated model version with its evaluation reproducible.
  • Failure examples — the images it got wrong — rather than only the ones it got right.

You provide

  • A named business owner and a named technical owner
  • Timely access to users, the line, machines and approved systems
  • An accurate explanation of the process and the master data
  • Network, power, mounting and safety access
  • ERP, PLC and vendor documentation, plus the experts who know them
  • Representative samples or historical data
  • Validation that the baseline is fair
  • Feedback and the acceptance decision
  • Enough genuine NOK samples per class; rare defects are the hardest and the most important to supply.
  • Line access for the controlled test at normal production speed.

Defined in the written proposal

  • Panel PCs, tablets, servers and GPU servers
  • Cameras, lenses, lighting and enclosures
  • Scanners, printers, RFID readers, meters and sensors
  • Travel, installation, freight, import duty and local electrical work
  • Whether hardware is rented or purchased
  • Whether any PoC fee is credited against a rollout

Commercial terms, hardware ownership, travel, integration scope and any rollout credit are defined in the written PoC proposal. They are not the same for every product, and this page does not promise them.

What you receive at the end

  • Feasibility verdict with the reasoning behind it.
  • Imaging and lighting design validated on real parts.
  • A validated model version with a reproducible evaluation.
  • Metric report per defect class, with failure examples included.
  • Risk and limitation list covering the conditions that degrade it.
  • Hardware bill of quantities, integration architecture and rollout recommendation.

Dependencies, exclusions and limits

This PoC depends on

  • Enough genuine NOK samples per class — this is the most common cause of a delayed vision PoC.
  • Stable part presentation at the station, or an agreed fixture to achieve it.

Not included in this PoC

  • Defect classes not named in the scope, and product variants not represented in the samples.
  • Mechanical handling, fixturing and reject-mechanism construction.
What this PoC does not claim

Overall accuracy is never used as the acceptance metric — on an imbalanced defect set it can look excellent while missing every defect that matters. Results are reported per class with sample counts, and no claim is made for defect types, variants or conditions that were not in the validated set.

Go, adjust or stop — the decision gate

GoGo: per-class results meet the agreed thresholds at line speed — proceed to the station rollout on the delivered design.
AdjustAdjust: imaging, sample coverage or the class definitions need work; the failure examples show exactly where.
StopStop: the task is not reliably solvable at this speed and defect size, and you know it after weeks rather than after buying a cell.

Frequently asked questions

How many sample parts do you need?

It depends on how variable the defect and the product are, and the feasibility gate gives a specific number for your case. As a rule the constraint is not OK parts — those are everywhere — but genuine NOK examples per class, especially the rare defects that are the whole reason for the project.

Why not just report accuracy?

Because on a line producing 2% defects, a model that passes everything scores 98% accuracy and catches nothing. Precision and recall per class, plus false accepts and false rejects separately, are the only numbers that describe what will actually happen on your line.

What if the feasibility gate says no?

You get the reasoning, the imaging evidence and, where one exists, an alternative — a different inspection point, a different lighting geometry, or a sensor-based check instead of a visual one. A clear no in week one is a good outcome compared with a failed cell in month nine.

Will it work on new defect types later?

Not automatically, and this is stated in the limitation list rather than glossed over. A model detects what it was trained and validated on. New defect classes need new samples, retraining and a fresh validation — which is a normal, plannable activity, but it is not free.

Request this Proof of Concept

Tell us the scope you have in mind and we will come back with a written PoC plan: what gets connected, what you provide, how success is measured and what the decision at the end looks like.

Please do not send credentials, production database exports, employee records or confidential drawings through this form. If a PoC needs them, we set up an approved secure channel first.

Submissions are checked for abuse and logged, including IP address. You are responsible for what you submit.