Choosing an inspection method is not the same as choosing a camera. A polished demonstration can hide missing defect classes, narrow material variation, or a decision that arrives too late. This comparison helps you evaluate AI, rule-based tools, and combined approaches using the same production evidence. You will be able to define a fair trial, interpret inspection errors, and specify acceptance criteria before committing to hardware or software.
Start with the inspection decision
Choose rule-based inspection when you can express acceptance through stable, measurable features: an edge position, hole count, distance, or intensity range. Choose AI when acceptable appearance varies in ways that are difficult to describe explicitly, but representative examples are available. Combine them when appearance classification and dimensional checks answer different questions.
Neither method repairs an image that does not reveal the defect. Establish contrast, focus, exposure, and part presentation first. The lighting selection guide explains how to make the feature visible, while the lens selection guide addresses image scale and optical constraints.
Use this table to choose what to trial, rather than declaring a universal winner.
| Inspection condition | Rule-based starting point | AI starting point | Evidence needed |
|---|---|---|---|
| Stable geometry with explicit limits | Edge, position, count, or measurement tools | Usually unnecessary for the measurement itself | Repeatability near each acceptance limit |
| Variable texture with cosmetic defects | Possible, but thresholds may become complicated | Classification or anomaly detection may suit the task | Normal texture variation and subtle defects |
| Missing component with predictable position | Presence and location checks | Useful when appearance varies substantially | Missing, shifted, obscured, and acceptable examples |
| Several visually similar defect types | Separate explicit checks where feasible | Supervised classification may help | Independently labeled examples for every class |
| Few defective samples available | Start with measurable defect mechanisms | Anomaly detection is a candidate, not a guarantee | Broad normal variation and independent defect challenges |
| Appearance plus dimensional requirements | Direct measurement for dimensions | Appearance screening alongside measurement | Separate acceptance evidence for each requirement |
Build a representative evaluation set
Write the acceptance definition before collecting images. “Looks wrong” is insufficient when two reviewers disagree about a marginal surface mark. Define defect classes, minimum relevant severity, permitted variation, and the disposition of uncertain parts.
Collect physical parts across production conditions, not just convenient images from one tray. Include different material lots, shifts, orientations, and positions within the allowed fixture tolerance. Add acceptable cosmetic variation that might resemble a defect.
Keep development data separate from acceptance data. For AI, separate training, validation, and final test sets. For rule-based inspection, reserve an equivalent untouched test set after adjusting thresholds. Otherwise, repeated tuning can make either method look better than it generalizes.
Split by physical part or production batch where appropriate. Ten images of the same scratch are not ten independent examples of manufacturing variation. Keep near-duplicate images together so they cannot leak between development and final testing.
For supervised training, include acceptable backgrounds and relevant negative examples without inventing object labels. The guide to background images in object detection training explains that distinction when object detection is part of the proposed method.
Maintain a sample register containing:
- Physical part identifier and image identifier.
- Defect class, severity, and agreed reference disposition.
- Material lot and relevant production condition.
- Dataset assignment and labeling revision.
- Capture settings and inspection recipe version.
Compare false accepts and false rejects separately
A false accept is a defective part incorrectly passed. A false reject is an acceptable part incorrectly rejected. Report both, using their correct denominators.
Do not rank methods using overall accuracy alone. If defects are rare, passing almost everything can produce an impressive percentage while missing the parts that matter most.
Record errors by defect class and severity. A method that detects obvious missing components but misses fine cracks should not receive one reassuring combined score. Also record uncertain decisions, failed acquisitions, timeouts, and missing outputs separately. Define their production disposition before testing.
A classification confidence or anomaly score is not automatically the probability that a part is acceptable. Its interpretation depends on the tool and validation evidence. Compare decisions against independently assigned reference labels, not against the apparent strength of a display score.
Set acceptance limits from process risk and operational requirements. Reject handling capacity matters, but it does not justify passing unacceptable defects. If a decision contributes to personnel protection, ordinary quality-inspection performance is not a substitute for a compliant safety design.
Work through a blind-test example
Suppose both methods inspect the same reserved set of 2,000 acceptable parts and 200 defective parts. These are illustrative trial quantities, not a universal sample-size recommendation.
Before testing, the team permits no more than one false accept and 20 false rejects in this particular trial. Those counts are test acceptance criteria, not proof of future production rates.
| Measurement | Rule-based trial | AI trial |
|---|---|---|
| Defective parts incorrectly passed | 2 | 1 |
| Acceptable parts incorrectly rejected | 10 | 30 |
| False-accept rate | 2 / 200 = 1% | 1 / 200 = 0.5% |
| False-reject rate | 10 / 2,000 = 0.5% | 30 / 2,000 = 1.5% |
| Meets both declared count limits | No | No |
The AI trial passes fewer defective samples, but rejects more acceptable parts. Neither method meets both requirements. Choosing the lower false-accept percentage alone would ignore the declared rejection limit.
Investigate which parts caused each error. Perhaps the rule-based method misses low-contrast damage, while AI rejects a legitimate texture variation absent from training. Those findings suggest different corrective actions. Any revised method needs a fresh held-out evaluation rather than repeated optimization against the original acceptance set.
Zero observed misses also needs context. With independent, representative defective samples and zero misses, the approximate one-sided 95% upper confidence bound on the miss probability is 3 divided by the sample count. Zero misses among 300 defective samples therefore gives roughly 3 / 300 = 1%, not evidence of zero future risk. Correlated samples weaken that interpretation.
Measure the complete decision deadline
Compare timing on the proposed execution hardware using the intended image size, tool sequence, communications, and logging. An offline processing benchmark does not establish when a machine receives a usable decision.
For an illustrative conveyor, a 200 mm part pitch at 1,000 mm/s produces this arrival interval:
Here, the other allocations represent trigger and image delivery, communication and output handling, and an engineering reserve. They are example budget entries, not specifications for any catalog product. The real deadline also depends on reject position, actuator response, and part tracking.
Measure trigger-to-decision latency, its distribution, and the slowest observed cycles under the specified load. Also measure sustained throughput: a pipeline can accept frequent images while individual decisions still arrive too late.
Run the trial with image saving, operator displays, and network traffic enabled as production requires. The guide to CPU time versus wall-clock time explains why processor activity and elapsed decision time are different measurements.
Separate software capability from hardware selection
The smart cameras category and camera finder help shortlist hardware. They do not establish which AI tools, rule-based functions, licenses, or export options a particular configuration supports.
For a camera-based shortlist, consider the MV-SC3050XC-16M-ATN-H. Treat it as a hardware candidate whose required inspection functions must be confirmed before purchase.
- Interface
- Fast Ethernet
- Resolution
- 5 MP
- Sensor format
- 1/1.45"
- Shutter
- Global
The LS-SMC-0063 is another catalog candidate for that review. Apply the same image-quality, software-capability, and acceptance-test requirements rather than assuming equivalent toolsets.
- Interface
- GigE
- Resolution
- Up to 3 MP
If processing needs to be separate from the camera, review vision controllers. Include the MV-VC3301H-128G66 in that hardware discussion without assuming support for an unlisted AI workflow.
- LAN ports
- 5+ LAN ports
- USB 3 ports
- 3-4 USB 3 ports
- Light outputs
- 4 built-in channels
- Memory
- 8 GB
Ask for written confirmation of training location, runtime location, supported tools, model deployment, license scope, and version compatibility. The smart camera software compatibility checklist covers those purchasing questions. The guide to on-camera image processing helps distinguish device-side functions from work requiring separate processing.
Specify acceptance evidence before ordering
Give the supplier an acceptance protocol, not only a folder of favorable images. State the inspection region, defect definitions, permitted presentation variation, and required machine output.
Require the trial report to identify the exact configuration evaluated. Record optics, illumination, acquisition settings, software version, recipe, model revision, threshold settings, and execution hardware. Preserve the reference images and decisions so later changes can be compared fairly.
Confirm whether the demonstration used live acquisition or previously saved images. Replaying a fixed dataset is useful for comparing algorithms, but live testing is necessary to expose trigger handling, focus variation, communication delays, and part association errors.
Ask what happens after a material change or recipe update. A method that requires retraining for routine variation creates different maintenance work from a method requiring threshold adjustments. Neither is maintenance-free. Define who approves changes, which evidence is retained, and how the previous validated configuration is restored.
Agree on a controlled response to lost communication, failed acquisition, uncertain classification, and unavailable inspection. Do not silently convert these conditions into pass decisions.
Know when the usual recommendation is wrong
AI is not automatically the right answer for difficult images. If a defect disappears into glare, improve the image before collecting more training data. A learner cannot reliably classify a feature that acquisition repeatedly hides.
Rule-based inspection is not automatically simpler to maintain. A recipe containing many interacting exceptions may be harder to validate than a carefully bounded appearance classifier. Compare maintenance effort over expected product changes, not just initial setup time.
Anomaly detection does not guarantee detection of every unseen defect. Unusual acceptable variation can trigger rejection, while some real defects may resemble learned normal appearance. Challenge the method with independently selected defects and review errors by mechanism.
A hybrid approach may be appropriate: locate the part with geometric tools, inspect appearance with AI, and verify dimensions separately. Validate the combined decision logic, because additional processing and alignment stages can introduce new failure modes.
Use a short purchase checklist
Before committing, confirm these points:
- Defined decision: acceptance limits and uncertain-part handling are documented.
- Representative evidence: normal variation and relevant defect classes are covered.
- Independent testing: development images are separated from final acceptance samples.
- Separate error rates: false accepts and false rejects use explicit denominators.
- Timing proof: complete decision latency and sustained throughput meet machine requirements.
- Confirmed functionality: tools, licenses, deployment, and compatibility are documented.
- Controlled changes: recipes, models, thresholds, and rollback procedures are retained.
- Production verification: a monitored launch checks performance against new manufacturing variation.
Start a hardware shortlist with the camera configurator. Then send your acceptance protocol and representative sample requirements through applications support so the proposed system can be evaluated against your inspection decision, not just a demonstration image.
Questions
When should you choose AI instead of rule-based inspection?
AI is worth evaluating when acceptable appearance varies substantially and explicit thresholds become difficult to maintain. Rule-based tools are often a better starting point for stable geometry, counts, and defined measurements. Select the method using independent production samples and separate limits for missed defects, unnecessary rejects, and decision latency.
How many samples do you need to evaluate an AI inspection?
There is no reliable universal minimum. The required dataset depends on appearance variation, defect classes, defect severity, and the statistical confidence required. Separate the quantity needed to develop the model from the independent evidence needed to accept the inspection. Repeated views of one part do not replace diverse physical samples.
Can one smart camera combine AI and rule-based tools?
Some software environments support combined workflows, but the catalog information here does not establish that capability for a particular configuration. Confirm supported tools, execution order, licenses, and deployment restrictions. Then test the complete workflow, including alignment failures and timing, rather than accepting separate demonstrations of its individual tools.
What should you request before buying an inspection system?
Use a written protocol covering sample selection, reference labels, separate error limits, timing deadlines, and abnormal-condition handling. Request a report identifying the hardware, acquisition settings, software, recipe, model revision, and thresholds used. Retain an independent acceptance set and document who approves future changes.


