3D visionExplainer

Depth image field of view: why stereo coverage is smaller

Understand why depth image field of view differs from raw stereo images, then check overlap, output crops and usable coverage before choosing a mode.

LumaSpec Vision9 min read Share on LinkedIn

On this page 10 sections
  1. 01Separate four different kinds of coverage
  2. 02Shared coverage depends on working distance
  3. 03Output aspect ratio can remove a different part of the scene
  4. 04Invalid disparity borders are not necessarily cropped pixels
  5. 05Verify usable coverage with a controlled scene
  6. 06Budget usable pixels as well as physical width
  7. 07Compare operating modes before comparing products
  8. 08Check these items before ordering
  9. 09Know when the usual explanation is wrong
  10. 10Questions

A raw infrared image can show a surface that never appears in the depth map. That does not necessarily mean the sensor is partly disabled. Stereo depth requires usable observations from both cameras, followed by rectification, correspondence matching and output formatting. Each stage can reduce the region containing trustworthy measurements.

For inspection and positioning tasks, compare the usable depth footprint at your actual working distance, not just the image dimensions. The practical task is to separate geometric coverage, output cropping and failed measurements before choosing a camera or operating mode.

Separate four different kinds of coverage

The depth image field of view is not necessarily the field of view of either individual camera. It can describe several different boundaries, depending on the documentation or software display.

Coverage boundary What defines it What to check
Individual camera coverage Lens, active sensor region and acquisition mode Raw images from each camera separately
Shared stereo coverage Scene points visible to both cameras Overlap at the required working distance
Rectified output coverage Calibration maps, virtual camera geometry and cropping Rectified images and their output intrinsics
Valid depth coverage Successful matching, confidence rules and filtering Validity mask and measured depth values

An image can retain its full rectangular dimensions while containing invalid depth along one edge. Conversely, a smaller output can contain valid measurements across nearly its entire width. These are different problems and need different remedies.

Treat pixel dimensions as the size of the delivered array, not proof of an angular or physical footprint. The guide to live stereo rectification explains how paired images are transformed before correspondence matching.

Shared coverage depends on working distance

For a simplified stereo pair, assume parallel optical axes, equal focal lengths and a horizontal baseline. A surface must fall inside both viewing regions before stereo correspondence is possible. Near the cameras, their viewing regions overlap less than they do farther away.

The field-of-view diagram and accompanying angle calculation explain the single-camera geometry. The figure below illustrates that individual viewing cone; stereo adds a second, displaced cone whose intersection matters.

How sensor width, working distance and field of view set the focal length Rays from the edges of the sensor pass through the lens and spread to the edges of the field of view. The ratio of sensor width to field of view is the magnification m.CameraField of view (FOV)Working distance (WD)≈ fsensor width slensm = s / FOVf = WD × m / (1 + m)
How sensor width, working distance and field of view set the focal length. Rays from the edges of the sensor pass through the lens and spread to the edges of the field of view. The ratio of sensor width to field of view is the magnification m.

For an ideal rectified pair viewing a plane perpendicular to the optical axes:

Single-camera footprint width: W = Z × Nx / fx Disparity: d = fx × B / Z Shared footprint width: Wshared = max(0, W - B)

Here, Z is axial distance from the camera plane, Nx is image width in pixels, fx is horizontal focal length in pixels, and B is baseline. Use the same length unit for distance, baseline and footprint width. These equations are geometric estimates, not guaranteed coverage specifications.

Consider an illustrative pair with an image width of 1280 pixels, a focal length of 800 pixels and a baseline of 60 mm. At an axial distance of 600 mm:

W = 600 mm × 1280 / 800 = 960 mm d = 800 × 60 mm / 600 mm = 80 pixels Wshared = 960 mm - 60 mm = 900 mm

Each camera sees a footprint 960 mm wide, but their common footprint is only 900 mm wide. On this plane, the corresponding horizontal image shift is 80 pixels.

At 300 mm, the same ideal geometry gives an individual footprint of 480 mm and shared coverage of 420 mm. The missing fraction therefore grows at closer range. These calculations exclude distortion, rectification crops, occlusion and matching support requirements.

Baseline also affects depth sensitivity, so reducing it is not automatically the right solution. Read wide baseline stereo camera selection when balancing coverage against depth measurement requirements.

Output aspect ratio can remove a different part of the scene

Horizontal overlap does not, by itself, explain every vertical crop. Output modes can use different sensor regions, rectification maps, resizing operations or aspect ratios. A height reduction may therefore come from formatting rather than the physical baseline.

Suppose a hypothetical raw image contains 1280 × 800 pixels. A depth output contains 1280 × 720 pixels. If the depth mode preserves the same pixel scale and uses a centered vertical crop, it retains:

Retained vertical fraction = 720 / 800 = 0.90 Removed fraction = 1 - 0.90 = 0.10

That would remove 10% of the raw vertical coverage, split equally between top and bottom for a centered crop. In the earlier example, an ideal vertical footprint of 600 mm would become 540 mm.

However, those conclusions apply only if the operation is actually a crop. A resized image could preserve the field of view while reducing sampling density. A different readout mode could change both coverage and sampling.

Check the mode documentation and calibration parameters rather than inferring the operation from resolution alone. The explanation of undistortion scaling and field of view helps distinguish retained scene coverage from output image size.

Invalid disparity borders are not necessarily cropped pixels

A stereo matcher compares a reference-image location with candidate locations in the other image. Near an edge, the required corresponding location may lie outside the other camera's image.

In the worked example, a point on the target plane has a horizontal disparity of 80 pixels. Some edge locations in the reference image therefore lack a visible counterpart. Which edge is affected depends on the reference camera and disparity convention; do not assume identical missing strips on both sides.

Matching can remove additional coverage because it needs a neighborhood around each candidate. Some implementations also reserve borders for the configured disparity search range. Others evaluate candidates near the boundary differently. The exact behavior is implementation-specific.

Even inside the geometric overlap, valid depth is not guaranteed. Occlusion, low texture, reflections, saturation and confidence filtering can leave holes. A foreground edge can hide a background surface from one camera while leaving it visible to the other.

If the boundary is irregular or follows object edges, investigate correspondence quality before changing output resolution. Use stereo disparity map troubleshooting to separate alignment problems from matching failures.

Verify usable coverage with a controlled scene

Use a flat, textured target larger than the required inspection region. Keep it stationary and place it at the nearest, nominal and farthest intended working distances. A single test at the nominal position can conceal a close-range limitation.

  1. Record the mode configuration. Save stream dimensions, calibration selection, rectification settings, depth range and filtering options. Confirm which camera supplies the reference image.
  2. Capture both raw views. Identify target features near every edge. A feature missing from either raw image cannot produce ordinary stereo correspondence.
  3. Inspect the rectified pair. Check whether those same features survive the remapping. A rectangular missing strip introduced here points toward the rectification or output definition.
  4. Inspect disparity and validity. Separate invalid pixels from legitimate near or far measurements using the software's documented validity representation.
  5. Measure the usable footprint. Record physical width and height, the valid-pixel fraction, and the largest uninterrupted valid region covering the task.
  6. Repeat with representative parts. A textured flat target establishes geometric potential, but reflective, dark or deeply recessed parts may deliver less usable coverage.

Define acceptance around the actual inspection region. For example, a task may need valid measurements throughout a central 500 mm × 300 mm rectangle, rather than a high average validity score across the whole image.

The guidance on calibration target coverage margins helps size the target and leave room for positioning variation. If empty corners appear only after remapping, compare the symptoms with black borders after undistortion.

Budget usable pixels as well as physical width

A footprint can be large enough yet too sparsely sampled for the smallest feature. Calculate both requirements before accepting a mode.

Suppose the required inspection width is 600 mm. The smallest feature is 3 mm wide, and the task uses a planning target of 5 pixels across that feature:

Required horizontal pixels = inspection width / feature width × pixels per feature Required horizontal pixels = 600 mm / 3 mm × 5 = 1000 pixels

The 5-pixel target is an application assumption, not a universal detection rule. Contrast, optics, matching quality and the measurement algorithm determine whether it is adequate.

Camera resolution for the smallest feature
Units
Pixels needed
–
Sensor size
– MP
Smallest sensor that fits
–
Pixel on the part
– mm
Pixels across the feature, that sensor
–

Pixels needed = field / feature × pixels per feature on each axis (field incl. margin). The lens must resolve the pixels too: Nyquist = 1000 / (2 × pixel µm) lp/mm.

Find cameras with enough pixels Open the full calculator

Count usable pixels over the required footprint, not every column in the delivered array. Upsampling a depth map increases its dimensions but does not create additional independent measurements. Likewise, a confidence mask can reduce effective coverage without changing the nominal resolution.

Spatial sampling also differs from depth precision. Enough pixels across a feature does not establish acceptable uncertainty along the viewing direction. Validate that requirement separately with representative surfaces and distances.

Compare operating modes before comparing products

Start a mode comparison with a coverage worksheet. For each candidate, record raw-view coverage, rectified coverage, valid depth footprint, acquisition timing and measurement stability at the same distances.

A larger output mode is useful only when it improves the requirement that currently limits the application. If it merely interpolates an existing result, it may add processing load without improving coverage or detail.

The 3D sensors category and camera finder provide starting points for comparing acquisition architectures. Do not transfer the passive stereo assumptions above to every active depth system without checking its documented operation.

The MV-DLS300P-04 is listed as a laser galvanometer stereo camera.

3D sensorsHikrobot MV-DLS300P-04 Laser galvanometer stereo cameraMV-DLS300P-04
Type
Stereo / structured light
$16,579.00 · quotedView and quote

The MV-DPS200P-02 is listed as a projected structured-light camera.

3D sensorsHikrobot MV-DPS200P-02 Projected structured-light 3D cameraMV-DPS200P-02
Type
Stereo / structured light
$8,829.00 · quotedView and quote

These catalog descriptions identify acquisition approaches; they do not establish a particular depth footprint or output crop. Request mode-specific coverage information and representative captures before selecting either for a coverage-critical task. The illustrative calculations above are not specifications for these products.

Check these items before ordering

Use a short acceptance checklist that distinguishes the scene you need from the image the software displays:

  • Working-distance envelope: include the nearest surface, not just the mounting distance to the conveyor or fixture.
  • Required footprint: specify physical width and height, plus placement tolerances and motion margins.
  • Depth reference: identify the coordinate frame and image to which depth values are registered.
  • Output mode: confirm whether differences come from cropping, resizing, sensor readout or rectification.
  • Usable sampling: state the minimum valid region and required feature sampling, not resolution alone.
  • Surface behavior: test texture, gloss, dark materials and recesses that can cause missing correspondence.
  • Timing conditions: use the intended exposure, motion and acquisition sequence during acceptance testing.

Ask for measurements at the operating distances rather than one advertised viewing angle. A single angular figure cannot describe every near-range overlap boundary or scene-dependent validity limit.

Know when the usual explanation is wrong

Not every reduced-looking depth image is a stereo coverage problem. A viewer may stretch images into different windows, apply digital zoom or display only a selected region. Compare saved frames and metadata before drawing conclusions from screen appearance.

Registration into another camera's coordinate frame can also change the visible footprint and create holes. Resolution changes require the corresponding calibration information; reusing incompatible intrinsics can produce misleading geometry rather than a genuine field-of-view reduction.

If the depth boundary changes with illumination or surface texture while the raw scene remains unchanged, focus on measurement validity. The discussion of stereo depth lighting for dark surfaces addresses that distinction.

The right remedy follows the cause: choose another mode for an avoidable crop, revise geometry for insufficient overlap, or improve acquisition conditions for failed matching. Start the camera configuration process, or request help reviewing depth coverage with your required footprint, distance range and paired sample images.

Questions

Does a higher depth resolution always provide a wider field of view?

No. Output dimensions describe an array, while coverage depends on sensor readout, rectification, cropping and geometry. A larger mode might retain more scene area, provide denser sampling of the same area, or only resize an existing result. Compare documented mode behavior and captures at the same working distance.

Why can depth lose vertical coverage when the cameras are separated horizontally?

A horizontal baseline primarily changes horizontal geometric overlap in a parallel stereo pair. Missing vertical coverage can instead result from output aspect ratio, rectification or a selected sensor region. Compare raw and rectified frames to identify the stage where the top and bottom disappear.

Can increasing working distance recover missing stereo coverage?

Moving farther away generally increases the shared physical footprint for a parallel stereo pair. However, feature sampling becomes coarser, and depth uncertainty can increase for a given disparity uncertainty. Check coverage, smallest-feature sampling and depth performance together rather than solving only the footprint requirement.

What should a buyer request to verify usable depth coverage?

Provide the nearest and farthest surface distances, required physical inspection area, smallest feature and allowed depth error. Include representative materials, motion conditions and the desired output mode. Ask for paired images, validity information and measured usable coverage under those conditions, rather than relying on nominal resolution.