International Standards - Update Guide

ISO 15781 ISO Logo

Measuring shooting time lag, shutter release time lag,
shooting rate, and start-up time lag

Updated: June 2019

The various timing parameters of a digital camera system are very important when capturing a scene, especially a moving scene. These parameters must work in harmony to allow the camera system to capture the desired scene. As a result, it is crucial to test all of the relevant timing factors to ensure an overall high-quality performance of the camera system.

ISO 15781 establishes the various measurements methods and the reporting requirements of shooting time lag, shutter release time lag, shooting rate, and start-up time for digital still cameras including mobile phones and tablets.

A recent update to the standard in June of 2019 put the focus on cameras that continuously shoot images into the buffer, which often results in negative shooting time lags. In these instances, the exposure button no longer triggers the exposure of an image but instead acts as a selector that chooses the last image added to the buffer causing the camera to store that particular image.

In addition, the new version of the standard provides the specifications on how to determine the shooting time lag of a camera that continuously focuses. In this case, the standard does not specify a setup that is used for the measurement, but it instead specifies the requirements that can be met by using different mechanical approaches.

Below is a list of products that we use in our test lab and that are specifically designed around the timing measurements outlined in ISO 15781. These products can be mixed and matched, depending on your requirements, to form a timing measurement solution. If you have questions or have specific requirements, please don’t hesitate to contact us.

  • LED-Panel: a timing measurement device that uses an LED frequency to determine the various timing parameters.
  • TE261: a slanted edge test chart to determine the SFR of a digital camera system.
  • iQ-AF Box: create low and bright light for shutter delay measurements of digital cameras.
  • iQ-Trigger: a mechanical finger to automatically press the shutter release button.
  • iQ-Analyzer: professional analysis software for evaluating your test results.
iQ-AF Box
LED-Panel

ISO/TS 19567-2 ISO Logo

Texture analysis using stochastic pattern

Published: June 2019

Over the last decade, there has been a push to use test charts that feature a “dead leaves target” when evaluating texture loss due to noise reduction in images of digital cameras. Finally, after much deliberation, the TC 42 working group has published ISO 19567-2 for texture analysis using stochastic patterns. This standard works in parallel with ISO 19567-1, which describes how to measure texture reproduction using test charts with cyclic patterns such as sinusoidal Siemens star charts.

The measurement and standardization of texture reproduction have continued to evolve from simple power spectrum analysis to a noise corrected power spectrum, and now to a cross-correlated analysis of the image that has revolutionized the image quality evaluation of cameras.

The “dead leaves target” is a stochastic pattern that consists of randomly arranged circles that vary in size and color and have a limited contrast. These features present a better representation of the texture found in natural objects. The measurement results are shown as SFR (spatial frequency response) curves from which a single value is obtained that represents the overall texture.

The TE276 is our main “dead leaves target” that we use to measure the texture reproduction performance of a digital camera. We also incorporate the pattern in the TE42 our multipurpose test chart. Our iQ-Analyzer evaluation software supports the standard and the test charts mentioned above.

Below is a select list of products that we use in our test lab when measuring a camera system using ISO 19567-2. If you have questions or have specific requirements, please don’t hesitate to contact us.

  • TE276: Dead leaves chart for measuring the texture reproduction of a digital camera.
  • TE42: our multipurpose test chart for measuring multiple image quality factors in a single image.
  • iQ-Flatlights: generate low light illumination with the iQ-Flatlights, our advanced iQ-LED test chart illumination devices.
  • iQ-Analyzer: professional analysis software for evaluating your test results.
TE276
TE42

ISO/TS 19093 ISO Logo

Measuring low-light performance

Published: September 2018

TThe performance measurement of a camera under low light conditions has always been important, however, as camera technology has progressed, low light performance has become the differentiator for camera systems especially mobile devices.

ISO 19093 describes the measurement methods of the low light performance of digital cameras including that of mobile phone cameras. This standard is somewhat unique because it does not provide a single set of thresholds or single light level for the individual image quality parameters to achieve for a high level of low light performance. However, it does specify the measurement procedure to move in the right direction of higher low light performance.

For mobile phones, the VCX (valued camera experience) standard builds on ISO 19093 and will soon include a published set of thresholds the VCX committee deems useful for cameras in mobile devices.

When we test the low light performance in our test lab, we do so strictly according to ISO 19093. We are the only providers of the specified TE42-LL multipurpose test chart that is used throughout the standard.

Below is a select list of products that we use in our test lab when measuring a camera system using ISO 19903. If you have questions or have specific requirements, please don’t hesitate to contact us.

  • TE42-LL: referenced directly in ISO 19093, the TE42-LL is our specifically designed test chart for low light performance evaluation.
  • iQ-Flatlights: generate low light illumination with the iQ-Flatlights, our advanced iQ-LED test chart illumination devices.
  • iQ-Analyzer: professional analysis software for evaluating your test results.
TE42-LL
Lab test scene

VCX 2.0 VCX Logo

An objective numeric indicator of the camera value of a smartphone

Updated: On-going, last meeting June 2019

VCX is a non-profit organization dedicated to objective image quality testing of mobile phone cameras. Each phone that is submitted for testing undergoes an independent evaluation and receives a numeric score. The camera is tested for its image quality performance under a variety of factors including bright light conditions, medium light conditions, low light conditions, flashing light, and response and performance. The final score is the sum of the performance of each image quality factor.

As mobile phone technology continues to advance, the organization continues to make adjustments and updates to the standard to accommodate the changing mobile phone industry. The organization is currently working on updating the standard from version 1.5 to 2.0.

Updates under development include changes to the light levels: 2000 lux D55 (daylight), 250 lux cool white LED (office light), and 10 lux warm white LED (indoor lighting). In addition, the low light performance will be determined based on ISO 19093 and the zoom function will be measured at all lighting conditions at 4x the standard focal length. Video analysis and an evaluation of the front camera using these same lighting conditions are also under consideration to be added to the standard.

Another update in development is testing the mobile phone image stabilization by using a new handshake profile that was recently developed for ISO 20954-2. This standard is used to evaluate the image stabilization of non-optical (mobile phone) systems.

The test lab at Image Engineering is one of only a few fully “trusted” VCX test labs, which means we are able to perform all of the necessary tests as outlined in the VCX whitepaper. Our lab team tests each of the six measurement components and sends the final score to the VCX-forum or requesting group.

Below is a select list of products that we use in our test lab when measuring a mobile phone using the VCX whitepaper. If you have questions or have specific requirements, please don’t hesitate to contact us.

  • iQ-Flatlight: iQ-LED-powered light sources used by the VCX members.
  • LED-Panel: analyze the various timing measurements of a mobile phone according to VCX.
  • TE42: multipurpose test chart for measuring various image quality factors.
  • iQ-Automator: fully automated mobile phone camera testing.
VCX testing
iQ-Automator

IEC-62676-5 IEC Logo

Descriptions and measurement methods of security and surveillance cameras

Published: June 2018

In today’s world, security and surveillance have become a huge part of our expectations and safety. As a result, the security industry has quickly become one of the most important imaging industries. As the industry continues to expand, it is crucial to develop performance standards of surveillance cameras to ensure high quality and safety. The first industry-wide standard was published in the summer of 2018, and more are currently in development.

IEC-62676-5 defines the measuring methods that are required when testing the image quality performance of a surveillance camera. It also outlines the necessary requirements for how the description and specifications should be properly written.

Many of our image quality measurement devices and test charts can test the performance of a surveillance camera according to the standard. Below is a select list of products that can be used to begin a test analysis. If you have questions or have specific requirements, please don't hesitate to contact us.

  • LG3: high-power light box with variable flicker mode for transparent test charts.
  • TE269: OECF test chart with 36 gray patches and contrast of up to 5,000,000:1.
  • TE281: test chart for measuring flare according to ISO 18844.
  • TE285: IR reflection chart for measuring the IR illumination operating distance.
  • iQ-Analyzer: professional analysis software for evaluating your test results.
Security camera testing
LG3