spot_img
15.9 C
London
spot_img
HomeAI & Machine LearningHow Televisions Are Tested by CNET

How Televisions Are Tested by CNET

Did you know that CNET opinions Monitors by comparing them to one another in a side-by-side roster after each has been tested and compared using professional equipment and software? Did you know the primary tool used to measure those screens charges about$ 28, 000? Did you know that CNET TV reviews include game, 4K large active range&nbsp, performance, gaming, off-angle and beautiful room evaluations, as well as testing bright TV features, voice commands, and other things?

Yes, we’re biased, but we consider CNET’s Television reviews the best in the business. We’ve been doing it for more than 20 years, and we’ve refined the procedure to help you choose the best TV to purchase. We have a proven set of tools and techniques designed to arrive at unbiased effects using video-quality analysis tools, goal assessment criteria and skilled experts. How do we go about doing it?

Read more: Best Televisions of 2025

culture and tools for testing

The most important part of test equipment is an expert eye. A competent evaluator with a background in reviewing related types of TVs cannot substitute for the latest equipment and test styles. CNET’s Screen readers, David Katzmaier and Ty Pendlebury, have considerable knowledge reviewing and calibrating features.

The primary TV lab at CNET is a sizable space where we setup assessment teams. There are curtains over the windows to prevent out light– or say it for daylight viewing tests– and a massive curtain divides the space from the rest of the lab. For TV assessment, lighting control is a big deal. We perform most measurements in total shadow, as is the industry standard, to remove the TV’s result from ambient lighting. To reduce light contamination and improve background contrast, the walls are painted dark grey, and the floors and ceiling are also dark.

Behind the curtains lies the TV lab

Curtains allow the facility to obtain great darkness and independent TV tests from the rest of CNET’s NYC lab. David Katzmaier/CNET
CNET_TV_LAB_28.jpg

The Konica Minolta CS-2000.

One of the most accurate electrical check equipments of its kind is the Konica Minolta CS-2000 spectroradiometer, which retails for about$ 28, 000. It measures light and colour from any type of show, including OLED, LCD and LED-based flat sections.

Here’s a list of the various test tools and hardware we have:

    &nbsp, Murideo 6G: A message machine that outputs a variety of test habits at different resolutions and formats, including 4K HDR and 1080p, via HDMI. The main generator for our evaluation is this. Its test patterns primarily consist of windows of white, gray or color in the middle of a TV’s screen, which are measured by the CS-2000 to evaluate the TV’s capabilities.

  • The AVLab DVDO TPG and  Quantum Data 780, which can be used for quick checks using their native patterns, are secondary signal generators.
  • Murideo 6A: A signal analyzer used to evaluate HDMI sources and devices for HDR, Dolby Vision and bandwidth.
  • <a href="http://sensing.konicaminolta.us/products/ls-100-luminance-meter/” target=”_self”>Konica Minolta LS-100: A very accurate handheld luminance meter that can be used to spot-check luminance when comparing products and when the larger CS-2000 is not practical.
  • AVPro 8×8 4K UHD Matrix Switch: &nbsp, This HDMI distribution amplifier and switch can send any one of eight HDMI sources to as many as eight screens simultaneously without any signal degradation, or send separate sources to each display. This setup is used for side-by-side comparison testing. &nbsp,
TV lab testing equipment

Sony UXP-700 Blu-ray player, AVPro 8×8 4K UHD Matrix Switch, and Oppo BDP-203 Blu-ray player, top. David Katzmaier/CNET

What reference and testing software do we use, as shown in this table:

    Portrait Displays Calman Ultimate: This flexible software program controls both our spectroradiometer and signal generators via a laptop PC to aid in the evaluation process. The majority of the figures in the CNET’s TV reviews, including color, brightness, black level, gamma, and more, are derived from its reports.

  • Spears &amp, Munsil HDR benchmark 4K Blu-ray: Our primary test Blu-ray disc. This includes a montage of 4K HDR video and numerous test patterns to enhance the signal generators. &nbsp,
  • Patterns from this disc are used to evaluate motion resolution in FPD Benchmark Software for Professional ( Blu-ray ).
TV lab testing equipment

Portrait Displays Calman software controls the spectroradiometer and signal generator to measure a television.

David Katzmaier/CNET

TV review samples and series reviews

CNET TV reviews are based on one reviewer’s hands-on knowledge of a single sample of a different model and size. While our experiences are usually representative, we can’t always be sure of that since performance can vary from sample to sample– particularly if newer samples receive updated firmware, or if manufacturers make changes without updating the model name. We typically review models as soon as possible, so we frequently receive early firmware updates that are occasionally updated. However, we never review preproduction samples. As far as we can tell, all of the samples used in CNET TV reviews are shipping models.

CNET obtains most of its review samples directly from manufacturers, typically by an editor asking a public relations representative for the desired model. Unfortunately, this can lead to manufacturers sending false samples or even tampering with the samples before they are sent to ensure better reviews. If we spot a blatant case of tampering, we’ll note it in the review, but we can’t always prove it ( and in case you’re wondering, no, we’ve never spotted a case of tampering that we could prove enough to mention in a review ). Sometimes we purchase the model in question ourselves if a manufacturer can’t send a sample or doesn’t want us to review a particular set.

How we test TV's in the CNET Lab

Side-by-side comparisons are the heart of CNET’s TV reviews.

David Katzmaier/CNET

Test procedure

We make an effort to test every TV we review consistently using the test method below. In cases where not all of the tests are followed, we’ll note the missing items in the review.

CNET TV reviews are conducted in a completely darkened environment, aside from the bright-room portion of the test ( see below ). We realize that most people don’t always watch TV in the dark, but we use a dark environment for a number of reasons. The most crucial aspect of darkness is the removal of the light’s ability to glare the TV’s screen, which can affect how the image appears. It makes differences in image quality easier to spot, especially perceived black-level performance, which is severely affected by ambient light. Additionally, darkness makes it easier for viewers at home to compare the reviewer’s opinions. Finally, darkness is the environment we find most satisfying for watching high-quality material on a high-performance TV.

Remote controls lined up in the TV testing lab

Lots of TVs and sources equate to lots and lots of remotes. David Katzmaier/CNET

Measurement:   As of 2022, we no longer calibrate the TVs we review. The main reason is that buyers are unlikely to pay for a professional calibration, so the measurements we take of the raw, uncalibrated picture settings provide a more representative comparison. There are also a few other causes of the change. First off, 4K and HDR material is becoming more common, and we never calibrated for HDR in the first place. Additionally, we’ve discovered that over time, the most accurate preset picture settings have improved.

Once the TV is warmed up, we perform a series of measurements using the spectroradiometer and Calman software. The screen’s center is set at a specific distance ( 18 inches ) from the lens. We measure every picture mode for both SDR and HDR sources and choose the best and most accurate ones for my comparisons. The most accurate modes are generally Movie, Cinema, or something similar, while the brightest modes are typically Vivid or Dynamic. We judge each mode’s accuracy based on the accepted standards for color, gamma and HDR EOTF, or Electro-Optical Transfer Function, and report which modes are most accurate in the review.

TV testing in darkness with curtains closed

We evaluate TV performance both in the dark and under lights. David Katzmaier/CNET

Side-by-side comparison: During the evaluation, CNET compares each TV to other devices in the room. This is a direct, side-by-side comparison, the TVs are literally lined up next to one another and compared in real time, with the reviewer recording observations on a laptop computer. The AVPro distribution amplifier, a device that can feed multiple TVs the exact same signal without deterioration, is used to power numerous sources. The TVs being compared often share similar prices, screen sizes and other characteristics, but can just as often be more or less expensive or have different characteristics to better illustrate major differences ( such as between LCD and OLED, or an extremely expensive set versus a less-expensive model ).

With these comparisons, CNET can make definitive, context-based comparisons about nearly every aspect of a TV’s performance.

How we test TV's in the CNET Lab

Gaming tests help determine how TVs can take advantage of the latest console’s features.

David Katzmaier/CNET

Image-quality tests: &nbsp, We perform a broad range of tests on all televisions we review, organized into a few key categories. &nbsp,

    TV and movies: We watch HDR and standard dynamic range examples of TV shows and movies, as well as reference video from the Spears &amp, Munsil benchmark disc, and note differences.

  • Gaming: We observe the effects of gaming modes and settings, as well as the 4K/120Hz and VRR input capabilities when we play a variety of games, typically from an Xbox Series X or PlayStation 5. We also measure and report input lag.
  • Bright lighting:  We turn on the lights in our testing area and open the windows during the day to see how the TV handles the ambient light. We note the screen’s reflectivity compared with its peers, as well as its ability to maintain black levels. A table that uses the standard 10 % window can be used to determine objective brightness measurements or various picture modes is also included in this section. &nbsp,
  • Uniformity and viewing angle:  We use this section to discuss uniformity across the screen, making subjective observations using full-raster test patterns, letterbox bars, and flat-color scenes. We also talk about off-angle viewing in this section, using similar material and subjective comparisons. &nbsp,
Samsung_PNF8500_35566923_35731512_35731513_23.jpg

The Leo Bodnar input lag tester.

Sarah Tew/CNET

Picture settings notes and Geek Box&nbsp,

At the end of the TV review, you’ll find our suggested picture mode and any additional information on how accurately the picture came out for us. We no longer list specific numeric settings because they can vary from sample to sample.

Many of the objective results we obtain from measurements are contained in the Geek Box. It’s been overhauled continually over the years as our testing evolves and is somewhat shorter in 2025 ( we replaced the individual color measurements with a simple average, for example ).

The results, score, and test columns are all in the box. Each test is detailed below. The outcomes of each test are either numerical or numerical. Each score is either Good, Average or Poor. Based on recommendations from the Calman software, data from previous reviews, and editorial discretion, we set the cutoffs for those scores.

The color and saturation&nbsp, results list error levels, namely DeltaE 2000 as reported by Calman, compared to the industry reference. Results of 3 or lower are Good, 5 or lower are Average, and higher than 5 are Poor. &nbsp,

TV lab testing equipment

In the Geek Box, among other things, are reported color measurements. David Katzmaier/CNET

The Geek Box also includes information on:

Black luminance ( 0 % ): This is the black level in nits from a custom test pattern ( User Defined window with Pattern Size 15, Pattern APL 10 on the Murideo SixG ) using the most accurate SDR and HDR picture mode. Good is anything less than or equal to 0.27, Average is 0.65, and Poor is anything higher.

Peak white luminance ( 10 % win ): This is the maximum brightness in nits using the brightest ( but not necessarily the most accurate ) SDR and HDR picture mode. Good is 500 or higher ( 1, 000 for HDR), Average is 300 or higher ( 700 for HDR), and Poor is anything other than that.

Avg. Gamma ( 10 to 100 % ): Only used to compare the 2.2 standard and the progression from dark to bright. Deviations of 0.1 or lower are Good, 0.2 or lower Average and higher than 0.2 Poor.

This is the lowest ( fastest ) lag measurement in milliseconds for SDR and 4K HDR sources, typically using the TV’s game mode, unless otherwise noted in the review.

Gamut % UHDA/P3 ( CIE 1976 ): Only reported for HDR, this is the P3 color gamut coverage using the CIE 1976 color space. 90 % or higher is Average, and less than 90 % Poor, respectively. 95 % or higher is Good.

Note that while these numbers and scores are useful, they don’t necessarily represent the full picture quality of a display, and we consider many other factors when arriving at the numeric performance score in a CNET review.

spot_img

latest articles

explore more

LEAVE A REPLY

Please enter your comment!
Please enter your name here

en_USEnglish