Display lag
Display lag is a phenomenon associated with some types of liquid crystal displays like smartphones and computers, and nearly all types of high-definition televisions. It refers to latency, or lag measured by the difference between the time there is a signal input, and the time it takes the input to display on the screen. This lag time has been measured as high as or the equivalent of 3-4 frames on a 60 Hz display. Display lag is not to be confused with pixel response time. Currently the majority of manufacturers do not include any specification or information about display latency on the screens they produce.
Analog vs digital technology
For older analog cathode ray tube technology, display lag is extremely low, due to the nature of the technology, which does not have the ability to store image data before display. The picture signal is minimally processed internally, simply for demodulation from a radio-frequency carrier wave, and then splitting into separate signals for the red, green, and blue electron guns, and for the timing of the vertical and horizontal sync. Image adjustments typically involve reshaping the signal waveform but without storage, so the image is written to the screen as fast as it is received, with only nanoseconds of delay for the signal to traverse the wiring inside the device from input to the screen.For modern digital signals, significant computer processing power and memory storage is needed to prepare an input signal for display. For either over-the-air or cable TV, the same analog demodulation techniques are used, but after that, then the signal is converted to digital data, which must be decompressed using the MPEG codec, and rendered into an image bitmap stored in a frame buffer.
For progressive scan display modes, the signal processing stops here, and the frame buffer is immediately written to the display device. In its simplest form, this processing may take several microseconds to occur.
For interlaced video, additional processing is frequently applied to deinterlace the image and make it seem to be clearer or more detailed than it actually is. This is done by storing several interlaced frames and then applying algorithms to determine areas of motion and stillness, and to either merge interlaced frames for smoothing or extrapolate where pixels are in motion, the resulting calculated frame buffer is then written to the display device.
De-interlacing imposes a delay that can be no shorter than the number of frames being stored for reference, plus an additional variable period for calculating the resulting extrapolated frame buffer.
Causes of display lag
While the pixel response time of the display is usually listed in the monitor's specifications, no manufacturers advertise the display lag of their displays, likely because the trend has been to increase display lag as manufacturers find more ways to process input at the display level before it is shown. Possible culprits are the processing overhead of HDCP, Digital Rights Management, and also DSP techniques employed to reduce the effects of ghosting – and the cause may vary depending on the model of display. Investigations have been performed by several technology-related websites, some of which are listed at the bottom of this article.LCD, plasma, and DLP displays, unlike CRTs, have a native resolution. That is, they have a fixed grid of pixels on the screen that show the image sharpest when running at the native resolution. In order to display non-native resolutions, such displays must use video scalers, which are built into most modern monitors. As an example, a display that has a native resolution of 1600x1200 being provided a signal of 640x480 must scale width and height by 2.5x to display the image provided by the computer on the native pixels. In order to do this, while producing as few artifacts as possible, advanced signal processing is required, which can be a source of introduced latency. Interlaced video signals such as 480i and 1080i require a deinterlacing step that adds lag. Anecdotally, display lag is significantly less when displays operate in native resolutions for a given LCD screen and in a progressive scanning mode. External devices have also been shown to reduce overall latency by providing faster image-space resizing algorithms than those present in the LCD screen. In practice this would stack the internal and external latencies.
Many LCDs also use a technology called "overdrive" which buffers several frames ahead and processes the image to reduce blurring and streaks left by ghosting. The effect is that everything is displayed on the screen several frames after it was transmitted by the video source.
Testing for display lag
Display lag can be measured using a test device such as the Video Signal Input Lag Tester. Despite its name, the device cannot independently measure input lag. It can only measure input lag and response time together.Lacking a measurement device, measurement can be performed using a test display, a control display that would ideally have negligible display lag, a computer capable of mirroring an output to the two displays, stopwatch software, and a high-speed camera pointed at the two displays running the stopwatch program. The lag time is measured by taking a photograph of the displays running the stopwatch software, then subtracting the two times on the displays in the photograph. This method only measures the difference in display lag between two displays and cannot determine the absolute display lag of a single display. CRTs are preferable to use as a control display because their display lag is typically negligible. However, video mirroring does not guarantee that the same image will be sent to each display at the same point in time.
In the past it was seen as common knowledge that the results of this test were exact as they seemed to be easily reproducible, even when the displays were plugged into different ports and different cards, which suggested that the effect is attributable to the display and not the computer system. An in depth analysis that has been released on the German website revealed that these assumptions have been wrong. Averaging measurements as described above lead to comparable results because they include the same amount of systematic errors. As seen on different monitor reviews the so determined values for the display lag for the very same monitor model differ by margins up to or even more.
To minimize the effects of asynchronous display outputs a highly specialized software application called SMTT or a very complex and expensive test environment has to be used.
Several approaches to measure display lag have been restarted in slightly changed ways but still reintroduced old problems, that have already been solved by the former mentioned SMTT. One such method involves connecting a laptop to an HDTV through a composite connection and run a timecode that shows on the laptop's screen and the HDTV simultaneously and recording both screens with a separate video recorder. When the video of both screens is paused, the difference in time shown on both displays have been interpreted as an estimation for the display lag. Nevertheless, this is almost identical to the use of casual stopwatches on two monitors using a "clone view" monitor setup as it does not care about the missing synchronisation between the composite video signal and the display of the laptop's screen or the display lag of that screen or the detail that the vertical screen refresh of the two monitors is still asynchronous and not linked to each other. Even if V-sync is activated in the driver of the graphics card the video signals of the analog and the digital output will not be synchronized. Therefore, it is impossible to use a single stop watch for display lag measurements, nevertheless if it is created by a timecode or a simple stopwatch application, as it will always cause an error of up to or even more.
Effects of display lag on users
Display lag contributes to the overall latency in the interface chain of the user's inputs to the graphics card to the monitor. Depending on the monitor, display lag times between have been measured. However, the effects of the delay on the user depend on each user's own sensitivity to it.Display lag is most noticeable in games, with different games affecting the perception of delay. For instance, in World of Warcraft's PvE, a slight input delay is not as critical compared to PvP, or to other games favoring quick reflexes like Counter-Strike. Rhythm-based games, such as Guitar Hero, also require exact timing; display lag will create a noticeable offset between the music and the on-screen prompts. Notably, many games of this type include an option that attempts to calibrate for display lag. Arguably, fighting games such as Street Fighter, Super Smash Brothers Melee and Tekken are the most-affected, since they may require move inputs within extremely tight event windows that sometimes only last 1 frame or 16.67 ms on the screen.
By assuming a Gaussian human response time to a particular in-game event, it becomes possible to discuss the effect of lag in terms of probabilities. Given a lag-less display, a human has a certain probability to land his/her input within a window of frames. As video games operate on discrete frames, missing the last frame of the window even by 0.1 ms causes an input to be interpreted a full frame later. Because of this, any amount of lag will affect a human's ability to hit a particular timing window. The severity of this impact is a function of the position and variance of a human's response to a visual cue, the amount of lag introduced, and the size of the timing window. For example, given a very large window of 30 frames, a human would likely have a 99.99% chance of hitting this window. By introducing one frame of lag, the human's ability to hit the 30 frame window would likely remain in the 99.99% range. Given a smaller window of say 2 frames, however, the effect of lag becomes much more significant. Assuming the human's response is centered on the 2 frame window and the super-human has a 99.99% chance to hit the window, introducing a full frame of lag causes the success rate to drop all the way to about 50%.
If the game's controller produces additional feedback, then the display lag will cause this feedback to not accurately match up with the visuals on-screen, possibly causing extra disorientation.
TV viewers can be affected as well. If a home theater receiver with external speakers is used, then the display lag causes the audio to be heard earlier than the picture is seen. "Early" audio is more jarring than "late" audio. Many home-theater receivers have a manual audio-delay adjustment which can be set to compensate for display latency.