Shoulder surfing (computer security)


In computer security, shoulder surfing is a type of social engineering technique used to obtain information such as personal identification numbers, passwords and other confidential data by looking over the victim's shoulder, either from keystrokes on a device or sensitive information being spoken and heard, also known as eavesdropping.

Methods and history

This attack can be performed either at close range or from a longer range, for example by using a pair of binoculars or similar hardware. To implement this technique attackers do not require any technical skills; keen observation of victims' surroundings and the typing pattern is sufficient. Crowded places are the more likely areas for an attacker to shoulder surf the victim. In the early 1980s, shoulder surfing was practiced near public pay phones to steal calling card digits and make long-distance calls or sell them in the market for cheaper prices than the original purchaser paid. However, the advent of modern-day technologies like hidden cameras and secret microphones makes shoulder surfing easier and gives more scope for the attacker to perform long range shoulder surfing. A hidden camera allows the attacker to capture whole login process and other confidential data of the victim, which ultimately could lead to financial loss or identity theft. Shoulder surfing is more likely to occur in crowded places because it is easier to observe the information without getting the victim's attention.
There are two types of shoulder-surfing attack: direct observation attacks, in which authentication information is obtained by a person who is directly monitoring the authentication sequence, and recording attacks, in which the authentication information is obtained by recording the authentication sequence for later analysis to open the device. Apart from threats to password or PIN entry, shoulder surfing also occurs in daily situations to uncover private content on handheld mobile devices; shoulder surfing visual content was found to leak sensitive information of the user and even private information about third-parties.

Countermeasures

Gaze-based password entry

The basic procedure for gaze-based password entry is similar to normal password entry, except that in place of typing a key or touching the screen, the user looks at each desired character or trigger region in sequence. The approach can, therefore, be used both with character-based passwords by using an on-screen keyboard and with graphical password schemes as surveyed in. A variety of considerations is important for ensuring usability and security. Eye tracking technology has come a long way since its origins in the early 1900s. State of the art eye trackers offers non-encumbering, remote video-based eye tracking with an accuracy of 1˚ of visual angle. Eye trackers are a specialized application of computer vision. A camera is used to monitor the user's eyes. One or more infrared light sources illuminate the user's face and produce a glint – a reflection of the light source on the cornea. As the user looks in different directions the pupil moves but the location of the glint on the cornea remains fixed. The relative motion and position of the center of the pupil and the glint are used to estimate the gaze vector, which is then mapped to coordinates on the screen plane.
Researchers proposed ways to counter shoulder surfing on mobile devices by leveraging the front-facing camera for gaze-based password entry. For example, GazeTouchPIN and GazeTouchPass combine gaze input in the form of eye movements to the left/right, and touch input by tapping on-screen buttons. These methods are more secure than traditional touch-based input because they require shoulder surfers to observe the user's eyes, observe the user's touch input, and combine the observations.

Painting album mechanism

Painting Album Mechanism is an anti-shoulder surfing mechanism, which has characteristics of both recall and recognition graphical techniques. Instead of using a regular PIN or password that involves numbers and letters, users select the picture or colour they remember to unlock the system they are using. It was developed based on survey results of users' affinity of choices, and through observation on the way children paint pictures. When this mechanism was developed, results from the user's affinity of choice survey helped create these new lock options. The outcome of this has created three input schemes, named Swipe Scheme, Colour Scheme, and Scot Scheme. They are the methods for password creation. Each input scheme is not identical, and it is the user's choice to choose the input scheme they prefer. Swipe Scheme has been implemented in Microsoft Windows 8 and later however has drawn criticism for requiring the user use a secure enough gesture.
Input SchemesInput Methods
Swipe SchemeSwipe the pictures
Color SchemeTouched the picture, then, select the colored boxes.
Scot SchemeSwipe the picture and in the meantime, touch the pictures and select the colored boxes

Secret tap method

For access to sensitive information with a low risk of shoulder surfing, the secret tap method proposes a technique that does not expose the authentication information during entry, even if other individuals try to view the input process. Additionally, the risk of covert observation is not restricted to direct observation by other individuals, as camera recordings also pose a threat. Therefore, it is necessary to make the authentication process more complex in order to prevent authentication information from being stolen even if cameras and/or other individuals observe the information input process numerous times. One of the simplest forms of a secret tap method, implemented in many smartphones, are biometrics such as fingerprint scanning or facial recognition, which cannot be replicated by a shoulder surfer.
The secret tap authentication method can use icons or some other form of system. The goals of a secret tap system are:
The primary benefit of graphical passwords compared to alphanumeric passwords is the improved memorability. However, the potential detriment of this advantage is the increased risk of shoulder-surfing. Graphical passwords that use graphics or pictures such as PassFaces, Jiminy, VIP, Passpoints or a combination of graphics and audio such as AVAP are likely all subject to this increased risk unless somehow mitigated in implementation. The results indicate the fact that both alphanumeric and graphical password-based authentication mechanisms may have a significant vulnerability to shoulder-surfing unless certain precautions are taken. Despite the common belief that nondictionary passwords are the most secure type of password-based authentication, our results demonstrate that it is, in fact, the most vulnerable configuration to shoulder-surfing.

PIN entry

is used to authenticate oneself in various situations, while withdrawing or depositing the money from an automatic teller machine, unlocking a phone, a door, a laptop or a PDA. Though this method of authentication is a two step verification process in some situations, it is vulnerable to shoulder surfing attack. An attacker can obtain the PIN either by directly looking over the victim's shoulder or by recording the whole login process. On items such as mobile phones with glass, glossy screens, the user could leave smudges on the screen, revealing a PIN. Some highly advanced attacks use thermal cameras to see the thermal signature of the PIN entered. So, various shoulder surfing resistant PIN entry methodologies are proposed to make the authentication process secure. Examples include PIN pads with covers to protect the privacy of the user, a system implemented at most ATMs. Another example used in ATMs and some entry systems is that of the use of metal PIN pads, making thermal camera attacks nearly impossible due to their material.

Countermeasure testing

The cognitive trapdoor game has three groups involved in it: a machine verifier, a human prover, and a human observer. The goal of each group is that a human prover has to input the PIN by answering the questions posed by the machine verifier while an observer attempts to shoulder surf the PIN. As the countermeasures are by design harder to easily usurp, it is not easy for the observer to remember the whole login process unless the observer had a recording device.