A fast eavesdropping attack against touchscreens

摘要: The pervasiveness of mobile devices increases the risk exposing sensitive information on go. In this paper, we arise concern by presenting an automatic attack against modern touchscreen keyboards. We demonstrate Apple iPhone — 2010's most popular device although it can be adapted to other (e.g., Android) that employ similar key-magnifying Our processes stream frames from a video camera surveillance or portable camera) and recognizes keystrokes online, in fraction time needed perform same task direct observation offline analysis recorded video, which unfeasible for large amount data. detects, tracks, rectifies target touchscreen, thus following camera's movements eliminating possible perspective distortions rotations real-world settings, our automatically recognize up 97.07 percent (91.03 average), with 1.15 errors (3.16 average) at speed ranging 37 51 per minute.