Sketch recognition describes the process by which a computer, or artificial intelligence can interpret hand-drawn sketches created by a human being, or other machine. Sketch recognition is a key frontier in the field of artificial intelligence and human-computer interaction, similar to natural language processing or conversational artificial intelligence
Uses and Applications
Research in sketch recognition lies at the crossroads of artificial intelligence and human–computer interaction. Recognition algorithms usually are gesture-based, appearance-based, geometry-based, or a combination thereof.
Advances in the field of sketch recognition would have significant application in the field of forensic science, in which sketches are often used to identify suspects associated with a crime.
In 2023, two developers used OpenAI's DallE-2 image generation platform to create a forensic sketch program. The program's results were described as "hyper-realistic" and purported the potential of exponentially decreasing the creation time of a forensic sketch, while increasing accuracy.
Sketch recognition technology has also been linked to applications in the fields of architecture, videogame production, animation, construction, and academia, among others.
See also
- Gesture recognition
- Handwriting recognition
- Human–computer interaction
- Multi-touch gestures
- Pen computing
- Sketch-based modeling
- Tablet computer
References
- Hammond, T. and Davis, R. (2005), "LADDER, a sketching language for user interface developers", Computers & Graphics, 2005, 29(4), pp. 518-532.
- Hammond, T., Logsdon, D., Peschel, J., Johnston, J., Taele, P., Wolin, A., and Paulson, B. A sketch recognition interface that recognizes hundreds of shapes in course-of-action diagrams. In Proceedings of the 28th of the international conference extended abstracts on Human factors in computing systems (CHI EA '10), 2010, pp. 4213-4218.
- Jorge, J. and Samavati, F. (2011), Sketch-Based Interfaces and Modeling, Springer
- IJRASET. "Forensic Face Sketch Construction and Recognition". www.ijraset.com. Retrieved 2024-01-10.
- Lei, Haopeng; Chen, Simin; Wang, Mingwen; He, Xiangjian; Jia, Wenjing; Li, Sibo (2021-05-25). "A New Algorithm for Sketch-Based Fashion Image Retrieval Based on Cross-Domain Transformation". Wireless Communications and Mobile Computing. 2021: e5577735. doi:10.1155/2021/5577735. hdl:10453/149881. ISSN 1530-8669.
- Xiang, Chloe (2023-02-07). "Developers Created AI to Generate Police Sketches. Experts Are Horrified". Vice. Retrieved 2024-01-10.
- "Papers with Code - Sketch Recognition". paperswithcode.com. Retrieved 2024-01-10.
- "Sketch Recognition". Microsoft Research. Retrieved 2024-01-10.
- Zhang, Lei (2021-08-21). "Hand-drawn sketch recognition with a double-channel convolutional neural network". EURASIP Journal on Advances in Signal Processing. 2021 (1): 73. Bibcode:2021EJASP2021...73Z. doi:10.1186/s13634-021-00752-4. ISSN 1687-6180.
- Korkut, Elif Hilal; Surer, Elif (2021). "Sketch Recognition for Interactive Game Experiences Using Neural Networks". In Baalsrud Hauge, Jannicke; C. S. Cardoso, Jorge; Roque, Licínio; Gonzalez-Calero, Pedro A. (eds.). Entertainment Computing – ICEC 2021. Lecture Notes in Computer Science. Cham: Springer International Publishing. pp. 393–401. doi:10.1007/978-3-030-89394-1_31. ISBN 978-3-030-89394-1. S2CID 240415939.
External links
- Notes on the History of Pen-based Computing (Youtube)
- Annotated Bibliography in Tablets, Gesture and Handwriting Recognition, and Pen Computing