poster

Balancing error and supervision effort in interactive-predictive handwriting recognition

Authors:

Nicolás Serrano,

Albert Sanchis,

Alfons JuanAuthors Info & Claims

IUI '10: Proceedings of the 15th international conference on Intelligent user interfaces

Pages 373 - 376

https://doi.org/10.1145/1719970.1720034

Published: 07 February 2010 Publication History

Get Access

Abstract

An effective approach to transcribe handwritten text documents is to follow an interactive-predictive paradigm in which both, the system is guided by the user, and the user is assisted by the system to complete the transcription task as efficiently as possible. This approach has been recently implemented in a system prototype called GIDOC, in which standard speech technology is adapted to handwritten text (line) images: HMM-based text image modeling, n-gram language modeling, and also confidence measures on recognized words. Confidence measures are used to assist the user in locating possible transcription errors, and thus validate system output after only supervising those (few) words for which the system is not highly confident. However, a certain degree of supervision is required for proper model adaptation from partially supervised transcriptions. Here, we propose a simple yet effective method to find an optimal balance between recognition error and supervision effort.

References

[1]

R. Bertolami and H. Bunke. Hidden Markov model-based ensemble methods for offline handwritten text line recognition. Patt. Rec., 41:3452--3460, 2008.

Digital Library

Google Scholar

[2]

L. Likforman-Sulem, A. Zahour, and B. Taconet. Text line segmentation of historical documents: a survey. IJDAR, 9:123--138, 2007.

Digital Library

Google Scholar

[3]

D. Pérez et al. The GERMANA database. In ICDAR, pages 301--305, Barcelona (Spain), 2009.

Digital Library

Google Scholar

[4]

O. Ramos, N. Serrano, and A. Juan. Interactive-predictive detection of handwritten text blocks. In DRR XVII, San Jose (USA), 2010.

Google Scholar

[5]

N. Serrano, F. Castro, and A. Juan. The RODRIGO database. In LREC, 2010. (submitted).

Google Scholar

[6]

N. Serrano, D. Pérez, A. Sanchis, and A. Juan. Adaptation from partially supervised handwritten text transcriptions. In ICMI-MLMI, Cambridge (USA), 2009.

Digital Library

Google Scholar

[7]

L. Tarazón et al. Confidence Measures for Error Correction in Interactive Transcription of Handwritten Text. In ICIAP, Vietri sul Mare (Italy), 2009.

Google Scholar

[8]

A. H. Toselli et al. Integrated handwriting recognition and interpretation using finite-state models. IJPRAI, 18(4):519--539, 2004.

Crossref

Google Scholar

Cited By

View all

Quiros LBosch VSerrano LToselli AVidal E(2018)From HMMs to RNNs: Computer-Assisted Transcription of a Handwritten Notarial Records Collection2018 16th International Conference on Frontiers in Handwriting Recognition (ICFHR)10.1109/ICFHR-2018.2018.00029(116-121)Online publication date: Aug-2018
https://doi.org/10.1109/ICFHR-2018.2018.00029
Serrano NCivera JSanchis AJuan A(2014)Effective balancing error and user effort in interactive handwriting recognitionPattern Recognition Letters10.1016/j.patrec.2013.03.01037(135-142)Online publication date: 1-Feb-2014
https://dl.acm.org/doi/10.1016/j.patrec.2013.03.010
Serrano NGiménez ACivera JSanchis AJuan A(2014)Interactive handwriting recognition with limited user effortInternational Journal on Document Analysis and Recognition10.1007/s10032-013-0204-517:1(47-59)Online publication date: 1-Mar-2014
https://dl.acm.org/doi/10.1007/s10032-013-0204-5
Show More Cited By

Index Terms

Balancing error and supervision effort in interactive-predictive handwriting recognition
1. Applied computing
  1. Document management and text processing
    1. Document capture
      1. Document analysis
      2. Optical character recognition
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interactive systems and tools

Recommendations

Active learning strategies for handwritten text transcription
ICMI-MLMI '10: International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction

Active learning strategies are being increasingly used in a variety of real-world tasks, though their application to handwritten text transcription in old manuscripts remains nearly unexplored. The basic idea is to follow a sequential, line-byline ...
Interactive handwriting recognition with limited user effort

Transcription of handwritten text in (old) documents is an important, time-consuming task for digital libraries. Although post-editing automatic recognition of handwritten text is feasible, it is not clearly better than simply ignoring it and ...
Indic script family and its offline handwriting recognition for characters/digits and words: a comprehensive survey
Abstract
Handwriting recognition has become an active area of research in pattern recognition and machine learning in recent years. Handwriting recognition systems have a variety of applications ranging from digital character conversion to signboard ...

Comments

Information & Contributors

Information

Published In

IUI '10: Proceedings of the 15th international conference on Intelligent user interfaces

February 2010

460 pages

ISBN:9781605585154

DOI:10.1145/1719970

General Chairs:
Charles Rich
Worcester Polytechnic Institute, USA
,
Qiang Yang
Hong Kong University of Science & Technology, China
,
Program Chairs:
Marc Cavazza
Teesside University, UK
,
Michelle Zhou
IBM Research, China

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 February 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Poster

Conference

IUI '10

Sponsor:

IUI '10: 15th International Conference on Intelligent User Interfaces

February 7 - 10, 2010

Hong Kong, China

Acceptance Rates

Overall Acceptance Rate 746 of 2,811 submissions, 27%

Upcoming Conference

IUI '25

Sponsor:
sigai
sigai

30th International Conference on Intelligent User Interfaces

March 24 - 27, 2025

Cagliari , Italy

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

16
Total Citations
View Citations
158
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Quiros LBosch VSerrano LToselli AVidal E(2018)From HMMs to RNNs: Computer-Assisted Transcription of a Handwritten Notarial Records Collection2018 16th International Conference on Frontiers in Handwriting Recognition (ICFHR)10.1109/ICFHR-2018.2018.00029(116-121)Online publication date: Aug-2018
https://doi.org/10.1109/ICFHR-2018.2018.00029
Serrano NCivera JSanchis AJuan A(2014)Effective balancing error and user effort in interactive handwriting recognitionPattern Recognition Letters10.1016/j.patrec.2013.03.01037(135-142)Online publication date: 1-Feb-2014
https://dl.acm.org/doi/10.1016/j.patrec.2013.03.010
Serrano NGiménez ACivera JSanchis AJuan A(2014)Interactive handwriting recognition with limited user effortInternational Journal on Document Analysis and Recognition10.1007/s10032-013-0204-517:1(47-59)Online publication date: 1-Mar-2014
https://dl.acm.org/doi/10.1007/s10032-013-0204-5
Sanchez-Cortina ISerrano NSanchis AJuan ADuarte CCarriço LJorge JOviatt SGonçalves D(2012)A prototype for interactive speech transcription balancing error and supervision effortProceedings of the 2012 ACM international conference on Intelligent User Interfaces10.1145/2166966.2167035(325-326)Online publication date: 14-Feb-2012
https://dl.acm.org/doi/10.1145/2166966.2167035
del Agua MSerrano NCivera JJuan A(2012)Character-Based Handwritten Text Recognition of Multilingual DocumentsAdvances in Speech and Language Technologies for Iberian Languages10.1007/978-3-642-35292-8_20(187-196)Online publication date: 2012
https://doi.org/10.1007/978-3-642-35292-8_20
del Agua MSerrano NJuan A(2011)Language identification for interactive handwriting transcription of multilingual documentsProceedings of the 5th Iberian conference on Pattern recognition and image analysis10.5555/2021341.2021423(596-603)Online publication date: 8-Jun-2011
https://dl.acm.org/doi/10.5555/2021341.2021423
del Agua MSerrano NJuan A(2011)Language Identification for Interactive Handwriting Transcription of Multilingual DocumentsPattern Recognition and Image Analysis10.1007/978-3-642-21257-4_74(596-603)Online publication date: 2011
https://doi.org/10.1007/978-3-642-21257-4_74
Toselli AVidal ECasacuberta FToselli AVidal ECasacuberta F(2011)Interactive ParsingMultimodal Interactive Pattern Recognition and Applications10.1007/978-0-85729-479-1_9(179-193)Online publication date: 2011
https://doi.org/10.1007/978-0-85729-479-1_9
Toselli AVidal ECasacuberta FToselli AVidal ECasacuberta F(2011)Computer Assisted Transcription: General FrameworkMultimodal Interactive Pattern Recognition and Applications10.1007/978-0-85729-479-1_2(47-59)Online publication date: 2011
https://doi.org/10.1007/978-0-85729-479-1_2
Toselli AVidal ECasacuberta FToselli AVidal ECasacuberta F(2011)General FrameworkMultimodal Interactive Pattern Recognition and Applications10.1007/978-0-85729-479-1_1(1-45)Online publication date: 2011
https://doi.org/10.1007/978-0-85729-479-1_1
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Active learning strategies for handwritten text transcription

Interactive handwriting recognition with limited user effort

Indic script family and its offline handwriting recognition for characters/digits and words: a comprehensive survey