Empirical evaluation of active sampling for CRF-based analysis of pages

Manabu Ohta, Ryohei Inoue, Atsuhiro Takasu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Citations (Scopus)

Abstract

We propose an automatic method of extracting bibliographies for academic articles scanned with OCR markup. The method uses conditional random fields (CRF) for labeling serially OCR-ed text lines on an article's title page as appropriate names for bibliographic elements. Although we achieved excellent extraction accuracies for some Japanese academic journals, we needed a substantial amount of training data that had to be obtained through costly manual extraction of bibliographies from printed documents. Therefore, this paper reports an empirical evaluation of active sampling applied to the CRF-based extraction of bibliographies to reduce the amount of training data. We applied active sampling techniques to three academic journals published in Japan. The experiments revealed that the sampling strategy using the proposed criteria for selecting samples could reduce the amount of training data to less than half or even a third of those for two academic journals. This paper also reports the effect of pseudo-training data that were added to training.

Original languageEnglish
Title of host publication2010 IEEE International Conference on Information Reuse and Integration, IRI 2010
Pages13-18
Number of pages6
DOIs
Publication statusPublished - Oct 22 2010
Event11th IEEE International Conference on Information Reuse and Integration, IRI 2010 - Las Vegas, NV, United States
Duration: Aug 4 2010Aug 6 2010

Publication series

Name2010 IEEE International Conference on Information Reuse and Integration, IRI 2010

Other

Other11th IEEE International Conference on Information Reuse and Integration, IRI 2010
CountryUnited States
CityLas Vegas, NV
Period8/4/108/6/10

Keywords

  • Active sampling
  • Bibliography extraction
  • CRF
  • Digital library
  • OCR

ASJC Scopus subject areas

  • Information Systems
  • Information Systems and Management

Fingerprint Dive into the research topics of 'Empirical evaluation of active sampling for CRF-based analysis of pages'. Together they form a unique fingerprint.

  • Cite this

    Ohta, M., Inoue, R., & Takasu, A. (2010). Empirical evaluation of active sampling for CRF-based analysis of pages. In 2010 IEEE International Conference on Information Reuse and Integration, IRI 2010 (pp. 13-18). [5558973] (2010 IEEE International Conference on Information Reuse and Integration, IRI 2010). https://doi.org/10.1109/IRI.2010.5558973