TY - GEN

T1 - Mining pure patterns in texts

AU - Yamada, Yasuhiro

AU - Nakatoh, Tetsuya

AU - Baba, Kensuke

AU - Ikeda, Daisuke

N1 - Copyright:
Copyright 2013 Elsevier B.V., All rights reserved.

PY - 2012

Y1 - 2012

N2 - We herein investigate finding unusual patterns from a given string as a text. In the present paper, the pattern is expressed as a substring of the string. The natural assumption with respect to the frequency of a pattern is that the shorter the length of the pattern, the larger the frequency of the pattern. We define a pattern to be pure if the frequencies of all of the substrings of the pattern are the same as the frequency of the pattern. This means that the substrings appear only within the pattern in the string. This condition is in contrast to the natural assumption. The present paper proposes three statistics for quantifying the purity of a pattern, i.e., probability, entropy, and difference, which are calculated based on the frequency of the pattern and its substrings. Experiments using DNA sequences reveal that patterns with large probability correspond to the features of the sequences.

AB - We herein investigate finding unusual patterns from a given string as a text. In the present paper, the pattern is expressed as a substring of the string. The natural assumption with respect to the frequency of a pattern is that the shorter the length of the pattern, the larger the frequency of the pattern. We define a pattern to be pure if the frequencies of all of the substrings of the pattern are the same as the frequency of the pattern. This means that the substrings appear only within the pattern in the string. This condition is in contrast to the natural assumption. The present paper proposes three statistics for quantifying the purity of a pattern, i.e., probability, entropy, and difference, which are calculated based on the frequency of the pattern and its substrings. Experiments using DNA sequences reveal that patterns with large probability correspond to the features of the sequences.

KW - Pattern discovery

KW - Pure pattern

KW - Text mining

UR - http://www.scopus.com/inward/record.url?scp=84870847112&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84870847112&partnerID=8YFLogxK

U2 - 10.1109/IIAI-AAI.2012.75

DO - 10.1109/IIAI-AAI.2012.75

M3 - Conference contribution

AN - SCOPUS:84870847112

SN - 9780769548265

T3 - Proceedings of the 2012 IIAI International Conference on Advanced Applied Informatics, IIAIAAI 2012

SP - 285

EP - 290

BT - Proceedings of the 2012 IIAI International Conference on Advanced Applied Informatics, IIAIAAI 2012

T2 - 1st IIAI International Conference on Advanced Applied Informatics, IIAIAAI 2012

Y2 - 20 September 2012 through 22 September 2012

ER -