Real-time recognition of multiple pedestrians using car-mounted camera

Hidekazu Suzuki, Mamoru Minami

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

In ITS, there has recently been emphasis on the importance of developing a driving assistance system which can detect pedestrians with a car-mounted camera and warn of their presence in order to assure pedestrian safety. In particular, the ability to detect multiple pedestrians in real time (at a video rate of 30 fps) is indispensable from the practical point of view. Consequently, this study proposes a method of recognizing multiple moving objects (pedestrians) in real time using dynamic scene input from a car-mounted camera, as a basic technology for the driving assistance system. The presence of a pedestrian is evaluated on the basis of hue information in the HSI color representation system and model-based matching using a circular approximation model. Thus, in terms of the evaluation function, the problem of recognition of multiple pedestrians is replaced by the problem of search for multiple local maxima. However, it is difficult to realize the process in real time if the evaluation value is calculated for the whole image. This paper considers the "attention," which is a function that reduces the burden of human visual information processing, and proposes a method in which a pseudo-attention function is realized by using a hybrid GA, allowing multiple local maxima to be retrieved efficiently in real time. A real-time experiment on the recognition of multiple pedestrians in dynamic images obtained from a car-mounted camera was used to verify the effectiveness of the proposed method. In addition, the practical performance of the system was investigated by an experiment on the recognition of suddenly appearing pedestrians.

Original languageEnglish
Pages (from-to)21-33
Number of pages13
JournalElectronics and Communications in Japan, Part III: Fundamental Electronic Science (English translation of Denshi Tsushin Gakkai Ronbunshi)
Volume89
Issue number4
DOIs
Publication statusPublished - Apr 2006
Externally publishedYes

Fingerprint

Railroad cars
Cameras
Pedestrian safety
Function evaluation
Experiments
Color

Keywords

  • Car-mounted camera
  • Hybrid GA
  • ITS
  • Pedestrian
  • Real-time recognition

ASJC Scopus subject areas

  • Electrical and Electronic Engineering

Cite this

@article{4adfefe2d6e54d69bf79dacfb7c7ad5b,
title = "Real-time recognition of multiple pedestrians using car-mounted camera",
abstract = "In ITS, there has recently been emphasis on the importance of developing a driving assistance system which can detect pedestrians with a car-mounted camera and warn of their presence in order to assure pedestrian safety. In particular, the ability to detect multiple pedestrians in real time (at a video rate of 30 fps) is indispensable from the practical point of view. Consequently, this study proposes a method of recognizing multiple moving objects (pedestrians) in real time using dynamic scene input from a car-mounted camera, as a basic technology for the driving assistance system. The presence of a pedestrian is evaluated on the basis of hue information in the HSI color representation system and model-based matching using a circular approximation model. Thus, in terms of the evaluation function, the problem of recognition of multiple pedestrians is replaced by the problem of search for multiple local maxima. However, it is difficult to realize the process in real time if the evaluation value is calculated for the whole image. This paper considers the {"}attention,{"} which is a function that reduces the burden of human visual information processing, and proposes a method in which a pseudo-attention function is realized by using a hybrid GA, allowing multiple local maxima to be retrieved efficiently in real time. A real-time experiment on the recognition of multiple pedestrians in dynamic images obtained from a car-mounted camera was used to verify the effectiveness of the proposed method. In addition, the practical performance of the system was investigated by an experiment on the recognition of suddenly appearing pedestrians.",
keywords = "Car-mounted camera, Hybrid GA, ITS, Pedestrian, Real-time recognition",
author = "Hidekazu Suzuki and Mamoru Minami",
year = "2006",
month = "4",
doi = "10.1002/ecjc.20181",
language = "English",
volume = "89",
pages = "21--33",
journal = "Electronics and Communications in Japan, Part III: Fundamental Electronic Science (English translation of Denshi Tsushin Gakkai Ronbunshi)",
issn = "1042-0967",
publisher = "John Wiley and Sons Inc.",
number = "4",

}

TY - JOUR

T1 - Real-time recognition of multiple pedestrians using car-mounted camera

AU - Suzuki, Hidekazu

AU - Minami, Mamoru

PY - 2006/4

Y1 - 2006/4

N2 - In ITS, there has recently been emphasis on the importance of developing a driving assistance system which can detect pedestrians with a car-mounted camera and warn of their presence in order to assure pedestrian safety. In particular, the ability to detect multiple pedestrians in real time (at a video rate of 30 fps) is indispensable from the practical point of view. Consequently, this study proposes a method of recognizing multiple moving objects (pedestrians) in real time using dynamic scene input from a car-mounted camera, as a basic technology for the driving assistance system. The presence of a pedestrian is evaluated on the basis of hue information in the HSI color representation system and model-based matching using a circular approximation model. Thus, in terms of the evaluation function, the problem of recognition of multiple pedestrians is replaced by the problem of search for multiple local maxima. However, it is difficult to realize the process in real time if the evaluation value is calculated for the whole image. This paper considers the "attention," which is a function that reduces the burden of human visual information processing, and proposes a method in which a pseudo-attention function is realized by using a hybrid GA, allowing multiple local maxima to be retrieved efficiently in real time. A real-time experiment on the recognition of multiple pedestrians in dynamic images obtained from a car-mounted camera was used to verify the effectiveness of the proposed method. In addition, the practical performance of the system was investigated by an experiment on the recognition of suddenly appearing pedestrians.

AB - In ITS, there has recently been emphasis on the importance of developing a driving assistance system which can detect pedestrians with a car-mounted camera and warn of their presence in order to assure pedestrian safety. In particular, the ability to detect multiple pedestrians in real time (at a video rate of 30 fps) is indispensable from the practical point of view. Consequently, this study proposes a method of recognizing multiple moving objects (pedestrians) in real time using dynamic scene input from a car-mounted camera, as a basic technology for the driving assistance system. The presence of a pedestrian is evaluated on the basis of hue information in the HSI color representation system and model-based matching using a circular approximation model. Thus, in terms of the evaluation function, the problem of recognition of multiple pedestrians is replaced by the problem of search for multiple local maxima. However, it is difficult to realize the process in real time if the evaluation value is calculated for the whole image. This paper considers the "attention," which is a function that reduces the burden of human visual information processing, and proposes a method in which a pseudo-attention function is realized by using a hybrid GA, allowing multiple local maxima to be retrieved efficiently in real time. A real-time experiment on the recognition of multiple pedestrians in dynamic images obtained from a car-mounted camera was used to verify the effectiveness of the proposed method. In addition, the practical performance of the system was investigated by an experiment on the recognition of suddenly appearing pedestrians.

KW - Car-mounted camera

KW - Hybrid GA

KW - ITS

KW - Pedestrian

KW - Real-time recognition

UR - http://www.scopus.com/inward/record.url?scp=31144479420&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=31144479420&partnerID=8YFLogxK

U2 - 10.1002/ecjc.20181

DO - 10.1002/ecjc.20181

M3 - Article

VL - 89

SP - 21

EP - 33

JO - Electronics and Communications in Japan, Part III: Fundamental Electronic Science (English translation of Denshi Tsushin Gakkai Ronbunshi)

JF - Electronics and Communications in Japan, Part III: Fundamental Electronic Science (English translation of Denshi Tsushin Gakkai Ronbunshi)

SN - 1042-0967

IS - 4

ER -