Sound collection and visualization system enabled participatory and opportunistic sensing approaches

Sunao Hara, Masanobu Abe, Noboru Sonehara

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

This paper presents a sound collection system to visualize environmental sounds that are collected using a crowd-sourcing approach. An analysis of physical features is generally used to analyze sound properties; however, human beings not only analyze but also emotionally connect to sounds. If we want to visualize the sounds according to the characteristics of the listener, we need to collect not only the raw sound, but also the subjective feelings associated with them. For this purpose, we developed a sound collection system using a crowdsourcing approach to collect physical sounds, their statistics, and subjective evaluations simultaneously. We then conducted a sound collection experiment using the developed system on ten participants. We collected 6,257 samples of equivalent loudness levels and their locations, and 516 samples of sounds and their locations. Subjective evaluations by the participants are also included in the data. Next, we tried to visualize the sound on a map. The loudness levels are visualized as a color map and the sounds are visualized as icons which indicate the sound type. Finally, we conducted a discrimination experiment on the sound to implement a function of automatic conversion from sounds to appropriate icons. The classifier is trained on the basis of the GMM-UBM (Gaussian Mixture Model and Universal Background Model) method. Experimental results show that the F-measure is 0.52 and the AUC is 0.79.

Original languageEnglish
Title of host publication2015 IEEE International Conference on Pervasive Computing and Communication Workshops, PerCom Workshops 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages390-395
Number of pages6
ISBN (Electronic)9781479984251
DOIs
Publication statusPublished - Jun 24 2015
Event13th IEEE International Conference on Pervasive Computing and Communication, PerCom Workshops 2015 - St. Louis, United States
Duration: Mar 23 2015Mar 27 2015

Publication series

Name2015 IEEE International Conference on Pervasive Computing and Communication Workshops, PerCom Workshops 2015

Other

Other13th IEEE International Conference on Pervasive Computing and Communication, PerCom Workshops 2015
CountryUnited States
CitySt. Louis
Period3/23/153/27/15

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Computer Science Applications
  • Human-Computer Interaction
  • Health(social science)

Fingerprint Dive into the research topics of 'Sound collection and visualization system enabled participatory and opportunistic sensing approaches'. Together they form a unique fingerprint.

  • Cite this

    Hara, S., Abe, M., & Sonehara, N. (2015). Sound collection and visualization system enabled participatory and opportunistic sensing approaches. In 2015 IEEE International Conference on Pervasive Computing and Communication Workshops, PerCom Workshops 2015 (pp. 390-395). [7134069] (2015 IEEE International Conference on Pervasive Computing and Communication Workshops, PerCom Workshops 2015). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/PERCOMW.2015.7134069