On October 23, 2004, an earthquake inflicted heavy damage on the Mid-Niigata district. The earthquake isolated Yamakoshi village; consequently, all village residents were forced to evacuate to temporary shelters in neighboring Nagaoka city for two months. A questionnaire survey and interviews were conducted to elucidate problems related to the living environment in the temporary shelters. This study analyzed the relationships between problems related to the acoustic environment and stressful experiences. Among the environmental problems (size, temperature, illumination, acoustic environment and odor problems, and problems related to the shelter equipment and to maintaining privacy), the acoustic environment problems were the fifth most frequently cited environmental problems. A higher proportion of the participants who complained about the acoustic environment of the temporary shelters had stressful experiences, compared to those who did not complain about the acoustic environment. The tendency was statistically significant. Logistic regression analysis revealed that among the living environment problems, that of the acoustic environment was the most important factor for whether refugees felt uneasy, unpleasant, and/or stressed. These results suggested that improvements to the acoustic environment of temporary shelters should lead to some mitigation of refugees' stress.