Video training and certification program improves reliability of postischemic neurologic deficit measurement in the rat

Hideki Taninishi, Molly Pearlstein, Huaxin Sheng, Miwa Izutsu, Rafael E. Chaparro, Larry B. Goldstein, David S. Warner

Research output: Contribution to journalArticle

5 Citations (Scopus)

Abstract

Scoring systems are used to measure behavioral deficits in stroke research. Video-assisted training is used to standardize stroke-related neurologic deficit scoring in humans. We hypothesized that a video-assisted training and certification program can improve inter-rater reliability in assessing neurologic function after middle cerebral artery occlusion in rats. Three expert raters scored neurologic deficits in post-middle cerebral artery occlusion rats using three published systems having different complexity levels (3, 18, or 48 points). The system having the highest point estimate for the correlation between neurologic score and infarct size was selected to create a video-assisted training and certification program. Eight trainee raters completed the video-assisted training and certification program. Inter-rater agreement (score) and agreement with expert consensus scores were measured before and after video-assisted training and certification program completion. The 48-point system correlated best with infarct size. Video-assisted training and certification improved agreement with expert consensus scores (pretraining = 65 ± 10, posttraining = 87 ± 14, 112 possible scores, P < 0.0001), median number of trainee raters with scores within ±2 points of the expert consensus score (pretraining = 4, posttraining = 6.5, P < 0.01), categories with > 0.4 (pretraining = 4, posttraining = 9), and number of categories with an improvement in the score from pretraining to posttraining (n = 6). Video-assisted training and certification improved trainee inter-rater reliability and agreement with expert consensus behavioral scores in rats after middle cerebral artery occlusion. Video-assisted training and certification may be useful in multilaboratory preclinical studies.

Original languageEnglish
Pages (from-to)2203-2210
Number of pages8
JournalJournal of Cerebral Blood Flow and Metabolism
Volume36
Issue number12
DOIs
Publication statusPublished - Dec 1 2016
Externally publishedYes

Fingerprint

Certification
Neurologic Manifestations
Education
Middle Cerebral Artery Infarction
Nervous System
Stroke
Research

Keywords

  • Animal models
  • behavior (rodent)
  • behavioral neurology
  • brain ischemia
  • focal ischemia

ASJC Scopus subject areas

  • Neurology
  • Clinical Neurology
  • Cardiology and Cardiovascular Medicine

Cite this

Video training and certification program improves reliability of postischemic neurologic deficit measurement in the rat. / Taninishi, Hideki; Pearlstein, Molly; Sheng, Huaxin; Izutsu, Miwa; Chaparro, Rafael E.; Goldstein, Larry B.; Warner, David S.

In: Journal of Cerebral Blood Flow and Metabolism, Vol. 36, No. 12, 01.12.2016, p. 2203-2210.

Research output: Contribution to journalArticle

Taninishi, Hideki ; Pearlstein, Molly ; Sheng, Huaxin ; Izutsu, Miwa ; Chaparro, Rafael E. ; Goldstein, Larry B. ; Warner, David S. / Video training and certification program improves reliability of postischemic neurologic deficit measurement in the rat. In: Journal of Cerebral Blood Flow and Metabolism. 2016 ; Vol. 36, No. 12. pp. 2203-2210.
@article{155f8efd767d414582b6f8fbc6290a03,
title = "Video training and certification program improves reliability of postischemic neurologic deficit measurement in the rat",
abstract = "Scoring systems are used to measure behavioral deficits in stroke research. Video-assisted training is used to standardize stroke-related neurologic deficit scoring in humans. We hypothesized that a video-assisted training and certification program can improve inter-rater reliability in assessing neurologic function after middle cerebral artery occlusion in rats. Three expert raters scored neurologic deficits in post-middle cerebral artery occlusion rats using three published systems having different complexity levels (3, 18, or 48 points). The system having the highest point estimate for the correlation between neurologic score and infarct size was selected to create a video-assisted training and certification program. Eight trainee raters completed the video-assisted training and certification program. Inter-rater agreement (score) and agreement with expert consensus scores were measured before and after video-assisted training and certification program completion. The 48-point system correlated best with infarct size. Video-assisted training and certification improved agreement with expert consensus scores (pretraining = 65 ± 10, posttraining = 87 ± 14, 112 possible scores, P < 0.0001), median number of trainee raters with scores within ±2 points of the expert consensus score (pretraining = 4, posttraining = 6.5, P < 0.01), categories with > 0.4 (pretraining = 4, posttraining = 9), and number of categories with an improvement in the score from pretraining to posttraining (n = 6). Video-assisted training and certification improved trainee inter-rater reliability and agreement with expert consensus behavioral scores in rats after middle cerebral artery occlusion. Video-assisted training and certification may be useful in multilaboratory preclinical studies.",
keywords = "Animal models, behavior (rodent), behavioral neurology, brain ischemia, focal ischemia",
author = "Hideki Taninishi and Molly Pearlstein and Huaxin Sheng and Miwa Izutsu and Chaparro, {Rafael E.} and Goldstein, {Larry B.} and Warner, {David S.}",
year = "2016",
month = "12",
day = "1",
doi = "10.1177/0271678X15616980",
language = "English",
volume = "36",
pages = "2203--2210",
journal = "Journal of Cerebral Blood Flow and Metabolism",
issn = "0271-678X",
publisher = "Nature Publishing Group",
number = "12",

}

TY - JOUR

T1 - Video training and certification program improves reliability of postischemic neurologic deficit measurement in the rat

AU - Taninishi, Hideki

AU - Pearlstein, Molly

AU - Sheng, Huaxin

AU - Izutsu, Miwa

AU - Chaparro, Rafael E.

AU - Goldstein, Larry B.

AU - Warner, David S.

PY - 2016/12/1

Y1 - 2016/12/1

N2 - Scoring systems are used to measure behavioral deficits in stroke research. Video-assisted training is used to standardize stroke-related neurologic deficit scoring in humans. We hypothesized that a video-assisted training and certification program can improve inter-rater reliability in assessing neurologic function after middle cerebral artery occlusion in rats. Three expert raters scored neurologic deficits in post-middle cerebral artery occlusion rats using three published systems having different complexity levels (3, 18, or 48 points). The system having the highest point estimate for the correlation between neurologic score and infarct size was selected to create a video-assisted training and certification program. Eight trainee raters completed the video-assisted training and certification program. Inter-rater agreement (score) and agreement with expert consensus scores were measured before and after video-assisted training and certification program completion. The 48-point system correlated best with infarct size. Video-assisted training and certification improved agreement with expert consensus scores (pretraining = 65 ± 10, posttraining = 87 ± 14, 112 possible scores, P < 0.0001), median number of trainee raters with scores within ±2 points of the expert consensus score (pretraining = 4, posttraining = 6.5, P < 0.01), categories with > 0.4 (pretraining = 4, posttraining = 9), and number of categories with an improvement in the score from pretraining to posttraining (n = 6). Video-assisted training and certification improved trainee inter-rater reliability and agreement with expert consensus behavioral scores in rats after middle cerebral artery occlusion. Video-assisted training and certification may be useful in multilaboratory preclinical studies.

AB - Scoring systems are used to measure behavioral deficits in stroke research. Video-assisted training is used to standardize stroke-related neurologic deficit scoring in humans. We hypothesized that a video-assisted training and certification program can improve inter-rater reliability in assessing neurologic function after middle cerebral artery occlusion in rats. Three expert raters scored neurologic deficits in post-middle cerebral artery occlusion rats using three published systems having different complexity levels (3, 18, or 48 points). The system having the highest point estimate for the correlation between neurologic score and infarct size was selected to create a video-assisted training and certification program. Eight trainee raters completed the video-assisted training and certification program. Inter-rater agreement (score) and agreement with expert consensus scores were measured before and after video-assisted training and certification program completion. The 48-point system correlated best with infarct size. Video-assisted training and certification improved agreement with expert consensus scores (pretraining = 65 ± 10, posttraining = 87 ± 14, 112 possible scores, P < 0.0001), median number of trainee raters with scores within ±2 points of the expert consensus score (pretraining = 4, posttraining = 6.5, P < 0.01), categories with > 0.4 (pretraining = 4, posttraining = 9), and number of categories with an improvement in the score from pretraining to posttraining (n = 6). Video-assisted training and certification improved trainee inter-rater reliability and agreement with expert consensus behavioral scores in rats after middle cerebral artery occlusion. Video-assisted training and certification may be useful in multilaboratory preclinical studies.

KW - Animal models

KW - behavior (rodent)

KW - behavioral neurology

KW - brain ischemia

KW - focal ischemia

UR - http://www.scopus.com/inward/record.url?scp=85001930678&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85001930678&partnerID=8YFLogxK

U2 - 10.1177/0271678X15616980

DO - 10.1177/0271678X15616980

M3 - Article

C2 - 26661238

AN - SCOPUS:85001930678

VL - 36

SP - 2203

EP - 2210

JO - Journal of Cerebral Blood Flow and Metabolism

JF - Journal of Cerebral Blood Flow and Metabolism

SN - 0271-678X

IS - 12

ER -