NDLI: Observer ratings of neighborhoods: comparison of two methods

Content Provider	Springer Nature : BioMed Central
Author	Andresen, Elena M Malmstrom, Theodore K Schootman, Mario Wolinsky, Fredric D Miller, J Philip Miller, Douglas K
Abstract	Background Although neighborhood characteristics have important relationships with health outcomes, direct observation involves imperfect measurement. The African American Health (AAH) study included two observer neighborhood rating systems (5-item Krause and 18-item AAH Neighborhood Assessment Scale [NAS]), initially fielded at two different waves. Good measurement characteristics were previously shown for both, but there was more rater variability than desired. In 2010 both measures were re-fielded together, with enhanced training and field methods implemented to decrease rater variability while maintaining psychometric properties. Methods AAH included a poor inner city and more heterogeneous suburban areas. Four interviewers rated 483 blocks, with 120 randomly-selected blocks rated by two interviewers. We conducted confirmatory factor analysis of scales and tested the Krause (5-20 points), AAH 18-item NAS (0-28 points), and a previous 7-item and new 5-item versions of the NAS (0-17 points, 0-11 points). Retest reliability for items (kappa) and scales (Intraclass Correlation Coefficient [ICC]) were calculated overall and among pre-specified subgroups. Linear regression assessed interviewer effects on total scale scores and assessed concurrent validity on lung and lower body functions. Mismeasurement effects on self-rated health were also assessed. Results Scale scores were better in the suburbs than in the inner city. ICC was poor for the Krause scale (ICC=0.19), but improved if the retests occurred within 10 days (ICC=0.49). The 7- and 5-item NAS scales had better ICCs (0.56 and 0.62, respectively), and were higher (0.71 and 0.73) within 10 days. Rater variability for the Kraus and 5- and 7-item NAS scales was 1-3 points (compared to the supervising rater). Concurrent validity was modest, with residents living in worse neighborhood conditions having worse function. Unadjusted estimates were biased towards the null compared with measurement-error corrected estimates. Conclusions Enhanced field protocols and rater training did not improve measurement quality. Specifically, retest reliability and interviewer variability remained problematic. Measurement error partially reduced, but did not eliminate concurrent validity, suggesting there are robust associations between neighborhood characteristics and health outcomes. We conclude that the 5-item AAH NAS has sufficient reliability and validity for further use. Additional research on the measurement properties of environmental rating methods is encouraged.
Related Links	https://bmcpublichealth.biomedcentral.com/counter/pdf/10.1186/1471-2458-13-1024.pdf
Ending Page	12
Page Count	12
Starting Page	1
File Format	HTM / HTML
ISSN	14712458
DOI	10.1186/1471-2458-13-1024
Journal	BMC Public Health
Issue Number	1
Volume Number	13
Language	English
Publisher	BioMed Central
Publisher Date	2013-10-29
Access Restriction	Open
Subject Keyword	Public Health Medicine Epidemiology Biostatistics Vaccine Environmental Health Intraclass Correlation Coefficient Confirmatory Factor Analysis Standard Deviation Concurrent Validity Interrater Reliability Medicine/Public Health
Content Type	Text
Resource Type	Article
Subject	Public Health, Environmental and Occupational Health
Journal Impact Factor	3.5/2023
5-Year Journal Impact Factor	3.9/2023

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Measuring walking within and outside the neighborhood in Chinese elders: reliability and validity

Development, scoring, and reliability of the Microscale Audit of Pedestrian Streetscapes (MAPS)

Assessing the construct validity and reliability of the parental perception on antibiotics (PAPA) scales

Observer ratings of neighborhoods: comparison of two methods

Utility of electronic patient records in primary care for stroke secondary prevention trials

The construct validity and reliability of the Turkish version of Spreitzer's psychological empowerment scale

Validity and reliability of the multidimensional health locus of control scale for college students

Evaluation of a portable hemoglobin photometer in pregnant women in a high altitude area: a pilot study

Functional ability in a population: normative survey data and reliability for the ICF based Norwegian Function Assessment Scale

Observer ratings of neighborhoods: comparison of two methods

Similar Documents

Measuring walking within and outside the neighborhood in Chinese elders: reliability and validity

Development, scoring, and reliability of the Microscale Audit of Pedestrian Streetscapes (MAPS)

Assessing the construct validity and reliability of the parental perception on antibiotics (PAPA) scales

Observer ratings of neighborhoods: comparison of two methods

Utility of electronic patient records in primary care for stroke secondary prevention trials

The construct validity and reliability of the Turkish version of Spreitzer's psychological empowerment scale

Validity and reliability of the multidimensional health locus of control scale for college students

Evaluation of a portable hemoglobin photometer in pregnant women in a high altitude area: a pilot study

Functional ability in a population: normative survey data and reliability for the ICF based Norwegian Function Assessment Scale

Observer ratings of neighborhoods: comparison of two methods