Analysis of the Cognitive Interview in Questionnaire Design

Analysis of the Cognitive Interview in Questionnaire Design

Author: Gordon Bruce Willis

Publisher: Understanding Qualitative Rese

Published: 2015

Total Pages: 275

ISBN-13: 0199957754

DOWNLOAD EBOOK

Cognitive interviewing, based on the self-report methods of Ericsson and Simon, is a key form of qualitative research that has developed over the past thirty years. The primary objective of cognitive interviewing, also known as cognitive testing, is to understand the cognitive mechanisms underlying the survey-response process. An equally important aim is contributing to the development of best practices for writing survey questions that are well understood and that produce low levels of response error. In particular, an important applied objective is the evaluation of a particular set of questions, items, or other materials under development by questionnaire designers, to determine means for rewording, reordering, or reconceptualizing. Hence, as well as providing an empirical, psychologically oriented framework for the general study of questionnaire design, cognitive interviewing has been adopted as a 'production' mechanism for the improvement of a wide variety of survey questions, whether factual, behavioral, or attitudinal in nature. As with other methods that rely on qualitative data, cognitive interviewing has increasingly been criticized for being lax in the critical area of the development of systematic methods for data reduction, analysis, and reporting of results. Practitioners tend to conduct cognitive interviewing in varying ways, and the data coding and compilation activities undertaken are often nonstandardized and poorly described. There is a considerable need for further development--and documentation--relating not only to a description of this variation but also to providing a set of recommendations for minimal standards, if not best practices. The proposed volume endeavors to address this clear omission.


Cognitive Interviewing

Cognitive Interviewing

Author: Gordon B. Willis

Publisher: SAGE Publications, Incorporated

Published: 2005

Total Pages: 356

ISBN-13:

DOWNLOAD EBOOK

The work provides general guidance about questionnaire design, development, and pre-testing sequence, with an emphasis on the cognitive interview.


Advances in Questionnaire Design, Development, Evaluation and Testing

Advances in Questionnaire Design, Development, Evaluation and Testing

Author: Paul C. Beatty

Publisher: John Wiley & Sons

Published: 2019-12-05

Total Pages: 816

ISBN-13: 111926362X

DOWNLOAD EBOOK

A new and updated definitive resource for survey questionnaire testing and evaluation Building on the success of the first Questionnaire Development, Evaluation, and Testing (QDET) conference in 2002, this book brings together leading papers from the Second International Conference on Questionnaire Design, Development, Evaluation, and Testing (QDET2) held in 2016. The volume assesses the current state of the art and science of QDET; examines the importance of methodological attention to the questionnaire in the present world of information collection; and ponders how the QDET field can anticipate new trends and directions as information needs and data collection methods continue to evolve. Featuring contributions from international experts in survey methodology, Advances in Questionnaire Design, Development, Evaluation and Testing includes latest insights on question characteristics, usability testing, web probing, and other pretesting approaches, as well as: Recent developments in the design and evaluation of digital and self-administered surveys Strategies for comparing and combining questionnaire evaluation methods Approaches for cross-cultural and cross-national questionnaire development New data sources and methodological innovations during the last 15 years Case studies and practical applications Advances in Questionnaire Design, Development, Evaluation and Testing serves as a forum to prepare researchers to meet the next generation of challenges, making it an excellent resource for researchers and practitioners in government, academia, and the private sector.


Cognitive Interviewing Practice

Cognitive Interviewing Practice

Author: Debbie Collins

Publisher: SAGE

Published: 2014-11-10

Total Pages: 400

ISBN-13: 1473909171

DOWNLOAD EBOOK

The use of the cognitive interviewing method for survey question testing has proliferated and evolved over the past 30 years. In more recent years the method has been applied to the evaluation of information letters and leaflets and to research consent forms. This book provides a practical handbook for implementing cognitive interviewing methods in the context of applied social policy research, based on the approach used by the authors at the NatCen Social Research (NatCen) where cognitive interviewing methods have been used for well over a decade. The book provides a justification for the importance of question testing and evaluation and discusses the position of cognitive interviewing in relation to other questionnaire development and evaluation techniques. Throughout the book, the focus is on providing practical and hands-on guidance around elements such as sampling and recruitment, designing probes, interviewing skills, data management and analysis and how to interpret the findings and use them to improve survey questions and other documents. The book also covers cognitive interviewing in different survey modes, in cross national, cross cultural and multilingual settings and discusses some other potential uses of the method.


Analysis of the Cognitive Interview in Questionnaire Design

Analysis of the Cognitive Interview in Questionnaire Design

Author: Gordon B. Willis

Publisher: Oxford University Press

Published: 2015-02-06

Total Pages: 275

ISBN-13: 0190262826

DOWNLOAD EBOOK

Cognitive interviewing, based on the self-report methods of Ericsson and Simon, is a key form of qualitative research that has developed over the past thirty years. The primary objective of cognitive interviewing, also known as cognitive testing, is to understand the cognitive mechanisms underlying the survey-response process. An equally important aim is contributing to the development of best practices for writing survey questions that are well understood and that produce low levels of response error. In particular, an important applied objective is the evaluation of a particular set of questions, items, or other materials under development by questionnaire designers, to determine means for rewording, reordering, or reconceptualizing. Hence, as well as providing an empirical, psychologically oriented framework for the general study of questionnaire design, cognitive interviewing has been adopted as a 'production' mechanism for the improvement of a wide variety of survey questions, whether factual, behavioral, or attitudinal in nature. As with other methods that rely on qualitative data, cognitive interviewing has increasingly been criticized for being lax in the critical area of the development of systematic methods for data reduction, analysis, and reporting of results. Practitioners tend to conduct cognitive interviewing in varying ways, and the data coding and compilation activities undertaken are often nonstandardized and poorly described. There is a considerable need for further development--and documentation--relating not only to a description of this variation but also to providing a set of recommendations for minimal standards, if not best practices. The proposed volume endeavors to address this clear omission.


The Palgrave Handbook of Survey Research

The Palgrave Handbook of Survey Research

Author: David L. Vannette

Publisher: Springer

Published: 2017-12-21

Total Pages: 655

ISBN-13: 3319543954

DOWNLOAD EBOOK

This handbook is a comprehensive reference guide for researchers, funding agencies and organizations engaged in survey research. Drawing on research from a world-class team of experts, this collection addresses the challenges facing survey-based data collection today as well as the potential opportunities presented by new approaches to survey research, including in the development of policy. It examines innovations in survey methodology and how survey scholars and practitioners should think about survey data in the context of the explosion of new digital sources of data. The Handbook is divided into four key sections: the challenges faced in conventional survey research; opportunities to expand data collection; methods of linking survey data with external sources; and, improving research transparency and data dissemination, with a focus on data curation, evaluating the usability of survey project websites, and the credibility of survey-based social science. Chapter 23 of this book is open access under a CC BY 4.0 license at link.springer.com.


Methods for Testing and Evaluating Survey Questionnaires

Methods for Testing and Evaluating Survey Questionnaires

Author: Stanley Presser

Publisher: John Wiley & Sons

Published: 2004-08-16

Total Pages: 624

ISBN-13: 0471654736

DOWNLOAD EBOOK

The definitive resource for survey questionnaire testing and evaluation Over the past two decades, methods for the development, evaluation, and testing of survey questionnaires have undergone radical change. Research has now begun to identify the strengths and weaknesses of various testing and evaluation methods, as well as to estimate the methods’ reliability and validity. Expanding and adding to the research presented at the International Conference on Questionnaire Development, Evaluation and Testing Methods, this title presents the most up-to-date knowledge in this burgeoning field. The only book dedicated to the evaluation and testing of survey questionnaires, this practical reference work brings together the expertise of over fifty leading, international researchers from a broad range of fields. The volume is divided into seven sections: Cognitive interviews Mode of administration Supplements to conventional pretests Special populations Experiments Multi-method applications Statistical modeling Comprehensive and carefully edited, this groundbreaking text offers researchers a solid foundation in the latest developments in testing and evaluating survey questionnaires, as well as a thorough introduction to emerging techniques and technologies.


MEMORY ENHANCING TECHNIQUES FOR INVESTIGATIVE INTERVIEWING

MEMORY ENHANCING TECHNIQUES FOR INVESTIGATIVE INTERVIEWING

Author: Ronald P. Fisher

Publisher: Charles C Thomas Publisher

Published: 1992-01-01

Total Pages: 233

ISBN-13: 0398082200

DOWNLOAD EBOOK

Despite the obvious importance of eyewitness information in criminal investigation, police receive surprisingly little instruction on how to conduct an effective interview with a cooperative eyewitness. More than half of police departments have no formal training whatsoever for newly appointed investigators. Most texts in police science either completely omit the issue of effective interviewing techniques or provide only superficial coverage. This manual provides guiding principles to effective interviewing, with specific techniques to be used and others to be avoided. There are principles of memory retrieval so that the reader will understand why to employ specific techniques -- for example, when to use open-ended versus direct short-answer questions, effective use of pauses, asking follow-up questions, cues to name and number recall, etc. There is the strategy of interview sequential structure -- that is, what to probe for at the beginning, middle, and end of the interview. Also included are practical exercises and real-world experiences. The book will also be helpful for attorneys in conducting investigative interviews.


Using Think-aloud Interviews and Cognitive Labs in Educational Research

Using Think-aloud Interviews and Cognitive Labs in Educational Research

Author: Jacqueline P. Leighton

Publisher: Oxford University Press

Published: 2017

Total Pages: 217

ISBN-13: 019937290X

DOWNLOAD EBOOK

This book provides the first volume focused on distinguishing psychological interview methods for probing distinct forms of student cognition for assessment purposes: student problem solving versus student comprehension and understanding of the subject matter at hand.


Usability Testing for Survey Research

Usability Testing for Survey Research

Author: Emily Geisen

Publisher: Morgan Kaufmann

Published: 2017-02-15

Total Pages: 252

ISBN-13: 0128036818

DOWNLOAD EBOOK

Usability Testing for Survey Research provides researchers with a guide to the tools necessary to evaluate, test, and modify surveys in an iterative method during the survey pretesting process. It includes examples that apply usability to any type of survey during any stage of development, along with tactics on how to tailor usability testing to meet budget and scheduling constraints. The book's authors distill their experience to provide tips on how usability testing can be applied to paper surveys, mixed-mode surveys, interviewer-administered tools, and additional products. Readers will gain an understanding of usability and usability testing and why it is needed for survey research, along with guidance on how to design and conduct usability tests, analyze and report findings, ideas for how to tailor usability testing to meet budget and schedule constraints, and new knowledge on how to apply usability testing to other survey-related products, such as project websites and interviewer administered tools. - Explains how to design and conduct usability tests and analyze and report the findings - Includes examples on how to conduct usability testing on any type of survey, from a simple three-question survey on a mobile device, to a complex, multi-page establishment survey - Presents real-world examples from leading usability and survey professionals, including a diverse collection of case studies and considerations for using and combining other methods - Discusses the facilities, materials, and software needed for usability testing, including in-lab testing, remote testing, and eye tracking