Automated Evaluation of Text and Discourse with Coh-Metrix

Automated Evaluation of Text and Discourse with Coh-Metrix

Author: Danielle S. McNamara

Publisher: Cambridge University Press

Published: 2014-03-24

Total Pages: 293

ISBN-13: 1139867091

DOWNLOAD EBOOK

Coh-Metrix is among the broadest and most sophisticated automated textual assessment tools available today. Automated Evaluation of Text and Discourse with Coh-Metrix describes this computational tool, as well as the wide range of language and discourse measures it provides. Part I of the book focuses on the theoretical perspectives that led to the development of Coh-Metrix, its measures, and empirical work that has been conducted using this approach. Part II shifts to the practical arena, describing how to use Coh-Metrix and how to analyze, interpret, and describe results. Coh-Metrix opens the door to a new paradigm of research that coordinates studies of language, corpus analysis, computational linguistics, education, and cognitive science. This tool empowers anyone with an interest in text to pursue a wide array of previously unanswerable research questions.


Handbook of Automated Essay Evaluation

Handbook of Automated Essay Evaluation

Author: Mark D. Shermis

Publisher: Routledge

Published: 2013-07-18

Total Pages: 515

ISBN-13: 1136334793

DOWNLOAD EBOOK

This comprehensive, interdisciplinary handbook reviews the latest methods and technologies used in automated essay evaluation (AEE) methods and technologies. Highlights include the latest in the evaluation of performance-based writing assessments and recent advances in the teaching of writing, language testing, cognitive psychology, and computational linguistics. This greatly expanded follow-up to Automated Essay Scoring reflects the numerous advances that have taken place in the field since 2003 including automated essay scoring and diagnostic feedback. Each chapter features a common structure including an introduction and a conclusion. Ideas for diagnostic and evaluative feedback are sprinkled throughout the book. Highlights of the book’s coverage include: The latest research on automated essay evaluation. Descriptions of the major scoring engines including the E-rater®, the Intelligent Essay Assessor, the IntellimetricTM Engine, c-raterTM, and LightSIDE. Applications of the uses of the technology including a large scale system used in West Virginia. A systematic framework for evaluating research and technological results. Descriptions of AEE methods that can be replicated for languages other than English as seen in the example from China. Chapters from key researchers in the field. The book opens with an introduction to AEEs and a review of the "best practices" of teaching writing along with tips on the use of automated analysis in the classroom. Next the book highlights the capabilities and applications of several scoring engines including the E-rater®, the Intelligent Essay Assessor, the IntellimetricTM engine, c-raterTM, and LightSIDE. Here readers will find an actual application of the use of an AEE in West Virginia, psychometric issues related to AEEs such as validity, reliability, and scaling, and the use of automated scoring to detect reader drift, grammatical errors, discourse coherence quality, and the impact of human rating on AEEs. A review of the cognitive foundations underlying methods used in AEE is also provided. The book concludes with a comparison of the various AEE systems and speculation about the future of the field in light of current educational policy. Ideal for educators, professionals, curriculum specialists, and administrators responsible for developing writing programs or distance learning curricula, those who teach using AEE technologies, policy makers, and researchers in education, writing, psychometrics, cognitive psychology, and computational linguistics, this book also serves as a reference for graduate courses on automated essay evaluation taught in education, computer science, language, linguistics, and cognitive psychology.


Coh-Metrix Measures Text Characteristics at Multiple Levels of Language and Discourse

Coh-Metrix Measures Text Characteristics at Multiple Levels of Language and Discourse

Author: Arthur C. Graesser

Publisher:

Published: 2014

Total Pages: 20

ISBN-13:

DOWNLOAD EBOOK

Coh-Metrix analyzes texts on multiple measures of language and discourse that are aligned with multilevel theoretical frameworks of comprehension. Dozens of measures funnel into five major factors that systematically vary as a function of types of texts (e.g., narrative vs. informational) and grade level: narrativity, syntactic simplicity, word concreteness, referential cohesion, and deep (causal) cohesion. Texts are automatically scaled on these five factors with Coh-Metrix-TEA (Text Easability Assessor). This article reviews how these five factors account for text variations and reports analyses that augment Coh-Metrix in two ways. First, there is a composite measure called "formality", which increases with low narrativity, syntactic complexity, word abstractness, and high cohesion. Second, the words are analyzed with Linguistic Inquiry and Word Count, an automated system that measures words in texts on dozens of psychological attributes. One next step in automated text analyses is a topics analysis that scales the difficulty of conceptual topics. [This article was published in "Elementary School Journal," v115 n2 p210-229 Dec 2014 (see EJ1047713).].


Science and Global Challenges of the 21st Century - Science and Technology

Science and Global Challenges of the 21st Century - Science and Technology

Author: Alvaro Rocha

Publisher: Springer Nature

Published: 2021-10-13

Total Pages: 1146

ISBN-13: 3030894770

DOWNLOAD EBOOK

This book comprises the proceedings of the International Perm Forum “Science and Global Challenges of the 21st Century” held on October 18th – 23rd, 2021, at Perm State University, Perm, Russia. Global challenges, which determine the main trends in the development of social and economic life in the XXI century, require the integration of specialists in various fields of knowledge. That is why the main principle of this edition is interdisciplinarity, the formation of end-to-end innovation chains, including fundamental and applied research, and the wide application of smart innovations, networks, and information technologies. The authors seek to find synergy between technologies and such fields as computer science, geosciences, biology, linguistics, social studies, historical studies, and economics. The book is of interest to researchers seeking nontrivial solutions at the interface of sciences, digital humanities, computational linguistics, cognitive studies, machine learning, and others.


Contemporary Second Language Assessment

Contemporary Second Language Assessment

Author: Jayanti Veronique Banerjee

Publisher: Bloomsbury Publishing

Published: 2016-06-30

Total Pages: 329

ISBN-13: 0567147061

DOWNLOAD EBOOK

Includes chapters on key aspects of second language assessment such as test construct, diagnosis, exam design, and the growing range of public policy, social and ethical issues. Each of the contributors is an expert in their area; some are established names while others are talented newcomers to the field. The chapters present new research or perspectives on traditional concerns such as test quality; fairness and bias; the testing of different language skills; the needs of different groups of examinees, including English language learners who need to take content tests in English; and the use of language assessments for gate-keeping purposes. The volume demonstrates how language assessment is informed by and engages with neighbouring areas of applied linguistics such as technology and language corpora. The book represents the best of current practice in second language assessment and, as a one volume reference, will be invaluable to students and researchers looking for material that extends their understanding of the field.


Discourse Comprehension

Discourse Comprehension

Author: Charles A. Weaver, III

Publisher: Routledge

Published: 2012-12-06

Total Pages: 426

ISBN-13: 1136482741

DOWNLOAD EBOOK

This volume is derived from presentations given at a conference hosted in Boulder, Colorado in honor of the 60th birthday of Walter Kintsch. Though the contents of the talks, and thus the chapters, varied widely, all had one thing in common -- they were inspired to some degree by the work of Walter Kintsch. When making plans for an edited book centered around this conference, the editors had a primary goal: to acknowledge the wide variety of researchers and research areas Kintsch had influenced. As a consequence, one of the more unusual elements of this volume is the diversity of the contributors. Researchers from six different countries contributed chapters to this book which is loosely organized around three main thrusts of Kintsch's work: * text-based representations that explain how meaning in a text is constructed, * situation models which represent what the text is about rather than what a text literally says, and * the construction-integration model, Kintsch's most recent work in discourse comprehension.


Artificial Intelligence in Education

Artificial Intelligence in Education

Author: Ido Roll

Publisher: Springer Nature

Published: 2021-06-11

Total Pages: 536

ISBN-13: 3030782700

DOWNLOAD EBOOK

This two-volume set LNAI 12748 and 12749 constitutes the refereed proceedings of the 22nd International Conference on Artificial Intelligence in Education, AIED 2021, held in Utrecht, The Netherlands, in June 2021.* The 40 full papers presented together with 76 short papers, 2 panels papers, 4 industry papers, 4 doctoral consortium, and 6 workshop papers were carefully reviewed and selected from 209 submissions. The conference provides opportunities for the cross-fertilization of approaches, techniques and ideas from the many fields that comprise AIED, including computer science, cognitive and learning sciences, education, game design, psychology, sociology, linguistics as well as many domain-specific areas. ​*The conference was held virtually due to the COVID-19 pandemic.


The Routledge International Handbook of Automated Essay Evaluation

The Routledge International Handbook of Automated Essay Evaluation

Author: Mark D. Shermis

Publisher: Taylor & Francis

Published: 2024-06-27

Total Pages: 647

ISBN-13: 1040033245

DOWNLOAD EBOOK

The Routledge International Handbook of Automated Essay Evaluation (AEE) is a definitive guide at the intersection of automation, artificial intelligence, and education. This volume encapsulates the ongoing advancement of AEE, reflecting its application in both large-scale and classroom-based assessments to support teaching and learning endeavors. It presents a comprehensive overview of AEE's current applications, including its extension into reading, speech, mathematics, and writing research; modern automated feedback systems; critical issues in automated evaluation such as psychometrics, fairness, bias, transparency, and validity; and the technological innovations that fuel current and future developments in this field. As AEE approaches a tipping point of global implementation, this Handbook stands as an essential resource, advocating for the conscientious adoption of AEE tools to enhance educational practices ethically. The Handbook will benefit readers by equipping them with the knowledge to thoughtfully integrate AEE, thereby enriching educational assessment, teaching, and learning worldwide. Aimed at researchers, educators, AEE developers, and policymakers, the Handbook is poised not only to chart the current landscape but also to stimulate scholarly discourse, define and inform best practices, and propel and guide future innovations.