Information Retrieval Evaluation

Information Retrieval Evaluation

Author: Donna Harman

Publisher: Springer Nature

Published: 2022-05-31

Total Pages: 107

ISBN-13: 3031022769

DOWNLOAD EBOOK

Evaluation has always played a major role in information retrieval, with the early pioneers such as Cyril Cleverdon and Gerard Salton laying the foundations for most of the evaluation methodologies in use today. The retrieval community has been extremely fortunate to have such a well-grounded evaluation paradigm during a period when most of the human language technologies were just developing. This lecture has the goal of explaining where these evaluation methodologies came from and how they have continued to adapt to the vastly changed environment in the search engine world today. The lecture starts with a discussion of the early evaluation of information retrieval systems, starting with the Cranfield testing in the early 1960s, continuing with the Lancaster "user" study for MEDLARS, and presenting the various test collection investigations by the SMART project and by groups in Britain. The emphasis in this chapter is on the how and the why of the various methodologies developed. The second chapter covers the more recent "batch" evaluations, examining the methodologies used in the various open evaluation campaigns such as TREC, NTCIR (emphasis on Asian languages), CLEF (emphasis on European languages), INEX (emphasis on semi-structured data), etc. Here again the focus is on the how and why, and in particular on the evolving of the older evaluation methodologies to handle new information access techniques. This includes how the test collection techniques were modified and how the metrics were changed to better reflect operational environments. The final chapters look at evaluation issues in user studies -- the interactive part of information retrieval, including a look at the search log studies mainly done by the commercial search engines. Here the goal is to show, via case studies, how the high-level issues of experimental design affect the final evaluations. Table of Contents: Introduction and Early History / "Batch" Evaluation Since 1992 / Interactive Evaluation / Conclusion


Interactive Information Retrieval in Digital Environments

Interactive Information Retrieval in Digital Environments

Author: Xie, Iris

Publisher: IGI Global

Published: 2008-04-30

Total Pages: 376

ISBN-13: 1599042428

DOWNLOAD EBOOK

"This book includes the integration of existing frameworks on user-oriented information retrieval systems across multiple disciplines; the comprehensive review of empirical studies of interactive information retrieval systems for different types of users, tasks, and subtasks; and the discussion of how to evaluate interactive information retrieval systems. "--Provided by publisher.


Information Retrieval

Information Retrieval

Author: Ayse Goker

Publisher: John Wiley & Sons

Published: 2009-12-15

Total Pages: 320

ISBN-13: 9780470033630

DOWNLOAD EBOOK

This book is an essential reference to cutting-edge issues and future directions in information retrieval Information retrieval (IR) can be defined as the process of representing, managing, searching, retrieving, and presenting information. Good IR involves understanding information needs and interests, developing an effective search technique, system, presentation, distribution and delivery. The increased use of the Web and wider availability of information in this environment led to the development of Web search engines. This change has brought fresh challenges to a wider variety of users’ needs, tasks, and types of information. Today, search engines are seen in enterprises, on laptops, in individual websites, in library catalogues, and elsewhere. Information Retrieval: Searching in the 21st Century focuses on core concepts, and current trends in the field. This book focuses on: Information Retrieval Models User-centred Evaluation of Information Retrieval Systems Multimedia Resource Discovery Image Users’ Needs and Searching Behaviour Web Information Retrieval Mobile Search Context and Information Retrieval Text Categorisation and Genre in Information Retrieval Semantic Search The Role of Natural Language Processing in Information Retrieval: Search for Meaning and Structure Cross-language Information Retrieval Performance Issues in Parallel Computing for Information Retrieval This book is an invaluable reference for graduate students on IR courses or courses in related disciplines (e.g. computer science, information science, human-computer interaction, and knowledge management), academic and industrial researchers, and industrial personnel tracking information search technology developments to understand the business implications. Intermediate-advanced level undergraduate students on IR or related courses will also find this text insightful. Chapters are supplemented with exercises to stimulate further thinking.


ImageCLEF

ImageCLEF

Author: Henning Müller

Publisher: Springer Science & Business Media

Published: 2010-08-20

Total Pages: 554

ISBN-13: 3642151817

DOWNLOAD EBOOK

The pervasive creation and consumption of content, especially visual content, is ingrained into our modern world. We’re constantly consuming visual media content, in printed form and in digital form, in work and in leisure pursuits. Like our cave– man forefathers, we use pictures to record things which are of importance to us as memory cues for the future, but nowadays we also use pictures and images to document processes; we use them in engineering, in art, in science, in medicine, in entertainment and we also use images in advertising. Moreover, when images are in digital format, either scanned from an analogue format or more often than not born digital, we can use the power of our computing and networking to exploit images to great effect. Most of the technical problems associated with creating, compressing, storing, transmitting, rendering and protecting image data are already solved. We use - cepted standards and have tremendous infrastructure and the only outstanding ch- lenges, apart from managing the scale issues associated with growth, are to do with locating images. That involves analysing them to determine their content, clas- fying them into related groupings, and searching for images. To overcome these challenges we currently rely on image metadata, the description of the images, - ther captured automatically at creation time or manually added afterwards.


Charting a New Course: Natural Language Processing and Information Retrieval.

Charting a New Course: Natural Language Processing and Information Retrieval.

Author: John I. Tait

Publisher: Springer Science & Business Media

Published: 2005-04-01

Total Pages: 312

ISBN-13: 9781402033438

DOWNLOAD EBOOK

Karen Spärck Jones is one of the major figures of 20th century and early 21st Century computing and information processing. Her ideas have had an important influence on the development of Internet Search Engines. Her contribution has been recognized by awards from the natural language processing, information retrieval and artificial intelligence communities, including being asked to present the prestigious Grace Hopper lecture. She continues to be an active and influential researcher. Her contribution to the scientific evaluation of the effectiveness of such computer systems has been quite outstanding. This book celebrates the life and work of Karen Spärck Jones in her seventieth year. It consists of fifteen new and original chapters written by leading international authorities reviewing the state of the art and her influence in the areas in which Karen Spärck Jones has been active. Although she has a publication record which goes back over forty years, it is clear even the very early work reviewed in the book can be read with profit by those working on recent developments in information processing like bioinformatics and the semantic web.


Readings in Information Retrieval

Readings in Information Retrieval

Author: Karen Sparck Jones

Publisher: Morgan Kaufmann

Published: 1997

Total Pages: 614

ISBN-13: 9781558604544

DOWNLOAD EBOOK

This compilation of original papers on information retrieval presents an overview, covering both general theory and specific methods, of the development and current status of information retrieval systems. Each chapter contains several papers carefully chosen to represent substantive research work that has been carried out in that area, each is preceded by an introductory overview and followed by supported references for further reading.


New Directions in Cognitive Information Retrieval

New Directions in Cognitive Information Retrieval

Author: Amanda Spink

Publisher: Springer Science & Business Media

Published: 2006-08-25

Total Pages: 250

ISBN-13: 1402040148

DOWNLOAD EBOOK

New Directions in Cognitive Information Retrieval presents an exciting new direction for research into cognitive oriented information retrieval (IR) research, a direction based on an analysis of the user’s problem situation and cognitive behavior when using the IR system. This contrasts with the current dominant IR research paradigm which concentrates on improving IR system matching performance. The chapters describe the leading edge concepts and models of cognitive IR that explore the nexus between human cognition, information and the social conditions that drive humans to seek information using IR systems. Chapter topics include: Polyrepresentation, cognitive overlap and the boomerang effect, Multitasking while conducting the search, Knowledge Diagram Visualizations of the topic space to facilitate user assimilation of information, Task, relevance, selection state, knowledge need and knowledge behavior, search training built into the search, children’s collaboration for school projects, and other cognitive perspectives on IR concepts and issues.


Information Context: Nature, Impact, and Role

Information Context: Nature, Impact, and Role

Author: Fabio Crestani

Publisher: Springer Science & Business Media

Published: 2005-05-20

Total Pages: 263

ISBN-13: 3540261788

DOWNLOAD EBOOK

CoLIS 5 was the ?fth in the series of international conferences whose general aim is to provide a broad forum for critically exploring and analyzing research inareassuchascomputerscience,informationscienceandlibraryscience.CoLIS examinesthehistorical,theoretical,empiricalandtechnicalissuesrelatingtoour understanding and use of information, promoting an interdisciplinary approach to research. CoLIS seeks to provide a broad platform for the examination of context as it relates to our theoretical, empirical and technical development of information-centered disciplines. The theme for CoLIS 5 was the nature, impact and role of context within information-centered research. Context is a complex, dynamic and multi- - mensional concept that in?uences both humans and machines: how they behave individually and how they interact with each other. In CoLIS 5 we took an interdisciplinary approach to the issue of context to help us understand and the theoretical approaches to modelling and understanding context, incorporate contextual reasoning within technology, and develop a shared framework for promoting the exploration of context.