Scalability Challenges in Web Search Engines

Scalability Challenges in Web Search Engines

Author: B. Barla Cambazoglu

Publisher: Springer Nature

Published: 2022-06-01

Total Pages: 122

ISBN-13: 303102298X

DOWNLOAD EBOOK

In this book, we aim to provide a fairly comprehensive overview of the scalability and efficiency challenges in large-scale web search engines. More specifically, we cover the issues involved in the design of three separate systems that are commonly available in every web-scale search engine: web crawling, indexing, and query processing systems. We present the performance challenges encountered in these systems and review a wide range of design alternatives employed as solution to these challenges, specifically focusing on algorithmic and architectural optimizations. We discuss the available optimizations at different computational granularities, ranging from a single computer node to a collection of data centers. We provide some hints to both the practitioners and theoreticians involved in the field about the way large-scale web search engines operate and the adopted design choices. Moreover, we survey the efficiency literature, providing pointers to a large number of relatively important research papers. Finally, we discuss some open research problems in the context of search engine efficiency.


Advanced Topics in Information Retrieval

Advanced Topics in Information Retrieval

Author: Massimo Melucci

Publisher: Springer Science & Business Media

Published: 2011-06-10

Total Pages: 295

ISBN-13: 3642209467

DOWNLOAD EBOOK

Information retrieval is the science concerned with the effective and efficient retrieval of documents starting from their semantic content. It is employed to fulfill some information need from a large number of digital documents. Given the ever-growing amount of documents available and the heterogeneous data structures used for storage, information retrieval has recently faced and tackled novel applications. In this book, Melucci and Baeza-Yates present a wide-spectrum illustration of recent research results in advanced areas related to information retrieval. Readers will find chapters on e.g. aggregated search, digital advertising, digital libraries, discovery of spam and opinions, information retrieval in context, multimedia resource discovery, quantum mechanics applied to information retrieval, scalability challenges in web search engines, and interactive information retrieval evaluation. All chapters are written by well-known researchers, are completely self-contained and comprehensive, and are complemented by an integrated bibliography and subject index. With this selection, the editors provide the most up-to-date survey of topics usually not addressed in depth in traditional (text)books on information retrieval. The presentation is intended for a wide audience of people interested in information retrieval: undergraduate and graduate students, post-doctoral researchers, lecturers, and industrial researchers.


The Past Web

The Past Web

Author: Daniel Gomes

Publisher: Springer Nature

Published: 2021-06-30

Total Pages: 297

ISBN-13: 3030632911

DOWNLOAD EBOOK

This book provides practical information about web archives, offers inspiring examples for web archivists, raises new challenges, and shares recent research results about access methods to explore information from the past preserved by web archives. The book is structured in six parts. Part 1 advocates for the importance of web archives to preserve our collective memory in the digital era, demonstrates the problem of web ephemera and shows how web archiving activities have been trying to address this challenge. Part 2 then focuses on different strategies for selecting web content to be preserved and on the media types that different web archives host. It provides an overview of efforts to address the preservation of web content as well as smaller-scale but high-quality collections of social media or audiovisual content. Next, Part 3 presents examples of initiatives to improve access to archived web information and provides an overview of access mechanisms for web archives designed to be used by humans or automatically accessed by machines. Part 4 presents research use cases for web archives. It also discusses how to engage more researchers in exploiting web archives and provides inspiring research studies performed using the exploration of web archives. Subsequently, Part 5 demonstrates that web archives should become crucial infrastructures for modern connected societies. It makes the case for developing web archives as research infrastructures and presents several inspiring examples of added-value services built on web archives. Lastly, Part 6 reflects on the evolution of the web and the sustainability of web archiving activities. It debates the requirements and challenges for web archives if they are to assume the responsibility of being societal infrastructures that enable the preservation of memory. This book targets academics and advanced professionals in a broad range of research areas such as digital humanities, social sciences, history, media studies and information or computer science. It also aims to fill the need for a scholarly overview to support lecturers who would like to introduce web archiving into their courses by offering an initial reference for students.


Global Information Technologies: Concepts, Methodologies, Tools, and Applications

Global Information Technologies: Concepts, Methodologies, Tools, and Applications

Author: Tan, Felix B.

Publisher: IGI Global

Published: 2007-10-31

Total Pages: 4194

ISBN-13: 1599049406

DOWNLOAD EBOOK

"This collection compiles research in all areas of the global information domain. It examines culture in information systems, IT in developing countries, global e-business, and the worldwide information society, providing critical knowledge to fuel the future work of researchers, academicians and practitioners in fields such as information science, political science, international relations, sociology, and many more"--Provided by publisher.


LC21

LC21

Author: National Research Council

Publisher: National Academies Press

Published: 2001-01-23

Total Pages: 284

ISBN-13: 0309171687

DOWNLOAD EBOOK

Digital information and networks challenge the core practices of libraries, archives, and all organizations with intensive information management needs in many respectsâ€"not only in terms of accommodating digital information and technology, but also through the need to develop new economic and organizational models for managing information. LC21: A Digital Strategy for the Library of Congress discusses these challenges and provides recommendations for moving forward at the Library of Congress, the world's largest library. Topics covered in LC21 include digital collections, digital preservation, digital cataloging (metadata), strategic planning, human resources, and general management and budgetary issues. The book identifies and elaborates upon a clear theme for the Library of Congress that is applicable more generally: the digital age calls for much more collaboration and cooperation than in the past. LC21 demonstrates that information-intensive organizations will have to change in fundamental ways to survive and prosper in the digital age.


String Processing and Information Retrieval

String Processing and Information Retrieval

Author: Christina Boucher

Publisher: Springer Nature

Published: 2020-10-18

Total Pages: 307

ISBN-13: 303059212X

DOWNLOAD EBOOK

This book constitutes the refereed proceedings of the 27th International Symposium on String Processing and Information Retrieval, SPIRE 2020, held in Orlando, FL, USA, in October 2020. The 17 full papers and 4 short papers presented in this volume were carefully reviewed and selected from 32 submissions. They cover topics such as: data structures; algorithms; information retrieval; compression; combinatorics on words; and computational biology.


Internet of Things. User-Centric IoT

Internet of Things. User-Centric IoT

Author: Raffaele Giaffreda

Publisher: Springer

Published: 2015-06-25

Total Pages: 409

ISBN-13: 3319196561

DOWNLOAD EBOOK

The two-volume set LNICST 150 and 151 constitutes the thoroughly refereed post-conference proceedings of the First International Internet of Things Summit, IoT360 2014, held in Rome, Italy, in October 2014. This volume contains 74 full papers carefully reviewed and selected from 118 submissions at the following four conferences: the First International Conference on Cognitive Internet of Things Technologies, COIOTE 2014; the First International Conference on Pervasive Games, PERGAMES 2014; the First International Conference on IoT Technologies for HealthCare, HealthyIoT 2014; and the First International Conference on IoT as a Service, IoTaaS 2014. The papers cover the following topics: user-centric IoT; artificial intelligence techniques for the IoT; the design and deployment of pervasive games for various sectors, such as health and wellbeing, ambient assisted living, smart cities and societies, education, cultural heritage, and tourism; delivery of electronic healthcare; patient care and medical data management; smart objects; networking considerations for IoT; platforms for IoTaaS; adapting to the IoT environment; modeling IoTaaS; machine to machine support in IoT.


Web and Big Data

Web and Big Data

Author: Xin Wang

Publisher: Springer Nature

Published: 2020-10-13

Total Pages: 565

ISBN-13: 3030602907

DOWNLOAD EBOOK

This two-volume set, LNCS 11317 and 12318, constitutes the thoroughly refereed proceedings of the 4th International Joint Conference, APWeb-WAIM 2020, held in Tianjin, China, in September 2020. Due to the COVID-19 pandemic the conference was organizedas a fully online conference. The 42 full papers presented together with 17 short papers, and 6 demonstration papers were carefully reviewed and selected from 180 submissions. The papers are organized around the following topics: Big Data Analytics; Graph Data and Social Networks; Knowledge Graph; Recommender Systems; Information Extraction and Retrieval; Machine Learning; Blockchain; Data Mining; Text Analysis and Mining; Spatial, Temporal and Multimedia Databases; Database Systems; and Demo.


Web Indicators for Research Evaluation

Web Indicators for Research Evaluation

Author: Michael Thelwall

Publisher: Springer Nature

Published: 2022-05-31

Total Pages: 155

ISBN-13: 3031023048

DOWNLOAD EBOOK

In recent years there has been an increasing demand for research evaluation within universities and other research-based organisations. In parallel, there has been an increasing recognition that traditional citation-based indicators are not able to reflect the societal impacts of research and are slow to appear. This has led to the creation of new indicators for different types of research impact as well as timelier indicators, mainly derived from the Web. These indicators have been called altmetrics, webometrics or just web metrics. This book describes and evaluates a range of web indicators for aspects of societal or scholarly impact, discusses the theory and practice of using and evaluating web indicators for research assessment and outlines practical strategies for obtaining many web indicators. In addition to describing impact indicators for traditional scholarly outputs, such as journal articles and monographs, it also covers indicators for videos, datasets, software and other non-standard scholarly outputs. The book describes strategies to analyse web indicators for individual publications as well as to compare the impacts of groups of publications. The practical part of the book includes descriptions of how to use the free software Webometric Analyst to gather and analyse web data. This book is written for information science undergraduate and Master’s students that are learning about alternative indicators or scientometrics as well as Ph.D. students and other researchers and practitioners using indicators to help assess research impact or to study scholarly communication.


Scholarly Collaboration on the Academic Social Web

Scholarly Collaboration on the Academic Social Web

Author: Daqing He

Publisher: Springer Nature

Published: 2022-05-31

Total Pages: 90

ISBN-13: 3031022998

DOWNLOAD EBOOK

Collaboration among scholars has always been recognized as a fundamental feature of scientific discovery. The ever-increasing diversity among disciplines and complexity of research problems makes it even more compelling to collaborate in order to keep up with the fast pace of innovation and advance knowledge. Along with the rapidly developing Internet communication technologies and the increasing popularity of the social web, we have observed many important developments of scholarly collaboration on the academic social web. In this book, we review the rapid transformation of scholarly collaboration on various academic social web platforms and examine how these platforms have facilitated academics throughout their research lifecycle—from forming ideas, collecting data, and authoring articles to disseminating findings. We refer to the term "academic social web platforms" in this book as a category of Web 2.0 tools or online platforms (such as CiteULike, Mendeley, Academia.edu, and ResearchGate) that enable and facilitate scholarly information exchange and participation. We will also examine scholarly collaboration behaviors including sharing academic resources, exchanging opinions, following each other's research, keeping up with current research trends, and, most importantly, building up their professional networks. Inspired by the model developed Olson et al. [2000] on factors for successful scientific collaboration, our examination of the status of scholarly collaboration on the academic social web has four emphases: technology readiness, coupling work, building common ground, and collaboration readiness. Finally, we talk about the insights and challenges of all these online scholarly collaboration activities imposed on the research communities who are engaging in supporting online scholarly collaboration. This book aims to help researchers and practitioners understand the development of scholarly collaboration on the academic social web, and to build up an active community of scholars who are interested in this topic.