Cache-aware load balancing for question answering

David Dominguez-Sal, Josep Aguilar-Saborit, Mihai Surdeanu, Josep Lluis Larriba-Pey

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

The need for high performance and throughput Question Answering (QA) systems demands for their migration to distributed environments. However, even in such cases it is necessary to provide the distributed system with cooper- ative caches and load balancing facilities in order to achieve the desired goals. Until now, the literature on QA has notconsidered such a complex system as a whole. Currently, the load balancer regulates the assignment of tasks based only on the CPU and I/O loads without considering the status of the system cache. This paper investigates the load balancing problem propos- ing two novel algorithms that take into account the dis- tributed cache status, in addition to the CPU and I/O load in each processing node. We have implemented, and tested the proposed algorithms in a fully fledged distributed QA system. The two algorithms show that the choice of using the status of the cache was determinant in achieving good performance, and high throughput for QA systems.

Original languageEnglish (US)
Title of host publicationInternational Conference on Information and Knowledge Management, Proceedings
Pages1271-1280
Number of pages10
DOIs
StatePublished - 2008
Externally publishedYes
Event17th ACM Conference on Information and Knowledge Management, CIKM'08 - Napa Valley, CA, United States
Duration: Oct 26 2008Oct 30 2008

Other

Other17th ACM Conference on Information and Knowledge Management, CIKM'08
CountryUnited States
CityNapa Valley, CA
Period10/26/0810/30/08

Fingerprint

Question answering
Load balancing
Throughput
Demand systems
Complex systems
High performance
Node
Assignment
Distributed systems

ASJC Scopus subject areas

  • Business, Management and Accounting(all)
  • Decision Sciences(all)

Cite this

Dominguez-Sal, D., Aguilar-Saborit, J., Surdeanu, M., & Larriba-Pey, J. L. (2008). Cache-aware load balancing for question answering. In International Conference on Information and Knowledge Management, Proceedings (pp. 1271-1280) https://doi.org/10.1145/1458082.1458250

Cache-aware load balancing for question answering. / Dominguez-Sal, David; Aguilar-Saborit, Josep; Surdeanu, Mihai; Larriba-Pey, Josep Lluis.

International Conference on Information and Knowledge Management, Proceedings. 2008. p. 1271-1280.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Dominguez-Sal, D, Aguilar-Saborit, J, Surdeanu, M & Larriba-Pey, JL 2008, Cache-aware load balancing for question answering. in International Conference on Information and Knowledge Management, Proceedings. pp. 1271-1280, 17th ACM Conference on Information and Knowledge Management, CIKM'08, Napa Valley, CA, United States, 10/26/08. https://doi.org/10.1145/1458082.1458250
Dominguez-Sal D, Aguilar-Saborit J, Surdeanu M, Larriba-Pey JL. Cache-aware load balancing for question answering. In International Conference on Information and Knowledge Management, Proceedings. 2008. p. 1271-1280 https://doi.org/10.1145/1458082.1458250
Dominguez-Sal, David ; Aguilar-Saborit, Josep ; Surdeanu, Mihai ; Larriba-Pey, Josep Lluis. / Cache-aware load balancing for question answering. International Conference on Information and Knowledge Management, Proceedings. 2008. pp. 1271-1280
@inproceedings{77ae2718477348ea98850abb39e74e81,
title = "Cache-aware load balancing for question answering",
abstract = "The need for high performance and throughput Question Answering (QA) systems demands for their migration to distributed environments. However, even in such cases it is necessary to provide the distributed system with cooper- ative caches and load balancing facilities in order to achieve the desired goals. Until now, the literature on QA has notconsidered such a complex system as a whole. Currently, the load balancer regulates the assignment of tasks based only on the CPU and I/O loads without considering the status of the system cache. This paper investigates the load balancing problem propos- ing two novel algorithms that take into account the dis- tributed cache status, in addition to the CPU and I/O load in each processing node. We have implemented, and tested the proposed algorithms in a fully fledged distributed QA system. The two algorithms show that the choice of using the status of the cache was determinant in achieving good performance, and high throughput for QA systems.",
author = "David Dominguez-Sal and Josep Aguilar-Saborit and Mihai Surdeanu and Larriba-Pey, {Josep Lluis}",
year = "2008",
doi = "10.1145/1458082.1458250",
language = "English (US)",
isbn = "9781595939913",
pages = "1271--1280",
booktitle = "International Conference on Information and Knowledge Management, Proceedings",

}

TY - GEN

T1 - Cache-aware load balancing for question answering

AU - Dominguez-Sal, David

AU - Aguilar-Saborit, Josep

AU - Surdeanu, Mihai

AU - Larriba-Pey, Josep Lluis

PY - 2008

Y1 - 2008

N2 - The need for high performance and throughput Question Answering (QA) systems demands for their migration to distributed environments. However, even in such cases it is necessary to provide the distributed system with cooper- ative caches and load balancing facilities in order to achieve the desired goals. Until now, the literature on QA has notconsidered such a complex system as a whole. Currently, the load balancer regulates the assignment of tasks based only on the CPU and I/O loads without considering the status of the system cache. This paper investigates the load balancing problem propos- ing two novel algorithms that take into account the dis- tributed cache status, in addition to the CPU and I/O load in each processing node. We have implemented, and tested the proposed algorithms in a fully fledged distributed QA system. The two algorithms show that the choice of using the status of the cache was determinant in achieving good performance, and high throughput for QA systems.

AB - The need for high performance and throughput Question Answering (QA) systems demands for their migration to distributed environments. However, even in such cases it is necessary to provide the distributed system with cooper- ative caches and load balancing facilities in order to achieve the desired goals. Until now, the literature on QA has notconsidered such a complex system as a whole. Currently, the load balancer regulates the assignment of tasks based only on the CPU and I/O loads without considering the status of the system cache. This paper investigates the load balancing problem propos- ing two novel algorithms that take into account the dis- tributed cache status, in addition to the CPU and I/O load in each processing node. We have implemented, and tested the proposed algorithms in a fully fledged distributed QA system. The two algorithms show that the choice of using the status of the cache was determinant in achieving good performance, and high throughput for QA systems.

UR - http://www.scopus.com/inward/record.url?scp=70349229911&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=70349229911&partnerID=8YFLogxK

U2 - 10.1145/1458082.1458250

DO - 10.1145/1458082.1458250

M3 - Conference contribution

AN - SCOPUS:70349229911

SN - 9781595939913

SP - 1271

EP - 1280

BT - International Conference on Information and Knowledge Management, Proceedings

ER -