Dynamic Multi-Resource Load Balancing in Parallel Database Systems.
Erhard Rahm, Robert Marek:
Dynamic Multi-Resource Load Balancing in Parallel Database Systems.
VLDB 1995: 395-406@inproceedings{DBLP:conf/vldb/RahmM95,
author = {Erhard Rahm and
Robert Marek},
editor = {Umeshwar Dayal and
Peter M. D. Gray and
Shojiro Nishio},
title = {Dynamic Multi-Resource Load Balancing in Parallel Database Systems},
booktitle = {VLDB'95, Proceedings of 21th International Conference on Very
Large Data Bases, September 11-15, 1995, Zurich, Switzerland},
publisher = {Morgan Kaufmann},
year = {1995},
isbn = {1-55860-379-4},
pages = {395-406},
ee = {db/conf/vldb/RahmM95.html},
crossref = {DBLP:conf/vldb/95},
bibsource = {DBLP, http://dblp.uni-trier.de}
}
Abstract
Parallel database systems have to support the effective parallelization ofcomplex queries in multi-user mode, i.e. in combination with inter-query/inter-transaction parallelism.
For this purpose, dynamic scheduling and load balancing strategies are necessary that consider the current system state for determiningg the degree of intra-query parallelism and for selecting the processors for executing subqueries.
We study these issues for parallel hash join processing and show that the two subproblems should be addressed in an integrated way.
Even more importantly, however, is the use of a multi- resource load balancing approach that considers all potential bottleneck resources, in particular memory, disk and CPU.
We discuss basic performance tradeoffs to consider and evaluate the performance of several load balancing strategies by means of a detailed simulation model.
Simulation results will be analyzed for multiuser configurations with bothhomogeneous and heterogeneous (query/OLTP) workloads.
Copyright © 1995 by the VLDB Endowment.
Permission to copy without fee all or part of this material is granted provided that the copies are not made or
distributed for direct commercial advantage, the VLDB
copyright notice and the title of the publication and
its date appear, and notice is given that copying
is by the permission of the Very Large Data Base
Endowment. To copy otherwise, or to republish, requires
a fee and/or special permission from the Endowment.
Online Paper
CDROM Version: Load the CDROM "Volume 1 Issue 5, VLDB '89-'97" and ...
DVD Version: Load ACM SIGMOD Anthology DVD 1" and ...
Printed Edition
Umeshwar Dayal, Peter M. D. Gray, Shojiro Nishio (Eds.):
VLDB'95, Proceedings of 21th International Conference on Very Large Data Bases, September 11-15, 1995, Zurich, Switzerland.
Morgan Kaufmann 1995, ISBN 1-55860-379-4
Contents
References
- [1]
- Kurt P. Brown, Manish Mehta, Michael J. Carey, Miron Livny:
Towards Automated Performance Tuning for Complex Workloads.
VLDB 1994: 72-84
- [2]
- Michael J. Carey, Rajiv Jauhari, Miron Livny:
Priority in DBMS Resource Scheduling.
VLDB 1989: 397-410
- [3]
- Michael J. Carey, Sanjay Krishnamurthi, Miron Livny:
Load Control for Locking: The 'Half-and-Half' Approach.
PODS 1990: 72-84
- [4]
- Michael J. Carey, Waleed A. Muhanna:
The Performance of Multiversion Concurrency Control Algorithms.
ACM Trans. Comput. Syst. 4(4): 338-378(1986)
- [5]
- Diane L. Davison, Goetz Graefe:
Memory-Contention Responsive Hash Joins.
VLDB 1994: 379-390
- [6]
- David J. DeWitt, Jim Gray:
Parallel Database Systems: The Future of High Performance Database Systems.
Commun. ACM 35(6): 85-98(1992)
- [7]
- David J. DeWitt, Jeffrey F. Naughton, Donovan A. Schneider, S. Seshadri:
Practical Skew Handling in Parallel Joins.
VLDB 1992: 27-40
- [8]
- ...
- [9]
- Susanne Englert:
NonStop SQL: Scalability and Availability for Decision Support.
SIGMOD Conference 1994: 491
- [10]
- Goetz Graefe:
Query Evaluation Techniques for Large Databases.
ACM Comput. Surv. 25(2): 73-170(1993)
- [11]
- Jim Gray:
Super Servers: Commodity Computer Clusters Pose a Software Challenge.
BTW 1995: 30-47
- [12]
- Yasuhiro Hirano, Tetsuji Satoh, Ushio Inoue, K. Teranaka:
Load Balancing Algorithms for Parallel Database Processing on Shared Memory Multiprocessors.
PDIS 1991: 210-217
- [13]
- Wei Hong:
Exploiting Inter-Operation Parallelism in XPRS.
SIGMOD Conference 1992: 19-28
- [14]
- Kien A. Hua, Jeffrey X. W. Su:
Dynamic Load Balancing in Very Large Shared-Nothing Hypercube Database Computers.
IEEE Trans. Computers 42(12): 1425-1439(1993)
- [15]
- Rajiv Jauhari, Michael J. Carey, Miron Livny:
Priority-Hints: An Algorithm for Priority-Based Buffer Management.
VLDB 1990: 708-721
- [16]
- Hongjun Lu, Kian-Lee Tan:
Dynamic and Load-balanced Task-Oriented Datbase Query Processing in Parallel Systems.
EDBT 1992: 357-372
- [17]
- Robert Marek:
Ein Kostenmodell der parallelen Anfragebearbeitung in Shared-Nothing-Datenbanksystemen.
BTW 1995: 232-251
- [18]
- ...
- [19]
- Manish Mehta, David J. DeWitt:
Dynamic Memory Allocation for Multiple-Query Workloads.
VLDB 1993: 354-367
- [20]
- Manish Mehta, David J. DeWitt:
Managing Intra-operator Parallelism in Parallel Database Systems.
VLDB 1995: 382-394
- [21]
- Marguerite C. Murphy, Ming-Chien Shan:
Execution Plan Balancing.
ICDE 1991: 698-706
- [22]
- Edward Omiecinski:
Performance Analysis of a Load Balancing Hash-Join Algorithm for a Shared Memory Multiprocessor.
VLDB 1991: 375-385
- [23]
- HweeHwa Pang, Michael J. Carey, Miron Livny:
Partially Preemptive Hash Joins.
SIGMOD Conference 1993: 59-68
- [24]
- David A. Patterson, Garth A. Gibson, Randy H. Katz:
A Case for Redundant Arrays of Inexpensive Disks (RAID).
SIGMOD Conference 1988: 109-116
- [25]
- ...
- [26]
- Erhard Rahm, Robert Marek:
Analysis of Dynamic Load Balancing Strategies for Parallel Shared Nothing Database Systems.
VLDB 1993: 182-193
- [27]
- Erhard Rahm, Thomas Stöhr:
Analysis of Parallel Scan Processing in Shared Disk Database Systems.
Euro-Par 1995: 485-500
- [28]
- Patricia G. Selinger:
Predictions and Challenges for Database Systems in the Year 2000.
VLDB 1993: 667-675
- [29]
- ...
- [30]
- Alexander Thomasian:
Thrashing in Two-Phase Locking Revisited.
ICDE 1992: 518-526
- [31]
- Patrick Valduriez:
Parallel Database Systems: Open Problems and New Issues.
Distributed and Parallel Databases 1(2): 137-165(1993)
- [32]
- Christopher B. Walton, Alfred G. Dale, Roy M. Jenevein:
A Taxonomy and Performance Model of Data Skew Effects in Parallel Joins.
VLDB 1991: 537-548
- [33]
- Gerhard Weikum, Christof Hasse, Alex Moenkeberg, Peter Zabback:
The COMFORT Automatic Tuning Project, Invited Project Review.
Inf. Syst. 19(5): 381-432(1994)
- [34]
- Annita N. Wilschut, Jan Flokstra, Peter M. G. Apers:
Parallelism in a Main-Memory DBMS: The Performance of PRISMA/DB.
VLDB 1992: 521-532
- [35]
- Joel L. Wolf, Daniel M. Dias, Philip S. Yu, John Turek:
An Effective Algorithm for Parallelizing Hash Joins in the Presence of Data Skew.
ICDE 1991: 200-209
- [36]
- Hansjörg Zeller, Jim Gray:
An Adaptive Hash Join Algorithm for Multiuser Environments.
VLDB 1990: 186-197
Copyright © Tue Mar 16 02:22:05 2010
by Michael Ley (ley@uni-trier.de)