ACM SIGMOD Anthology VLDB dblp.uni-trier.de

Dynamic Multi-Resource Load Balancing in Parallel Database Systems.

Erhard Rahm, Robert Marek: Dynamic Multi-Resource Load Balancing in Parallel Database Systems. VLDB 1995: 395-406
@inproceedings{DBLP:conf/vldb/RahmM95,
  author    = {Erhard Rahm and
               Robert Marek},
  editor    = {Umeshwar Dayal and
               Peter M. D. Gray and
               Shojiro Nishio},
  title     = {Dynamic Multi-Resource Load Balancing in Parallel Database Systems},
  booktitle = {VLDB'95, Proceedings of 21th International Conference on Very
               Large Data Bases, September 11-15, 1995, Zurich, Switzerland},
  publisher = {Morgan Kaufmann},
  year      = {1995},
  isbn      = {1-55860-379-4},
  pages     = {395-406},
  ee        = {db/conf/vldb/RahmM95.html},
  crossref  = {DBLP:conf/vldb/95},
  bibsource = {DBLP, http://dblp.uni-trier.de}
}

Abstract

Parallel database systems have to support the effective parallelization ofcomplex queries in multi-user mode, i.e. in combination with inter-query/inter-transaction parallelism. For this purpose, dynamic scheduling and load balancing strategies are necessary that consider the current system state for determiningg the degree of intra-query parallelism and for selecting the processors for executing subqueries. We study these issues for parallel hash join processing and show that the two subproblems should be addressed in an integrated way. Even more importantly, however, is the use of a multi- resource load balancing approach that considers all potential bottleneck resources, in particular memory, disk and CPU. We discuss basic performance tradeoffs to consider and evaluate the performance of several load balancing strategies by means of a detailed simulation model. Simulation results will be analyzed for multiuser configurations with bothhomogeneous and heterogeneous (query/OLTP) workloads.

Copyright © 1995 by the VLDB Endowment. Permission to copy without fee all or part of this material is granted provided that the copies are not made or distributed for direct commercial advantage, the VLDB copyright notice and the title of the publication and its date appear, and notice is given that copying is by the permission of the Very Large Data Base Endowment. To copy otherwise, or to republish, requires a fee and/or special permission from the Endowment.


Online Paper

ACM SIGMOD Anthology

CDROM Version: Load the CDROM "Volume 1 Issue 5, VLDB '89-'97" and ... DVD Version: Load ACM SIGMOD Anthology DVD 1" and ...

Printed Edition

Umeshwar Dayal, Peter M. D. Gray, Shojiro Nishio (Eds.): VLDB'95, Proceedings of 21th International Conference on Very Large Data Bases, September 11-15, 1995, Zurich, Switzerland. Morgan Kaufmann 1995, ISBN 1-55860-379-4
Contents CiteSeerX Google scholar pubzone.org BibTeX bibliographical record in XML

References

[1]
Kurt P. Brown, Manish Mehta, Michael J. Carey, Miron Livny: Towards Automated Performance Tuning for Complex Workloads. VLDB 1994: 72-84 CiteSeerX Google scholar pubzone.org BibTeX bibliographical record in XML
[2]
Michael J. Carey, Rajiv Jauhari, Miron Livny: Priority in DBMS Resource Scheduling. VLDB 1989: 397-410 CiteSeerX Google scholar pubzone.org BibTeX bibliographical record in XML
[3]
Michael J. Carey, Sanjay Krishnamurthi, Miron Livny: Load Control for Locking: The 'Half-and-Half' Approach. PODS 1990: 72-84 CiteSeerX Google scholar pubzone.org BibTeX bibliographical record in XML
[4]
Michael J. Carey, Waleed A. Muhanna: The Performance of Multiversion Concurrency Control Algorithms. ACM Trans. Comput. Syst. 4(4): 338-378(1986) CiteSeerX Google scholar pubzone.org BibTeX bibliographical record in XML
[5]
Diane L. Davison, Goetz Graefe: Memory-Contention Responsive Hash Joins. VLDB 1994: 379-390 CiteSeerX Google scholar pubzone.org BibTeX bibliographical record in XML
[6]
David J. DeWitt, Jim Gray: Parallel Database Systems: The Future of High Performance Database Systems. Commun. ACM 35(6): 85-98(1992) CiteSeerX Google scholar pubzone.org BibTeX bibliographical record in XML
[7]
David J. DeWitt, Jeffrey F. Naughton, Donovan A. Schneider, S. Seshadri: Practical Skew Handling in Parallel Joins. VLDB 1992: 27-40 CiteSeerX Google scholar pubzone.org BibTeX bibliographical record in XML
[8]
...
[9]
Susanne Englert: NonStop SQL: Scalability and Availability for Decision Support. SIGMOD Conference 1994: 491 CiteSeerX Google scholar pubzone.org BibTeX bibliographical record in XML
[10]
Goetz Graefe: Query Evaluation Techniques for Large Databases. ACM Comput. Surv. 25(2): 73-170(1993) CiteSeerX Google scholar pubzone.org BibTeX bibliographical record in XML
[11]
Jim Gray: Super Servers: Commodity Computer Clusters Pose a Software Challenge. BTW 1995: 30-47 CiteSeerX Google scholar pubzone.org BibTeX bibliographical record in XML
[12]
Yasuhiro Hirano, Tetsuji Satoh, Ushio Inoue, K. Teranaka: Load Balancing Algorithms for Parallel Database Processing on Shared Memory Multiprocessors. PDIS 1991: 210-217 CiteSeerX Google scholar pubzone.org BibTeX bibliographical record in XML
[13]
Wei Hong: Exploiting Inter-Operation Parallelism in XPRS. SIGMOD Conference 1992: 19-28 CiteSeerX Google scholar pubzone.org BibTeX bibliographical record in XML
[14]
Kien A. Hua, Jeffrey X. W. Su: Dynamic Load Balancing in Very Large Shared-Nothing Hypercube Database Computers. IEEE Trans. Computers 42(12): 1425-1439(1993) CiteSeerX Google scholar pubzone.org BibTeX bibliographical record in XML
[15]
Rajiv Jauhari, Michael J. Carey, Miron Livny: Priority-Hints: An Algorithm for Priority-Based Buffer Management. VLDB 1990: 708-721 CiteSeerX Google scholar pubzone.org BibTeX bibliographical record in XML
[16]
Hongjun Lu, Kian-Lee Tan: Dynamic and Load-balanced Task-Oriented Datbase Query Processing in Parallel Systems. EDBT 1992: 357-372 CiteSeerX Google scholar pubzone.org BibTeX bibliographical record in XML
[17]
Robert Marek: Ein Kostenmodell der parallelen Anfragebearbeitung in Shared-Nothing-Datenbanksystemen. BTW 1995: 232-251 CiteSeerX Google scholar pubzone.org BibTeX bibliographical record in XML
[18]
...
[19]
Manish Mehta, David J. DeWitt: Dynamic Memory Allocation for Multiple-Query Workloads. VLDB 1993: 354-367 CiteSeerX Google scholar pubzone.org BibTeX bibliographical record in XML
[20]
Manish Mehta, David J. DeWitt: Managing Intra-operator Parallelism in Parallel Database Systems. VLDB 1995: 382-394 CiteSeerX Google scholar pubzone.org BibTeX bibliographical record in XML
[21]
Marguerite C. Murphy, Ming-Chien Shan: Execution Plan Balancing. ICDE 1991: 698-706 CiteSeerX Google scholar pubzone.org BibTeX bibliographical record in XML
[22]
Edward Omiecinski: Performance Analysis of a Load Balancing Hash-Join Algorithm for a Shared Memory Multiprocessor. VLDB 1991: 375-385 CiteSeerX Google scholar pubzone.org BibTeX bibliographical record in XML
[23]
HweeHwa Pang, Michael J. Carey, Miron Livny: Partially Preemptive Hash Joins. SIGMOD Conference 1993: 59-68 CiteSeerX Google scholar pubzone.org BibTeX bibliographical record in XML
[24]
David A. Patterson, Garth A. Gibson, Randy H. Katz: A Case for Redundant Arrays of Inexpensive Disks (RAID). SIGMOD Conference 1988: 109-116 CiteSeerX Google scholar pubzone.org BibTeX bibliographical record in XML
[25]
...
[26]
Erhard Rahm, Robert Marek: Analysis of Dynamic Load Balancing Strategies for Parallel Shared Nothing Database Systems. VLDB 1993: 182-193 CiteSeerX Google scholar pubzone.org BibTeX bibliographical record in XML
[27]
Erhard Rahm, Thomas Stöhr: Analysis of Parallel Scan Processing in Shared Disk Database Systems. Euro-Par 1995: 485-500 CiteSeerX Google scholar pubzone.org BibTeX bibliographical record in XML
[28]
Patricia G. Selinger: Predictions and Challenges for Database Systems in the Year 2000. VLDB 1993: 667-675 CiteSeerX Google scholar pubzone.org BibTeX bibliographical record in XML
[29]
...
[30]
Alexander Thomasian: Thrashing in Two-Phase Locking Revisited. ICDE 1992: 518-526 CiteSeerX Google scholar pubzone.org BibTeX bibliographical record in XML
[31]
Patrick Valduriez: Parallel Database Systems: Open Problems and New Issues. Distributed and Parallel Databases 1(2): 137-165(1993) CiteSeerX Google scholar pubzone.org BibTeX bibliographical record in XML
[32]
Christopher B. Walton, Alfred G. Dale, Roy M. Jenevein: A Taxonomy and Performance Model of Data Skew Effects in Parallel Joins. VLDB 1991: 537-548 CiteSeerX Google scholar pubzone.org BibTeX bibliographical record in XML
[33]
Gerhard Weikum, Christof Hasse, Alex Moenkeberg, Peter Zabback: The COMFORT Automatic Tuning Project, Invited Project Review. Inf. Syst. 19(5): 381-432(1994) CiteSeerX Google scholar pubzone.org BibTeX bibliographical record in XML
[34]
Annita N. Wilschut, Jan Flokstra, Peter M. G. Apers: Parallelism in a Main-Memory DBMS: The Performance of PRISMA/DB. VLDB 1992: 521-532 CiteSeerX Google scholar pubzone.org BibTeX bibliographical record in XML
[35]
Joel L. Wolf, Daniel M. Dias, Philip S. Yu, John Turek: An Effective Algorithm for Parallelizing Hash Joins in the Presence of Data Skew. ICDE 1991: 200-209 CiteSeerX Google scholar pubzone.org BibTeX bibliographical record in XML
[36]
Hansjörg Zeller, Jim Gray: An Adaptive Hash Join Algorithm for Multiuser Environments. VLDB 1990: 186-197 CiteSeerX Google scholar pubzone.org BibTeX bibliographical record in XML

Copyright © Tue Mar 16 02:22:05 2010 by Michael Ley (ley@uni-trier.de)