Integrating Reliable Memory in Databases.

Wee Teck Ng, Peter M. Chen: Integrating Reliable Memory in Databases. VLDB 1997: 76-85

@inproceedings{DBLP:conf/vldb/NgC97,
  author    = {Wee Teck Ng and
               Peter M. Chen},
  editor    = {Matthias Jarke and
               Michael J. Carey and
               Klaus R. Dittrich and
               Frederick H. Lochovsky and
               Pericles Loucopoulos and
               Manfred A. Jeusfeld},
  title     = {Integrating Reliable Memory in Databases},
  booktitle = {VLDB'97, Proceedings of 23rd International Conference on Very
               Large Data Bases, August 25-29, 1997, Athens, Greece},
  publisher = {Morgan Kaufmann},
  year      = {1997},
  isbn      = {1-55860-470-7},
  pages     = {76-85},
  ee        = {db/conf/vldb/NgC97.html},
  crossref  = {DBLP:conf/vldb/97},
  bibsource = {DBLP, http://dblp.uni-trier.de}
}

Abstract

Recent results in the Rio project at the University of Michigan show that it is possible to create an area of main memory that is as safe as disk from operating system crashes. This paper explores how to integrate the reliable memory provided by the Rio file cache into a database system. We propose three designs for integrating reliable memory into databases: non-persistent database buffer cache, persistent database buffer cache, and persistent database buffer cache with protection. Non-persistent buffer caches use an I/O interface to reliable memory and require the fewest modifications to existing databases. However, they waste memory capacity and bandwidth due to double buffering. Persistent buffer caches use a memory interface to reliable memory by mapping it into the database address space. This places reliable memory under complete database control and eliminates double buffering, but it may expose the buffer cache to database errors. Our third design reduces this exposure by write protecting the buffer pages. Extensive fault tests show that mapping reliable memory into the database address space does not significantly hurt reliability. This is because wild stores rarely touch dirty, committed pages written by previous transactions. As a result, we believe that databases should use a memory interface to reliable memory.

Copyright © 1997 by the VLDB Endowment. Permission to copy without fee all or part of this material is granted provided that the copies are not made or distributed for direct commercial advantage, the VLDB copyright notice and the title of the publication and its date appear, and notice is given that copying is by the permission of the Very Large Data Base Endowment. To copy otherwise, or to republish, requires a fee and/or special permission from the Endowment.

Online Paper

Download PDF file (www.vldb.org, Darmstadt, Germany)
Download PDF file (www.acm.org, New York, USA)

ACM SIGMOD Anthology

CDROM Version: Load the CDROM "Volume 1 Issue 5, VLDB '89-'97" and ...

Windows: Click the letter of your CD drive
A B C D E F G H I J K L M N O P Q R S T U V W X Y Z
Mac: Click here
UNIX/LINUX: mount the CD and click on the path of your mount point:
/Anthology/vldb8997 or /cdrom

DVD Version: Load ACM SIGMOD Anthology DVD 1" and ...

Windows: Click the letter of your CD drive
A B C D E F G H I J K L M N O P Q R S T U V W X Y Z
Mac: Click here
UNIX/LINUX: mount the DVD and click on the path of your mount point:
/Anthology/aDVD1 or /dvd

Printed Edition

Matthias Jarke, Michael J. Carey, Klaus R. Dittrich, Frederick H. Lochovsky, Pericles Loucopoulos, Manfred A. Jeusfeld (Eds.): VLDB'97, Proceedings of 23rd International Conference on Very Large Data Bases, August 25-29, 1997, Athens, Greece. Morgan Kaufmann 1997, ISBN 1-55860-470-7
Contents

Electronic Edition

From CS Dept., University Trier (Germany)

References

[Agrawal89]: Rakesh Agrawal, H. V. Jagadish: Recovery Algorithms for Database Machines with Nonvolatile Main Memory. IWDM 1989: 269-285
[Akyurek95]: Sedat Akyürek, Kenneth Salem: Management of Partially Safe Buffers. IEEE Trans. Computers 44(3): 394-407(1995)
[APC96]: ...
[Bartlett81]: Joel F. Bartlett: A NonStop Kernel. SOSP 1981: 22-19
[Barton90]: James H. Barton, Edward W. Czeck, Zary Segall, Daniel P. Siewiorek: Fault Injection Experiments Using FIAT. IEEE Trans. Computers 39(4): 575-582(1990)
[Bhide93]: Anupam Bhide, Daniel M. Dias, Nagui Halim, T. Basil Smith, Francis N. Parr: A Case for Fault-Tolerant Memory for Transaction Processing. FTCS 1993: 451-460
[Bitton93]: Dina Bitton, David J. DeWitt, Carolyn Turbyfill: Benchmarking Database Systems A Systematic Approach. VLDB 1983: 8-19
[Bohannon97]: Philip Bohannon, Daniel F. Lieuwen, Rajeev Rastogi, Abraham Silberschatz, S. Seshadri, S. Sudarshan: The Architecture of the Dalí Main-Memory Storage Manager. Multimedia Tools Appl. 4(2): 115-151(1997)
[Chen94]: Peter M. Chen, Edward L. Lee, Garth A. Gibson, Randy H. Katz, David A. Patterson: RAID: High-Performance, Reliable Secondary Storage. ACM Comput. Surv. 26(2): 145-185(1994)
[Chen96]: Peter M. Chen, Wee Teck Ng, Subhachandra Chandra, Christopher M. Aycock, Gurushankar Rajamani, David E. Lowell: The Rio File Cache: Surviving Operating System Crashes. ASPLOS 1996: 74-83
[Copeland89]: George P. Copeland, Tom W. Keller, Ravi Krishnamurthy, Marc G. Smith: The Case For Safe RAM. VLDB 1989: 327-335
[DeWitt84]: David J. DeWitt, Randy H. Katz, Frank Olken, Leonard D. Shapiro, Michael Stonebraker, David A. Wood: Implementation Techniques for Main Memory Database Systems. SIGMOD Conference 1984: 1-8
[Elhardt84]: Klaus Elhardt, Rudolf Bayer: A Database Cache for High Performance and Fast Restart in Database Systems. ACM Trans. Database Syst. 9(4): 503-525(1984)
[GM92]: Hector Garcia-Molina, Kenneth Salem: Main Memory Database Systems: An Overview. IEEE Trans. Knowl. Data Eng. 4(6): 509-516(1992)
[Gray78]: Jim Gray: Notes on Data Base Operating Systems. Advanced Course: Operating Systems 1978: 393-481
[Gray81]: Jim Gray, Paul R. McJones, Mike W. Blasgen, Bruce G. Lindsay, Raymond A. Lorie, Thomas G. Price, Gianfranco R. Putzolu, Irving L. Traiger: The Recovery Manager of the System R Database Manager. ACM Comput. Surv. 13(2): 223-243(1981)
[Haerder93]: Theo Härder, Andreas Reuter: Principles of Transaction-Oriented Database Recovery. ACM Comput. Surv. 15(4): 287-317(1983)
[Hagmann86]: Robert B. Hagmann: Crash Recovery Scheme for a Memory-Resident Database System. IEEE Trans. Computers 35(9): 839-843(1986)
[Harty92]: Kieran Harty, David R. Cheriton: Application-Controlled Physical Memory using External Page-Cache Management. ASPLOS 1992: 187-197
[Kanawati95]: Ghani A. Kanawati, Nasser A. Kanawati, Jacob A. Abraham: FERRARI: A Flexible Software-Based Fault and Error Injection System. IEEE Trans. Computers 44(2): 248-260(1995)
[Kao93]: Wei-lun Kao, Ravishankar K. Iyer, Dong Tang: FINE: A Fault Injection and Monitoring Environment for Tracing the UNIX System Behavior under Faults. IEEE Trans. Software Eng. 19(11): 1105-1118(1993)
[Lee93]: Inhwan Lee, Ravishankar K. Iyer: Faults, Symptoms, and Software Fault Tolerance in the Tandem GUARDIAN90 Operating System. FTCS 1993: 20-29
[Liskov91]: Barbara Liskov, Sanjay Ghemawat, Robert Gruber, Paul Johnson, Liuba Shrira, Michael Williams: Replication in the Harp File System. SOSP 1991: 226-238
[Lowell97]: David E. Lowell, Peter M. Chen: Free Transactions With Rio Vista. SOSP 1997: 92-101
[Muller96]: Gilles Muller, Michel Banâtre, Nadine Peyrouze, Bruno Rochat: Lessons from FTM: An Experiment in Design and Implementation of a Low-Cost Fault-Tolerant System. IEEE Transactions on Reliability 45(2): 332-339(1996)
[Patterson95]: R. Hugo Patterson, Garth A. Gibson, Eka Ginting, Daniel Stodolsky, Jim Zelenka: Informed Prefetching and Caching. SOSP 1995: 79-95
[Rahm92]: Erhard Rahm: Performance Evaluation of Extended Storage Architectures for Transaction Processing. SIGMOD Conference 1992: 308-317
[Rosenblum95]: Mendel Rosenblum, Edouard Bugnion, Stephen Alan Herrod, Emmett Witchel, Anoop Gupta: The Impact of Architectural Trends on Operating System Performance. SOSP 1995: 285-298
[Satyanarayanan93]: Mahadev Satyanarayanan, Henry H. Mashburn, Puneet Kumar, David C. Steere, James J. Kistler: Lightweight Recoverable Virtual Memory. SOSP 1993: 146-160
[Seltzer96]: Margo I. Seltzer, Yasuhiro Endo, Christopher Small, Keith A. Smith: Dealing with Disaster: Surviving Misbehaved Kernel Extensions. OSDI 1996: 213-227
[Srivastava94]: Amitabh Srivastava, Alan Eustace: ATOM - A System for Building Customized Program Analysis Tools. PLDI 1994: 196-205
[Stonebraker81]: Michael Stonebraker: Operating System Support for Database Management. Commun. ACM 24(7): 412-418(1981)
[Stonebraker87]: Michael Stonebraker: The Design of the POSTGRES Storage System. VLDB 1987: 289-300
[Sullivan91a]: Mark Sullivan, Michael Stonebraker: Using Write Protected Data Structures To Improve Software Fault Tolerance in Highly Available Database Management Systems. VLDB 1991: 171-180
[Sullivan91b]: Mark Sullivan, Ram Chillarege: Software Defects and their Impact on System Availability: A Study of Field Failures in Operating Systems. FTCS 1991: 2-9
[Sullivan92]: Mark Sullivan, Ram Chillarege: A Comparison of Software Defects in Database Management Systems and Operating Systems. FTCS 1992: 475-484
[Sullivan93]: Mark Sullivan: System Support for Software Fault Tolerance in Highly Available Database Management Systems. Ph.D. thesis, University of California at Berkeley 1993
[TPC90]: ...
[Wahbe93]: Robert Wahbe, Steven Lucco, Thomas E. Anderson, Susan L. Graham: Efficient Software-Based Fault Isolation. SOSP 1993: 203-216
[Wu94]: Michael Wu, Willy Zwaenepoel: eNVy: A Non-Volatile, Main Memory Storage System. ASPLOS 1994: 86-97