Flash-based database systems: Experiences from the flashdb project

The new characteristics of flash memory bring great challenges in optimizing database performance, by using new querying algorithms, indexes, buffer management schemes, and new transaction processing protocols. In this talk, we will first present an overview on the FlashDB project, which was launched in 2009 and supported by the National Natural Science Foundation of China (No. 60833005). The project aims at constructing the fundamental theory and design principles of flash-based database systems including a series of key problems, such as system architecture, storage management and indexing, query processing, transaction processing, buffer management, etc. In particular, we focus on establishing a basis for data management involving flash memory, developing database management systems for flash-based SSDs, and preparing a test bed for flash-based database applications. During the past two years, we have made some achievements in buffer management [1, 2], index structures [3], storage management [4], and SSD simulation platform [5]. After a brief introduction on the current research results in the project, we will discuss some experiences and lessons concluded from the study. We will emphasize several issues that may be open up exciting avenues and influence the direction of the research within the scope of flash-based database systems.