TY - JOUR
T1 - Adaptive Index Utilization in Memory-Resident Structural Joins
AU - He, Bingsheng
AU - Luo, Qiong
AU - Choi, Byron
N1 - Funding information:
The authors thank the anonymous reviewers for their comments on the earlier versions of the draft. This work was supported by Grants DAG05/06.EG11, HKUST6263/04E, and 617206, all from the Hong Kong Research Grants Council.
Publisher copyright:
© 2007 IEEE.
PY - 2007/6
Y1 - 2007/6
N2 - We consider adaptive index utilization as a fine-grained problem in autonomic databases in which an existing index is dynamically determined to be used or not in query processing. As a special case, we study this problem for structural joins, the core operator in XML query processing, in the main memory. We find that index utilization is beneficial for structural joins only under certain join selectivity and distribution of matching elements. Therefore, we propose adaptive algorithms to decide whether to use an index probe or a data scan for each step of matching during the processing of a structural join operator. Our adaptive algorithms are based on the history, the look-ahead information, or both. We have developed a cost model to facilitate this adaptation and have conducted experiments with both synthetic and real-world data sets. Our results show that adaptively utilizing indexes in a structural join improves the performance by taking advantage of both sequential scans and index probes.
AB - We consider adaptive index utilization as a fine-grained problem in autonomic databases in which an existing index is dynamically determined to be used or not in query processing. As a special case, we study this problem for structural joins, the core operator in XML query processing, in the main memory. We find that index utilization is beneficial for structural joins only under certain join selectivity and distribution of matching elements. Therefore, we propose adaptive algorithms to decide whether to use an index probe or a data scan for each step of matching during the processing of a structural join operator. Our adaptive algorithms are based on the history, the look-ahead information, or both. We have developed a cost model to facilitate this adaptation and have conducted experiments with both synthetic and real-world data sets. Our results show that adaptively utilizing indexes in a structural join improves the performance by taking advantage of both sequential scans and index probes.
KW - Adaptive query processing
KW - Index utilization
KW - Memory-resident systems
KW - Structural joins
UR - http://www.scopus.com/inward/record.url?scp=34247615159&partnerID=8YFLogxK
U2 - 10.1109/TKDE.2007.190616
DO - 10.1109/TKDE.2007.190616
M3 - Journal article
AN - SCOPUS:34247615159
SN - 1041-4347
VL - 19
SP - 772
EP - 788
JO - IEEE Transactions on Knowledge and Data Engineering
JF - IEEE Transactions on Knowledge and Data Engineering
IS - 6
ER -