TY - JOUR
T1 - Change Propagation Without Joins
AU - Wang, Qichen
AU - Hu, Xiao
AU - Dai, Binyang
AU - Yi, Ke
N1 - Funding Information:
This work has been supported by HKRGC under grants 16201318, 16201819, and 16205420. Qichen Wang conducted this research work when he studied at HKUST.
Publisher Copyright:
© 2023, VLDB Endowment. All rights reserved.
Copyright is held by the owner/author(s). Publication rights licensed to the VLDB Endowment.
PY - 2023/1/1
Y1 - 2023/1/1
N2 - We revisit the classical change propagation framework for query evaluation under updates. The standard framework takes a query plan and materializes the intermediate views, which incurs high polynomial costs in both space and time, with the join operator being the culprit. In this paper, we propose a new change propagation framework without joins, thus naturally avoiding this polynomial blowup. Meanwhile, we show that the new framework still supports constant-delay enumeration of both the deltas and the full query results, the same as in the standard framework. Furthermore, we provide a quantitative analysis of its update cost, which not only recovers many recent theoretical results on the problem, but also yields an effective approach to optimizing the query plan. The new framework is also easy to be integrated into an existing streaming database system. Experimental results show that our system prototype, implemented using Flink DataStream API, significantly outperforms other systems in terms of space, time, and latency.
AB - We revisit the classical change propagation framework for query evaluation under updates. The standard framework takes a query plan and materializes the intermediate views, which incurs high polynomial costs in both space and time, with the join operator being the culprit. In this paper, we propose a new change propagation framework without joins, thus naturally avoiding this polynomial blowup. Meanwhile, we show that the new framework still supports constant-delay enumeration of both the deltas and the full query results, the same as in the standard framework. Furthermore, we provide a quantitative analysis of its update cost, which not only recovers many recent theoretical results on the problem, but also yields an effective approach to optimizing the query plan. The new framework is also easy to be integrated into an existing streaming database system. Experimental results show that our system prototype, implemented using Flink DataStream API, significantly outperforms other systems in terms of space, time, and latency.
UR - http://www.scopus.com/inward/record.url?scp=85149914368&partnerID=8YFLogxK
U2 - 10.14778/3579075.3579080
DO - 10.14778/3579075.3579080
M3 - Conference article
AN - SCOPUS:85149914368
SN - 2150-8097
VL - 16
SP - 1046
EP - 1058
JO - Proceedings of the VLDB Endowment
JF - Proceedings of the VLDB Endowment
IS - 5
T2 - 49th International Conference on Very Large Data Bases, VLDB 2023
Y2 - 28 August 2023 through 1 September 2023
ER -