TY - JOUR
T1 - Cardinality estimation of activity trajectory similarity queries using deep learning
AU - Tian, Ruijie
AU - Zhang, Weishi
AU - Wang, Fei
AU - Zhou, Jingchun
AU - Alhudhaif, Adi
AU - Alenezi, Fayadh
N1 - Publisher Copyright:
© 2023 Elsevier Inc.
PY - 2023/10
Y1 - 2023/10
N2 - Cardinality estimation, which involves estimating the result size of queries, is a critical aspect of query processing and optimization. Deep Neural Networks (DNNs) are data hungry, and being trained directly for cardinality estimation of activity trajectory similarity queries usually leads to poor performance. To address this problem, we propose two enhancements to improve accuracy and reduce the training data size: query slice and data slice. Query slice divides a query trajectory into three slices based on similarity dimensions (i.e., spatial, temporal, and textual). Data slice organizes similar trajectories into data slices. Furthermore, we design a global-local model to determine which local models should be used for a given query. We also extend above model to support similarity joins. Experimental results show that our method efficiently learns to estimate the cardinality, achieving superior accuracy and efficiency compared to state-of-the-art methods.
AB - Cardinality estimation, which involves estimating the result size of queries, is a critical aspect of query processing and optimization. Deep Neural Networks (DNNs) are data hungry, and being trained directly for cardinality estimation of activity trajectory similarity queries usually leads to poor performance. To address this problem, we propose two enhancements to improve accuracy and reduce the training data size: query slice and data slice. Query slice divides a query trajectory into three slices based on similarity dimensions (i.e., spatial, temporal, and textual). Data slice organizes similar trajectories into data slices. Furthermore, we design a global-local model to determine which local models should be used for a given query. We also extend above model to support similarity joins. Experimental results show that our method efficiently learns to estimate the cardinality, achieving superior accuracy and efficiency compared to state-of-the-art methods.
KW - Activity trajectory
KW - Cardinality estimation
KW - Deep neural network (DNN)
KW - Similarity query
UR - http://www.scopus.com/inward/record.url?scp=85165927287&partnerID=8YFLogxK
U2 - 10.1016/j.ins.2023.119398
DO - 10.1016/j.ins.2023.119398
M3 - Article
AN - SCOPUS:85165927287
SN - 0020-0255
VL - 646
JO - Information Sciences
JF - Information Sciences
M1 - 119398
ER -