TY - JOUR
T1 - Local Search for Efficient Causal Effect Estimation
AU - Cheng, Debo
AU - Li, Jiuyong
AU - Liu, Lin
AU - Zhang, Jiji
AU - Liu, Jixue
AU - Le, Thuc Duy
N1 - This work was supported in part by the Australian Research Council under Grant DP200101210. The work of Jiji Zhang was supported in part by the RGC of Hong Kong under Grant GRF13602720 and in part by a start-up fund from HKBU.
Publisher Copyright:
© 1989-2012 IEEE.
PY - 2023/9/1
Y1 - 2023/9/1
N2 - Causal effect estimation from observational data is a challenging problem, especially with high dimensional data and in the presence of unobserved variables. The available data-driven methods for tackling the problem either provide an estimation of the bounds of a causal effect (i.e., nonunique estimation) or have low efficiency. The major hurdle for achieving high efficiency while trying to obtain unique and unbiased causal effect estimation is how to find a proper adjustment set for confounding control in a fast way, given the huge covariate space and considering unobserved variables. In this paper, we approach the problem as a local search task for finding valid adjustment sets in data. We establish the theorems to support the local search for adjustment sets, and we show that unique and unbiased estimation can be achieved from observational data even when there exist unobserved variables. We then propose a data-driven algorithm that is fast and consistent under mild assumptions. We also make use of a frequent pattern mining method to further speed up the search of minimal adjustment sets for causal effect estimation. Experiments conducted on extensive synthetic and real-world datasets demonstrate that the proposed algorithm outperforms the state-of-the-art criteria/estimators in both accuracy and time-efficiency.
AB - Causal effect estimation from observational data is a challenging problem, especially with high dimensional data and in the presence of unobserved variables. The available data-driven methods for tackling the problem either provide an estimation of the bounds of a causal effect (i.e., nonunique estimation) or have low efficiency. The major hurdle for achieving high efficiency while trying to obtain unique and unbiased causal effect estimation is how to find a proper adjustment set for confounding control in a fast way, given the huge covariate space and considering unobserved variables. In this paper, we approach the problem as a local search task for finding valid adjustment sets in data. We establish the theorems to support the local search for adjustment sets, and we show that unique and unbiased estimation can be achieved from observational data even when there exist unobserved variables. We then propose a data-driven algorithm that is fast and consistent under mild assumptions. We also make use of a frequent pattern mining method to further speed up the search of minimal adjustment sets for causal effect estimation. Experiments conducted on extensive synthetic and real-world datasets demonstrate that the proposed algorithm outperforms the state-of-the-art criteria/estimators in both accuracy and time-efficiency.
KW - causal inference
KW - confounding bias
KW - graphical causal modelling
KW - latent variables
KW - Observational data
UR - http://www.scopus.com/inward/record.url?scp=85141613314&partnerID=8YFLogxK
UR - https://ieeexplore.ieee.org/document/9932683
U2 - 10.1109/TKDE.2022.3218131
DO - 10.1109/TKDE.2022.3218131
M3 - Journal article
AN - SCOPUS:85141613314
SN - 1041-4347
VL - 35
SP - 8823
EP - 8837
JO - IEEE Transactions on Knowledge and Data Engineering
JF - IEEE Transactions on Knowledge and Data Engineering
IS - 9
ER -