Our paper has been accepted to IJCAI 2023! Check the paper.