Advances In Sequential Decision Making Problems With Causal And Low-Rank Structures