Use antisemitic propaganda to get the population focused on hating the jews instead of hating Tsarism and Orthodoxy. Do the same for muslims.
Sure, it'd mean you get protofascist russia but if you want a surviving czarist regime, good luck getting it without going down unpleasant paths.