The fmu goes post fpr, so yes you keep the stock (or aftermarket) fuel pressure reg.
The fmu will not control idle fuel pressure, it only comes into play once boost is detected. The inlet to the fmu is the outlet of the stock (or aftermarket) fuel press reg (fuel return line) and the outlet continues on to the tank.