The AEM regulator is not stock. You want a stock regulator. It doesn't matter if you had the problem before you switched the pump. You should go back to stock fuel system components.

The only time you need to upgrade any of these things is if you're going to be running higher flow rate injectors to go with a turbo and you need to supply those injectors with enough fuel. You don't have a turbo, so you don't need these things.

The stock fuel system is more than up to the task of providing fuel to the stock fuel injectors. Throwing a bunch of aftermarket stuff in there while still using the stock injectors is only going to mess things up.