If the EGR doesn't pan out, check your rear (vacuum operated) engine mount.

When that screws up, the idle gets rough when stopped IN GEAR like at a stop light. The idle speed doesn't get real low, & the engine doesn't struggle to stay running, but it vibrates more than normal.

But the engine mount won't explain the sooty exhaust...