I had a similar problem my '98 LX and it was the rear drums that were bad. I found out after testing it by using the parking brake only at different speeds and I could feel exactly what you described.