If I am not mistaken most Civic's and CRX's of the "EARLY YEARS" did not have power steering and You also might want to check your tie rods mine are doing the same thing and I am going to replace mine after the new years along with the axles and shocks......
Hope I was helpful in some way...