A good battery should be able to push 10.5 volts at 1/2 cold cranking amps for about 15 seconds. A good alternator should be able to provide it's amp rating ( usually around 60 for a honda ) at battery voltage, around 12 volts.
If you don't have proper testing equipment and your battery is a few years old, replace it anyway.
BTW, why do you think your battery has problems?