THIS is a router. you plug it into the cable modem.
On that, there are several jacks that you can plug ethernet cords into. Plug two identical ethernet cables into the available jacks, and then one goes into one computer's network card, and the other cable goes into the OTHER computer's network card.