Home networking?

Poll of the Day

I have a cable modem/router combo (Arris Surfboard) connected via coax cable through a patch panel and connected into a wall jack.

Picture of patch panel:
https://gamefaqs.gamespot.com/a/forum/4/4f19f981.jpg

But my patch panel is in the basement far from my modem, and I want to be able to use the Ethernet ports in the house. I think I just need to run an Ethernet cable to the nearest wall Ethernet port and then I can connect the other end of that in the patch panel to an Ethernet Switch and plug in the remaining cables to enable access at the other ports, correct?
But...none of the cables in the patch panel are labeled. There's 11 Ethernet cables and 2 unused coax ends hanging there (I only have 6 total Ethernet ports in the house, I guess the other 5 are spare / connect to nothing?).
I guess there's cable testers you can buy, but this is like a one time only problem. Can I just brute force this? Like...run the Ethernet from the modem to the wall port, then go to the patch panel w/ my laptop and plug in to different cable ends till I get a LAN connection? Then I can label that as the "main" and use it w/ the switch as above?
Just checking if I'm on the right track here... Thanks.