With the exception of there not being a crosswalk nearby or it's a dead street, you really shouldn't be jaywalking.
If it's safe to do so, why does it matter where you cross?
Pedestrians should have right of way, given their vulnerability. Only reason to whack someone is if they are just running out in front of traffic, or suddenly lurching from in between cars. Otherwise let people cross where they want/are safe to do so.
Because you are leaving the judgment of when it's safe up to the pedestrian who often underestimates the speed of oncoming traffic, especially at night.
A pedestrian at a crosswalk is at least more clear of an indicator that they wish to cross and therefore oncoming traffic has a better chance to slow down ahead of time or at least slow down without the risk of hitting the pedestrian.
If there are no cars around why should you wait for the light to change before you cross the street? It makes no sense ---