The day basically doesn't have meaning unless you go to a public school or work a government job, or maybe some banks, in which case you likely have the day off.
For everyone else you go to work and the day is as normal.
Even the people who have the day off, it's not like they put on Colombus costumes and celebrate him (not like people do it for presidents day either, or other historical figures that have a dated holiday but nobody actually actively celebrates).
So technically, almost nobody celebrates Colombus Day even if you do get the day off. It's mostly just a government holiday.
That said, should the day be removed or the named changed because people find history to be offensive? No.
I don't give a crap about Colombus or Colombus Day, but that's a stupid amount of effort to put into something because people's feeling are hurt about history, about something nobody actually does in the first place, celebrate Colombus.
You want to name it anything name it government holiday #8 or something, because that's what it is.