Even if I were single, liked women enough for a romantic relationship, or you turned it into a hot guy, my answer would be no.
As long as you're handling your responsibilities and not doing something unfaithful or illegal, NO ONE has any business telling you what you can do as a hobby.