I also am in the process of phasing out all of my men's pants. I've found so many women's dress pants that look and fit great that I can't find a reason not too.
Dress as you like and enjoy yourself. So much of today's styles can cross over, that only you'll know for sure.