It never used to be said in a way to diminish women, rather to protect them from heavier work. I know that I can't lift as much as my husband can, so I don't mind admitting that I am physically weaker.
If you have seen those women bodybuilders though, they probably wouldn't like to be called weaker sex!