The longer you're on testosterone, the harder it may be to get sperm production to come back—and in 25% of people, they may not get it back if they've been on prolonged testosterone exposure.