By the age of 35, men's testosterone levels begin to drop by one or two percent each year. By the age of 50, 30% of men are already below the normal testosterone range and that number increases as years advance.