Testosterone levels can decrease with age, usually starting from the age of 30-40. Stress, poor nutrition, and certain diseases can also lower levels.