1. Use of drugs Most ingredients found in drugs that affect a man's sperm count is Anabolic steroids. It is used to improve muscle strength and growth, but it can shrink the testicles and reduce sperm production. The use of cocaine or marijuana can also reduce the quantity and consistency of your husband's semen. 2. Excessive alcohol intake Alcohol has oxygen-free radicals that are suspect of lowering a man's sperm count. This is due to the toxicity of alcohol itself. While some studies say that red wine may help give men a good quality of sperm, there are also many studies that claim otherwise. If you are planning to conceive a child soon, it is recommended to advise your husband to start controlling alcohol usage. And if this seems to be a drastic change in his lifestyle, it is best to consult with a specialist.