More than two drinks a day is considered a risk factor for ED. Alcohol can lower testosterone levels, decrease flowing blood to the penis, and cause nerve and hormonal imbalances. Low testosterone from alcohol or drug abuse can also affect your libido and performance, potentially leading to further psychological ED complications.