The prostate is a small gland in men that lies immediately beneath the bladder. A bacterial infection within the prostate, a condition called bacterial prostatitis, can cause uncomfortable symptoms in men.