Angiogenesis sustains tumor growth and metastasis, and recent studies indicate that the vascular endothelium regulates tissue mass. In the prostate, androgens drive angiogenic inducers to stimulate growth, whereas androgen withdrawal leads to decreased vascular endothelial growth factor, vascular regression and epithelial cell apoptosis. Here, we identify the angiogenesis inhibitor pigment epithelium–derived factor (PEDF) as a key inhibitor of stromal vasculature and epithelial tissue growth in mouse prostate and pancreas. In PEDF-deficient mice, stromal vessels were increased and associated with epithelial cell hyperplasia. Androgens inhibited prostatic PEDF expression in cultured cells. In vivo, androgen ablation increased PEDF in normal rat prostates and in human cancer biopsies. Exogenous PEDF induced tumor epithelial apoptosis in vitro and limited in vivo tumor xenograft growth, triggering endothelial apoptosis. Thus, PEDF regulates normal pancreas and prostate mass. Its androgen sensitivity makes PEDF a likely contributor to the anticancer effects of androgen ablation.