Autophagy or “self-eating” is a highly conserved pathway that enables cells to degrade pieces of themselves in autolysosomes to enable their survival in times of stress, including nutrient deprivation. The formation of these degradative compartments requires cytosolic proteins, some of which are autophagy specific, as well as intracellular organelles, such as the ER and Golgi, and the endosome–lysosome system. Here we discuss the cross talk between autophagy and intracellular compartments, highlighting recent exciting data about the role and regulation of the Vps34 class III phosphatidylinositol (PI) 3-kinase in autophagy.