Coat complexes coordinate cargo recognition through cargo adaptors with biogenesis of transport carriers during integral membrane protein trafficking. Here, we combine biochemical, structural, and cellular analyses to establish the mechanistic basis through which SNX27-Retromer, a major endosomal cargo adaptor, couples to the membrane remodeling endosomal SNX-BAR sorting complex for promoting exit 1 (ESCPE-1). In showing that the SNX27 FERM (4.1/ezrin/radixin/moesin) domain directly binds acidic-Asp-Leu-Phe (aDLF) motifs in the SNX1/SNX2 subunits of ESCPE-1, we propose a handover model where SNX27-Retromer captured cargo proteins are transferred into ESCPE-1 transport carriers to promote endosome-to-plasma membrane recycling. By revealing that assembly of the SNX27:Retromer:ESCPE-1 coat evolved in a stepwise manner during early metazoan evolution, likely reflecting the increasing complexity of endosome-to-plasma membrane recycling from the ancestral opisthokont to modern animals, we provide further evidence of the functional diversification of yeast pentameric Retromer in the recycling of hundreds of integral membrane proteins in metazoans.