Caveolin-1 (CAV1) and CAV3 are membrane-sculpting proteins driving the formation of the plasma membrane (PM) caveolae. Within the PM mosaic environment, caveola assembly is unique as it requires progressive oligomerization of newly synthesized caveolins while trafficking through the biosynthetic-secretory pathway. Here, we have investigated these early events by combining structural, biochemical, and microscopy studies. We uncover striking trafficking differences between caveolins, with CAV1 rapidly exported to the Golgi and PM while CAV3 is initially retained in the endoplasmic reticulum and laterally moves into lipid droplets. The levels of caveolins in the endoplasmic reticulum are controlled by proteasomal degradation, and only monomeric/low oligomeric caveolins are exported into the cis-Golgi with higher-order oligomers assembling beyond this compartment. When any of those early proteostatic mechanisms are compromised, chemically or genetically, caveolins tend to accumulate along the secretory pathway forming non-functional aggregates, causing organelle damage and triggering cellular stress. Accordingly, we propose a model in which disrupted proteostasis of newly synthesized caveolins contributes to pathogenesis.