The Golgi apparatus has many important physiological functions, including sorting of secretory cargo and biosynthesis of complex glycans. These functions depend on the intricate and compartmentalized organization of the Golgi apparatus. To investigate the mechanisms that regulate Golgi architecture, we developed a quantitative morphological assay using three different Golgi compartment markers and quantitative image analysis, and performed a kinome- and phosphatome-wide RNAi screen in HeLa cells. Depletion of 159 signaling genes, nearly 20% of genes assayed, induced strong and varied perturbations in Golgi morphology. Using bioinformatics data, a large regulatory network could be constructed. Specific subnetworks are involved in phosphoinositides regulation, acto-myosin dynamics and mitogen activated protein kinase signaling. Most gene depletion also affected Golgi functions, in particular glycan biosynthesis, suggesting that signaling cascades can control glycosylation directly at the Golgi level. Our results provide a genetic overview of the signaling pathways that control the Golgi apparatus in human cells.