The current distribution of Bantu languages is commonly considered to be a consequence of a relatively recent population expansion (3-5 kya) in Central Western Africa. While there is a substantial consensus regarding the centre of origin of Bantu languages (the Benue River Valley, between South East Nigeria and Western Cameroon), the identification of the area from where the population expansion actually started, the relation between the processes leading to the spread of languages and peoples and the relevance of local migratory events remain controversial. In order to shed new light on these aspects, we studied Y chromosome variation in a broad dataset of populations encompassing Nigeria, Cameroon, Gabon and Congo. Our results evidence an evolutionary scenario which is more complex than had been previously thought, pointing to a marked differentiation of Cameroonian populations from the rest of the dataset. In fact, in contrast with the current view of Bantu speakers as a homogeneous group of populations, we observed an unexpectedly high level of inter-population genetic heterogeneity and highlighted previously undetected diversity for lineages associated with the diffusion of Bantu languages (E1b1a (M2) sub-branches). We also detected substantial differences in local demographic histories, which concord with the hypotheses regarding an early diffusion of Bantu languages into the forest area and a subsequent demographic expansion and migration towards eastern and western Africa.