Geraniaceae are known for their unusual plastid genomes (plastomes), with the genus Pelargonium being most conspicuous with regard to plastome size and gene organization as judged by the sequenced plastomes of P. x hortorum and P. alternans. However, the hybrid origin of P. x hortorum and the uncertain phylogenetic position of P. alternans obscure the events that led to these extraordinary plastomes. Here, we examine all plastid reconfiguration hotspots for 60 Pelargonium species across all subgenera using a PCR and sequencing approach. Our reconstruction of the rearrangement history revealed four distinct plastome types. The ancestral plastome configuration in the two subgenera Magnipetala and Pelargonium is consistent with that of the P. alternans plastome, whereas that of the subgenus Parvulipetala deviates from this organization by one synapomorphic inversion in the trnNGUU-ndhF region. The plastome of P. x hortorum resembles those of one group of the subgenus Paucisignata, but differs from a second group by another inversion in the psaI-psaJ region. The number of microstructural changes and amount of repetitive DNA are generally elevated in all inverted regions. Nucleotide substitution rates correlate positively with the number of indels in all regions across the different subgenera. We also observed lineage- and species-specific changes in the gene content, including gene duplications and fragmentations. For example, the plastid rbcL-psaI region of Pelargonium contains a highly variable accD-like region. Our results suggest alternative evolutionary paths under possibly changing modes of plastid transmission and indicate the non-functionalization of the plastid accD gene in Pelargonium.