Tea (Camellia sinensis (L.) O. Kuntze) is the world’s most popular beverage crop. However, to date, no core collection has been selected from worldwide germplasm resources on the basis of genotype data. In this study, we analyzed 788 tea germplasm accessions using 23 simple sequence repeat (SSR) markers. Our population structure analysis divided the germplasms into a Japanese group and an exotic group. The latter could be divided into var. sinensis and var. assamica. The genetic diversity was higher in germplasms from China, Taiwan, India, and Sri Lanka than in those from other countries, and low in germplasms from Japan. Using the number of SSR alleles as a measure of genetic diversity, we developed a core collection consisting of 192 accessions and three subcore collections with 96, 48, and 24 accessions. Although the results might be affected by marker-selection bias, the core 192 collection adequately covered the range of variation of the 788 accessions in floral morphology, and the chemical composition of first-flush leaves. These collections will be powerful tools for breeding and genetic research in tea.