Beetles (Coleoptera) have the highest species diversity among all orders, and they have diverse food habits. Gut microbes may have contributed to this diversification of food habits. Here, we identified the pattern of the relationship between ground-dwelling beetles and their gut microbial communities (bacteria and fungi) in the field. We collected 46 beetle species of five families from secondary deciduous forests and grasslands in Japan and extracted microbial DNA from whole guts for amplicon sequencing. The gut bacterial and fungal communities differed among all habitats and all food habits of their hosts (carnivores, herbivores, omnivores, and scavengers) except for the fungal communities between carnivores and scavengers. Specifically, the abundant bacterial group varied among food habits: Xanthomonadaceae were abundant in scavengers, whereas Enterobacteriaceae were abundant in carnivores and herbivores. Phylogenetically closely related beetles had phylogenetically similar communities of Enterobacteriaceae, suggesting that the community structure of this family is related to the evolutionary change in beetle ecology. One of the fungal groups, Yarrowia species, which has been reported to have a symbiotic relationship with silphid beetles, was also detected from various carnivorous beetles. Our results suggest that the symbiotic relationships between ground-dwelling beetles and these microbes are widespread.