The microstructural evolution of polymineralic contact metamorphic calcite marbles (Adamello contact aureole) with variable volume fractions of second-phase minerals were quantitatively analyzed in terms of changes in grain size and nearest neighbor relations, as well as the volume fractions, dispersion and occurrences of the second phases as a function of changing metamorphic conditions. In all samples, the calcite grain size is controlled by pinning of grain boundaries by second phases, which can be expressed by the Zener parameter (Z), i.e., the ratio between size and volume fraction of the second phases. With increasing peak metamorphic temperature, both the sizes of matrix grains and second phases increase in dependence on the second-phase volume fraction. Two distinct coarsening trends are revealed: trend I with coupled grain coarsening limited by the growth of the second phases is either characterized by large-sized or a large number of closely spaced-second phase particles, and results finally in a dramatic increase in the calcite grain size with Z. Trend II is manifest by matrix controlled grain growth, which is retarded by the presence of single second-phase particles that are located on calcite grain boundaries. It is supported by grain boundary pinning induced by triple junctions, and the calcite grain size increases moderately with Z. The two different grain coarsening trends manifest the transition between relatively pure polymineralic aggregates (trend II) and microstructures with considerable second-phase volume fractions of up to 0.5. The variations might be of general validity for any polymineralic rock, which undergoes grain coarsening during metamorphism. The new findings are important for a better understanding of the initiation of strain localization based on the activation of grain size dependent deformation mechanisms.