The genetic diversity and population genetic structure of 252 accessions from 21 Prunus sibirica L. populations were investigated using 10 ISSR, SSR, and SRAP markers. The results suggest that the entire population has a relatively high level of genetic diversity, with populations HR and MY showing very high diversity. A low level of inter-population genetic differentiation and a high level of intra-population genetic differentiation was found, which is supported by a moderate level of gene flow, and largely attributable to the cross-pollination and self-incompatibility reproductive system. A STRUCTURE (model-based program) analysis revealed that the 21 populations can be divided into two main groups, mainly based on geographic differences and genetic exchanges. The entire wild Siberia apricot population in China could be divided into two subgroups, including 107 accessions in subgroup (SG) 1 and 147 accessions in SG 2. A Mantel test revealed a significant positive correlation between genetic and geographic distance matrices, and there was a very significant positive correlation among three marker datasets. Overall, we recommend a combination of conservation measures, with ex situ and in situ conservation that includes the construction of a core germplasm repository and the implement of in situ conservation for populations HR, MY, and ZY.