The diversity of microbial communities in rhizosphere soil and non-rhizosphere soil was investigated in Juglans mandshurica plantation in Liaodong Mountain, and the relationship between the diversity and physical or chemical characteristics of soil were also studied. The results showed that most of chemical characteristics such as pH, total carbon, total nitrogen, total phosphorus and available phosphorus in rhizosphere soils were higher than that in non-rhizosphere soils significantly. The main factors affecting soil bacterial and fungal community structure are soil pH and available phosphorus (bacteria) and available nitrogen (fungi), respectively. Significant difference in the number of biomaker between rhizosphere and non-rhizosphere soils was detected for fungal, but not for bacteria. On contrast, significant difference of the diversity indexes between rhizosphere and non-rhizosphere soils were detected for bacteria, but not for fungi. These differences between rhizosphere and non-rhizosphere soils, and also between bacteria and fungi might caused by roots physiological metabolism of J. mandshurica. The dominant microbial groups are Actinobacteriota, Proteobacteria and Acidobacteriota (bacteria) and Ascomycota (fungi), which accounted for about 80% of relative abundance of bacteria or fungi. These results will provide the theoretical and scientific basis for the sustainable management and improvement of soil fertility of J. mandshurica plantation.