In this study, two open-pit coal mine dumps in Ordos City, Inner Mongolia, namely, Shigetai and Heidaigou, were selected as research subjects. Soil physicochemical properties, structure, heavy metal pollution (assessed using a single-factor evaluation index), and their interrelationships were analyzed at each dumping site along eight directions: east, west, south, north, northeast, northwest, southeast, and southwest. The aim of this study was to elucidate the factors influencing heavy metal contamination in open-pit coal mine dumps. The results of this study can guide the selection of ecological remediation measures for mining areas based on local conditions. The results showed that: (1) There were considerable differences in soil physicochemical properties, structure, and heavy metal contamination between the Shigetai and Heidaigou mining areas. (2) Soil total phosphorus varied considerably among the different orientations in Shigetai, whereas there was a considerable difference in soil total potassium among the different orientations in Heidaigou. (3) Heavy Cd pollution was observed, and there was slight Mn pollution in Shigetai. In Heidaigou, there was heavy Cd pollution and slight Cu and Ni pollution. (4) While there was a considerable difference in the level of Cd pollution along the different directions in Shigetai, the level of Mn pollution showed no correlation with direction. There was a considerable difference in Ni pollution levels among the different orientations in Heidaigou, whereas Cd and Cu pollution levels were not related to orientation. (5) The trends in the Cd pollution levels in Shigetai and Ni in Heidaigou along the different directions were generally consistent with the changes in their topography. In other words, areas with lower topography experienced more severe heavy metal pollution. (6) Correlation analysis revealed that the level of heavy metal contamination was strongly associated with soil pH, total K content, and the proportion of large-sized soil particles. In conclusion, varying levels of heavy metal pollution were observed in the different mining dumps. Significant correlations were observed between three soil environmental factors, namely, the topography of the dump, soil fertility, soil structure, and the level of soil heavy metal pollution.