The shortage of water resources is a constraint factor for sustainable economic and social development in Anhui Province, and the improvement in utilization efficiency of water resources is the key solution. The complete decomposition model was used to measure the shares of technological progress and structural change factors in per unit GDP water consumption of Anhui Province. The results show that: (1) during 2001-2014, technological progress led to per unit GDP water consumption with annual average decline of 31.91 m3 in Anhui Province, which is a key factor in increasing the utilization efficiency of water resources with the contribution rate as high as 88.69%, and those of three industrial technological progresses are 45.19%, 38.59% and 4.91% respectively; (2) the adjustment of industrial structure has a contribution rate of 11.31% in per unit GDP water utilization intensity of Anhui Province, and those of three industry changes are -4.98%, 0.62% and 15.66% respectively. The core of improving the utilization efficiency of water resources in Anhui Province is to rely on scientific and technological innovation to promote the technological levels of the primary and secondary industries, adjust and optimize industrial structure, and vigorously improve the proportion of the tertiary industry. The research results can provide decision-making references for policy formulation of water resources utilization