The shallow groundwater that exists in the loess is the basic and precious source of water to the people who live in the Loess Plateau. But there are little scholars who studied hydrochemical characteristics of the groundwater there. The west Liupan Mountain is the model loess hilly-gully area. The Liupan Mount Liupan area and the model loess hilly-gully area were taken as the crucial study areas in this paper. We studied the hydrochemical property and origin of groundwater by making some field visits, monitoring and sampling through several years. We chose 29 sampling sites and collected 58 samples including 26 spring water samples, 26 well water samples, 5 river water samples and 1 reservoir water sample. The shallow groundwater which exists in the Liupan Mountain area has a low TDS and a high number of bicarbonate ions, so the groundwater has a short flow route and a good circulation condition, and this area keeps a natural state of freshwater resources. There are many different hydrochemical types of the groundwater in the model loess hilly-gully area, and the average TDS of the groundwater is 1870mg/L. Rock weathering is an influencing factor on the shallow groundwater and river water, specially in the loess hilly-gully area. Evaporation is another crucial influencing factor. The Liupan Mountain area is both a recharge area and runoff area, and the model loess hilly-gully area is not only a recharge area but also a runoff area and runoff -stay area. The loess groundwater is likely to accept the Liupan Mountain karst water. The calcite and dolomite saturation index of the groundwater stay the equilibrium state or supersaturated state, and there is hardly any water in the unsaturated state. The fluorine ion concentration and hardness exceed permissible standard that are most fearful factors to water quality. In the areas that have a strong impact on evaporation, the problems about exceeded permissible standard stand out. The distribution and quality of the groundwater are different in various parts of the Loess Plateau. The valuable and high quality fresh groundwater resource should be protected well, reasonably developed and utilized in macroeconomic regulation and control, which is the key to alleviate the shortage of water resources in the Loess Plateau.