Abstract: The production of various industrial by-products in the form of gypsum residues increases annually with the acceleration of industrialization. China, as a large agricultural and non-ferrous metal smelting country, produces a large amount of solid waste with CaSO₄·2H₂O as the main component in both phosphate fertilizer production and dirty acid neutralization. These gypsum residues occupy a large amount of land resources and are responsible for heavy-metal leakage, the release of toxic gases, and other safety hazards. Thus, accelerating the comprehensive utilization of these two types of gypsum residues is not only directly in line with the strategic layout for the construction of a “Waste-Free City” and the “Double Carbon” goal, but would also significantly contribute to resource recycling and ecological environmental protection. At present, phosphogypsum has a wide range of applications in the fields of construction, the chemical industry, and agriculture, and is widely used in the preparation of cement retarders, quicklime, road base materials, soil conditioners, and so on. However, its comprehensive utilization rate is only approximately 40%, and there are still large phosphogypsum stockpiles. It is crucial to expand the market demand for phosphogypsum applications, and the key lies in the efficient removal of its impurities. On the other hand, the gypsum residue produced by acidic wastewater neutralization is difficult to handle because of the presence of toxic elements such as arsenic, cadmium, and lead. Thus, at present, its disposal primarily consists of the recovery of valuable metals and solidification/stabilization. However, because of the complex composition and low content of these valuable metals, the economic benefits of recovery are insufficient and it is difficult to realize industrialization. This paper presents a framework for comparing phosphogypsum and acidic wastewater neutralization gypsum residues for the first time, systematically discusses their current utilization and disposal methods, and thoroughly explores the resource-utilization mechanisms of different production systems, along with the fixation mechanisms for heavy metals and other pollutants. Finally, some suggestions and future prospects are outlined based on this review. Efforts should be made to research and develop highly efficient and low-cost technologies to stabilize the soluble phosphorus and fluorine in phosphogypsum to ensure that its leachate meets the requirements for surface water class V and above, while simultaneously exploring the development of emerging fields such as gypsum whisker preparation and the synthesis of new chemical raw materials, with the goal of expanding the scale of the high-value utilization of phosphogypsum and realizing large-scale phosphogypsum elimination. The following future development steps for tainted acid gypsum residues are proposed: 1) continue to develop green and efficient valuable metal element recovery technology, and achieve large-scale industrial application; 2) strengthen the exploration of synergistic use technology between tainted acid gypsum residues and other solid wastes, and synergistically treat gypsum slag with other solid wastes in combination with other methods such as flotation to improve resource utilization; 3) optimize the application of efficient complexing and precipitating agents to reduce gypsum production and its pollutant content at the source through acidic wastewater treatment process regulation; and 4) increase the attention given to studies of the longevity of a gypsum slag curing body to prevent the occurrence of an “anti-solution” and other problems.