The existing aggregated regulation methods neglect the differentiated spatio-temporal regulation demand of user-side resources, and cannot use the complementary characteristics of multiple types of energy to achieve the power supply and demand balance in the integrated energy system. Consequently, it leads to low efficiency and high cost of aggregation regulation. To address the above issues, this paper first considers the difference of regulation timescale of power and heat resource participation in demand response of integrated energy system. On this basis, this paper constructs a user-side resources spatio-temporal collaboration aggregation regulation model. Secondly, a multi-time scale aggregated regulation and optimization problem of user-side resources is constructed. Specificity, the optimization objective of the long timescale is the cost of heat energy regulation and carbon emission of the integrated energy system, and the short timescale is the cost of electric energy regulation and regulation delay deviation. Correspondingly, a spatio-temporal collaboration aggregation regulation optimization method based on improved particle swarm and multi-agent soft actor-critic (MASAC) is proposed to solve the problem. Finally, the proposed algorithm is verified by simulation. The simulation results show that the proposed algorithm can effectively improve the efficiency of user-side resources spatio-temporal collaboration aggregation regulation and reduce the regulation cost.