With the development of energy Internet and integrated energy services, it is very important to promote the construction of remote automatic collection and transcription of water, gas, heat and electricity. Based on the electrical information collection system, this paper designs a collection technology framework for the integration of electric, water, gas and thermal energy measurement, and defines the technical route of the energy measurement system. Then, by analyzing the collection task category of the system, a multi task and adaptive real-time scheduling method based on Spark cluster is proposed, which solves the problem that the acquisition system is based on the unequal assignment of task allocation in the existing scheduling mechanism of the Spark cluster, the longer task completion time and the higher priority of the task, resulting in the poor user experience. Finally, the experimental results show that the total number of 2 million collection tasks is divided into six classes, and the comparison between this method and the Spark default scheduling method is made. This method has better response speed and better response speed, which can greatly improve the user experience of the system.
