Service-oriented EPICS and data processing method based on high-availability cluster
-
摘要: 提出了一种基于Proxmox VE平台搭建的高可用Kubernetes集群下的新型服务化EPICS与新型前端数据获取方式,以提高数据采集系统的性能和稳定性。通过将EPICS服务化部署在Kubernetes集群上,实现了全新高效的前端数据处理及获取方式。数据获取方式利用基于Channel Access协议的分布式数据共享,对数据进行实时处理和分析。该方法具有降低硬件和维护成本、提高可移植性和灵活性、提高数据采集和处理效率等优势。实际应用和测试表明,该方法具有在大型科学设施中应用的潜力,未来将探索其在其他领域的应用价值。
-
关键词:
- EPICS /
- Docker容器 /
- Kubernetes集群 /
- 数据处理 /
- 分布式系统
Abstract: A novel service-based EPICS and new front-end data acquisition method based on a high-availability Kubernetes cluster built on the Proxmox VE platform is proposed in this paper to enhance the performance and stability of the data acquisition system. By deploying EPICS services on the Kubernetes cluster, a new efficient front-end data processing and acquisition method is realized. The data acquisition method utilizes distributed data sharing based on the Channel Access protocol to perform real-time processing and analysis of data. This approach offers advantages such as reducing hardware and maintenance costs, improving portability and flexibility, and enhancing data acquisition and processing efficiency. The practical application and testing have demonstrated that this method has the potential for use in large scientific facilities. In the future, its application value in other fields will be explored.-
Key words:
- EPICS /
- Docker container /
- Kubernetes cluster /
- data processing /
- distributed system
-
表 1 Kubernetes集群状况
Table 1. Kubernetes cluster configuration
node node IP node role deployed services k8s-master 192.168.0.117 Master/ETCD — k8s-node1 192.168.0.118 Worker/ETCD Phoebus desktop k8s-node2 192.168.0.119 Worker/ETCD Archiver appliance -
[1] Voirin R, Oulevey T, Vanden Eynden M. The state of containerization in CERN accelerator controls[C]//18th International Conference on Accelerator and Large Experimental Physics Control Systems. 2021: 829-834. [2] 李宇鲲, 曹建社, 杜垚垚, 等. 基于虚拟化平台的EPICS容器数据获取及处理方式[C]//中国核学会. 中国核科学技术进展报告(第八卷)论文集. 2023: 6Li Yukun, Cao Jianshe, Du Yaoyao, et al. Data acquisition and processing method for EPICS container based on virtualization platform[C]//Chinese Nuclear Society. Progress Report on China Nuclear Science & Technology (vol. 8). 2023: 6 [3] Zhang Weiguo, Ma Xilin, Zhang Jinzhong. Research on Kubernetes’ resource scheduling scheme[C]//Proceedings of the 8th International Conference on Communication and Network Security. 2018: 144-148. [4] Alshuqayran N, Ali N, Evans R. A systematic mapping study in microservice architecture[C]//2016 IEEE 9th International Conference on Service-oriented Computing and Applications (SOCA). 2016: 44-51. [5] Endo P T, Rodrigues M, Gonçalves G E, et al. High availability in clouds: systematic review and research challenges[J]. Journal of Cloud Computing, 2016, 5: 16. doi: 10.1186/s13677-016-0066-8 [6] Kovari A, Dukan P. KVM & OpenVZ virtualization based IaaS open source cloud virtualization platforms: OpenNode, Proxmox VE[C]//2012 IEEE 10th Jubilee International Symposium on Intelligent Systems and Informatics. 2012: 335-339. [7] Wijayanto D, Firdonsyah A, Adhinata F D, et al. Rancang bangung private server menggunakan platform Proxmox dengan studi kasus: PT. MKNT[J]. Journal ICTEE, 2021, 2(2): 41-49. doi: 10.33365/jictee.v2i2.1333 [8] Hardikar S, Ahirwar P, Rajan S. Containerization: cloud computing based inspiration technology for adoption through Docker and Kubernetes[C]//2021 Second International Conference on Electronics and Sustainable Communication Systems (ICESC). 2021: 1996-2003. [9] Arredondo I, Jugo J. Containerized control structure for accelerators[C]//Proceedings of the 16th International Conference on Accelerator and Large Experimental Control Systems. 2017: 816-821. [10] Wang R, Guo Y H, Wang B J, et al. The deployment technology of EPICS application software based on Docker[C]//Proceedings of the 18th International Conference on Accelerator and Large Experimental Physics Control Systems. 2021: 197-201. [11] Wang R, Guo Y H, Xie N, et al. A new deployment method of the archiver application with Kubernetes for the CAFe facility[J]. Radiation Detection Technology and Methods, 2022, 6(4): 508-518. doi: 10.1007/s41605-022-00356-y -