Application of BERT-Free Pre-Training Model in Identifying Power Safety Risk Points
Main Article Content
Abstract
In intelligent power systems operating under increasingly complex electromagnetic environments, accurate identification of safety risk points is essential for ensuring reliable equipment operation and supporting electromagnetic compatibility assessment. Traditional rule-based methods suffer from limited semantic understanding and poor generalization, making them insufficient for processing complex operation and maintenance texts. To address this issue, this paper proposes a lightweight CNN-based pre-training model built on a BERT-Free architecture for efficient and accurate power safety risk identification. A professional dataset containing 58,000 power operation and maintenance texts is constructed, and a high-quality multi-label corpus covering four categories and 17 subcategories is established through dictionary-enhanced word segmentation and expert cross-annotation. The model is exported in ONNX format to facilitate flexible deployment in engineering applications. Experimental results demonstrate that the proposed model achieves an overall accuracy of 89.1% and an F1-score of 87.3%. Under class imbalance, the F1-score reaches 0.901 for majority classes and 0.784 for minority classes, exhibiting strong robustness. The average inference time per sample is only 8.3 ms, indicating high computational efficiency. These results demonstrate that the proposed model provides an effective and practical solution for intelligent power safety risk identification while offering valuable support for electromagnetic infrastructure monitoring and reliable operation in modern power systems.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
References
N. D. Fîță, S. M. Radu, and D. Păsculescu, “The resilience of critical infrastructures within the national energy system in order to ensure energy and national security,” Bulletin of" Carol I" National Defence University, vol. 11, no. 2, pp. 57-67, 2022, doi: 10.53477/2284-9378-22-75.
A. Mohanty, A. K. Ramasamy, R. Verayiah, S. Bastia, S. S. Dash, E. Cuce, et al., “Power system resilience and strategies for a sustainable infrastructure: A review,” Alexandria Engineering Journal, vol. 105, pp. 261-279, 2024, doi: 10.1016/j.aej.2024.06.092.
J. J. Moreno Escobar, O. Morales Matamoros, R. Tejeida Padilla, I. Lina Reyes, and H. Quintana Espinosa, “A comprehensive review on smart grids: Challenges and opportunities,” Sensors, vol. 21, no. 21, pp. 6978, 2021, doi: 10.3390/s21216978.
M. Kiasari, M. Ghaffari, and H. H. Aly, “A comprehensive review of the current status of smart grid technologies for renewable energies integration and future trends: The role of machine learning and energy storage systems,” Energies, vol. 17, no. 16, pp. 4128, 2024, doi: 10.3390/en17164128.
S. Akhtar, M. Adeel, M. Iqbal, A. Namoun, A. Tufail, and K. H. Kim, “Deep learning methods utilization in electric power systems,” Energy Reports, vol. 10, pp. 2138-2151, 2023, doi: 10.1016/j.egyr.2023.09.028.
W. Weerakkody, B. Rathnayaka, and C. Siriwardana, “Identifying and Prioritizing Critical Risk Factors in the Context of a High-Voltage Power Transmission Line Construction Project: A Case Study from Sri Lanka,” CivilEng, vol. 5, no. 4, pp. 1057-1088, 2024, doi: 10.3390/civileng5040052.
Q. Liu, V. Hagenmeyer, and H. B. Keller, “A review of rule learning-based intrusion detection systems and their prospects in smart grids,” IEEE Access, vol. 9, pp. 57542-57564, 2021, doi: 10.1109/ACCESS.2021.3071263.
Z. Han, Y. Li, Z. Zhao, and B. Zhang, “An Online safety monitoring system of hydropower station based on expert system,” Energy Reports, vol. 8, pp. 1552-1567, 2022, doi: 10.1016/j.egyr.2022.02.040.
P. G. George and V. R. Renjith, “Evolution of safety and security risk assessment methodologies towards the use of bayesian networks in process industries,” Process Safety and Environmental Protection, vol. 149, pp. 758-775, 2021, doi: 10.1016/j.psep.2021.03.031.
A. M. Stankovi´c, K. L. Tomsovic, F. De Caro, M. Braun, J. H. Chow, N. ˇCukalevski, et al., “Methods for analysis and quantification of power system resilience,” IEEE Transactions on Power Systems, vol. 38, no. 5, pp. 4774-4787, 2022, doi: 10.1109/TPWRS.2022.3212688.
S. Zhang, Z. Zhu, and Y. Li, “A critical review of data-driven transient stability assessment of power systems: principles, prospects and challenges,” Energies, vol. 14, no. 21, pp. 7238, 2021, doi: 10.3390/en14217238.
S. Gao, R. Takanobu, A. Bosselut, and M. Huang, “End-to-end task-oriented dialog modeling with semistructured knowledge management,” IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. 30, pp. 2173-2187, 2022, doi: 10.1109/TASLP.2022.3153255.
Q. Li, J. Li, L. Wang, C. Ji, Y. Hei, J. Sheng, et al., “Type information utilized event detection via multi-channel gnns in electrical power systems,” ACM Transactions on the Web, vol. 17, no. 3, pp. 1-26, 2023, doi: 10.1145/3577031.
Y. Shu and Y. Dai, “An effective link prediction method for industrial knowledge graphs by incorporating entity description and neighborhood structure information,” The Journal of Supercomputing, vol. 80, no. 6, pp. 8297-8329, 2024, doi: 10.1007/s11227-023-05767-2.
J. Ortiz-Bejar, M. R. A. Paternina, A. Zamora-Mendez, L. Lugnani, and E. Tellez, “Power system coherency assessment by the affinity propagation algorithm and distance correlation,” Sustainable Energy, Grids and Networks, vol. 30, Art. no. 100658, 2022, doi: 10.1016/j.segan.2022.100658.
S. Liu, S. You, Z. Lin, C. Zeng, H. Li, W. Wang, et al., “Data-driven event identification in the US power systems based on 2D-OLPP and RUSBoosted trees,” IEEE Transactions on Power Systems, vol. 37, no. 1, pp. 94-105, 2021, doi: 10.1109/TPWRS.2021.3092037.
G. Wu and Y. Zheng, “The construction of Bert fusion model of speech recognition and sensing for South China electricity charge service scenario,” EURASIP Journal on Advances in Signal Processing, vol. 2023, no. 1, pp. 113, 2023, doi: 10.1186/s13634-023-01073-4.
X. Tong, B. Jin, J. Wang, Y. Yang, Q. Suo, and Y. Wu, “MM-ConvBERT-LMS: detecting malicious web pages via multimodal learning and pre-trained model,” Applied Sciences, vol. 13, no. 5, pp. 3327, 2023, doi: 10.3390/app13053327.
Z. Li, J. Yan, Y. Liu, W. Liu, L. Li, and H. Qu, “Power system transient voltage vulnerability assessment based on knowledge visualization of CNN,” International Journal of Electrical Power & Energy Systems, vol. 155, Art. no. 109576, 2024, doi: 10.1016/j.ijepes.2023.109576.
A. Quawi, Y. M. Shuaib, and M. Manikandan, “CNN based fault event classification and power quality enhancement in hybrid power system,” International Journal of Power Electronics and Drive Systems (IJPEDS), vol. 15, no. 3, pp. 1851-1870, 2024, doi: 10.11591/ijpeds.v15.i3.pp1851-1870.