Using the Stable Diffusion Model to Achieve Ink Painting Style Transfer and Contemporary Art Re-Creation
Main Article Content
Abstract
Chinese ink painting is regarded as a jewel of Eastern art, with its aesthetic of “living” and the “integration of form and spirit” manifested through techniques of hooking, kneading, and leaving blank. Existing artificial intelligence (AI) methods often reproduce visual forms while failing to preserve intrinsic artistic expression. To address this limitation, this paper proposes a hierarchical style transfer framework based on Stable Diffusion that aligns abstract aesthetic concepts such as the balance between emptiness and reality through CLIP, while LoRA fine-tuning and ControlNet preserve structural consistency and enhance expressive flexibility under ink-edge constraints. Considering the growing importance of intelligent visual information processing in electromagnetic sensing and multimodal communication systems, the proposed framework also provides a reference for interpretable semantic representation and digital cultural information transmission. Experimental results demonstrate improved structural fidelity (SSIM 0.78) and wellcontrolled blank-space distribution (28.5%). The framework not only facilitates digital artistic creation but also contributes to the preservation and revitalization of traditional crafts, including weaving and dyeing, through explainable AI technologies with potential value for cross-domain intelligent information processing.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
References
J. Zhang, J. Yu, Y. Miao, and R. Peng, “Self-Adaptive Computational Aesthetic Evaluation of Chinese Ink Paintings Based on Deep Learning,” Journal of Computer-Aided Design & Computer Graphics, vol. 33, no. 9, pp. 1349-1360, 2021, doi: 10.3724/SP.J.1089.2021.18815.
X. Y. Zhang, “The Analysis of the Graphic Creation Teams of Digital Ink in Chinese Universities and Colleges in the Past Twenty Years,” Journal of Education and Teaching, vol. 6, no. 2, pp. 15-35, 2024, doi: 10.6994/JET.202412_6(2).0002.
B. Liu, “GAN-Based Scene Text Artistic Style Transfer,” Computer & Digital Engineering, vol. 52, no. 5, pp. 1523-1528, 2024.
C. Y. Chung and S. H. Huang, “Interactively transforming Chinese ink paintings into realistic images using a border enhance generative adversarial network,” Multimedia Tools and Applications, vol. 82, no. 8, pp. 11663-11696, 2023, doi: 10.1007/s11042-022-13684-4.
K. Yu, Y. Wang, S. Zeng, C. Liang, X. Bai, D. Chen, et al., “InkGAN: Generative Adversarial Networks for Ink-And-Wash Style Transfer of Photographs,” Advances in Artificial Intelligence and Machine Learning, vol. 3, no. 2, pp. 1220-1233, 2023, doi: 10.54364/aaiml.2023.1171.
X. Peng, S. Peng, Q. Hu, J. Peng, J. Wang, X. Liu, et al., “Contour-enhanced CycleGAN framework for style transfer from scenery photos to Chinese landscape paintings,” Neural Computing and Applications, vol. 34, no. 20, pp. 18075-18096, 2022, doi: 10.1007/s00521-022-07432-w.
F. Fu, J. Lv, C. Tang, and M. Li, “Multi-style Chinese art painting generation of flowers,” IET Image Processing, vol. 15, no. 3, pp. 746-762, 2021, doi: 10.1049/ipr2.12059.
M. Wang, Y. Shao, and H. Liu, “APST-Flow: A Reversible Network-Based Artistic Painting Style Transfer Method,” Computers, Materials and Continua, vol. 75, no. 3, pp. 5229-5254, 2023, doi: 10.32604/cmc.2023.036631.
X. C. Liu, Y. C. Wu, and P. Hall, “Painterly style transfer with learned brush strokes,” IEEE Transactions on Visualization and Computer Graphics, vol. 30, no. 9, pp. 6309-6320, 2023, doi: 10.1109/TVCG.2023.3332950.
X. Shi, X. Y. Hu, Y. H. Huang, R. Yang, and F. Z. Zhu, “Art Painting Image Style Transfer Based on Stroke and Contour Constraints,” Journal of Chaohu University, vol. 25, no. 6, pp. 101-110+128, 2024.
J. Y. Zeng and X. P. Shen, “Application and Research on Virtual Human Image Pre-design Based on Stable Diffusion,” Modern Information Technology, vol. 8, no. 3, pp. 169-175, 2024, doi: 10.19850/j.cnki.2096-4706.2024.03.036.
S. S. Li, “Application of AI Painting in Art Creation–Taking Stable Diffusion as an Example,” Modern Information Technology, vol. 8, no. 8, pp. 133-137, 2024, doi: 10.19850/j.cnki.2096-4706.2024.08.029.
A. Rahmatulloh, “Custom concept text-to-image using stable diffusion Model in generative artificial intelligence,” JICO: International Journal of Informatics and Computing, vol. 1, no. 1, pp. 1-11, 2025, [Online]. Available: https://iaico.org/index.php/JICO/article/view/2.
S. H. Lee and K. S. Song, “Exploring the possibility of using ChatGPT and Stable Diffusion as a tool to recommend picture materials for teaching and learning,” Journal of the Korea Society of Computer and Information, vol. 28, no. 4, pp. 209-216, 2023, doi: 10.9708/jksci.2023.28.04.209.
S. L. Liu and L. Y. Yang, “AI Drawing Helps the Development of 3D Design: Taking Stable Diffusion as an Example,” Journal of Kunming Metallurgy College, vol. 41, no. 1, pp. 61-69, 2025, doi: 10.3969/j.issn.1009-0479.2025.01.009.
R. Xia, Y. Y. Chang, P. F. Li, and X. Z. Wei, “Research on cultural graph technology based on Stable Diffusion and its application in multiple scenarios,” Journal of Zhoukou Normal University, vol. 42, no. 2, pp. 50-54, 2025, doi: 10.13450/j.cnki.jzknu.2025.02.009.
Y. C. Dou, “Research on UI design optimization based on Stable Diffusion,” Science and Technology Vision, vol. 14, no. 35, pp. 61-64, 2024, doi: 10.3969/j.issn.2095-2457.2024.35.017.
Y. R. Li, “On the Impact of Stable Diffusion Algorithm on the Illustration Market and Aesthetic Environment,” Art Science and Technology, vol. 36, no. 15, pp. 244-246, 2023, doi: 10.3969/j.issn.1004-9436.2023.15.080.
P. Gao, S. Geng, R. Zhang, T. Ma, R. Fang, Y. Zhang, et al., “Clip-adapter: Better vision-language models with feature adapters,” International Journal of Computer Vision, vol. 132, no. 2, pp. 581-595, 2024, doi: 10.1007/s11263-023-01891-x.
P. Shieh, M. R. Hill, W. Zhang, S. L. Kristufek, and J. A. Johnson, “Clip chemistry: Diverse (bio)(macro) molecular and material function through breaking covalent bonds,” Chemical Reviews, vol. 121, no. 12, pp. 7059-7121, 2021, doi: 10.1021/acs.chemrev.0c01282.
S. A. Abdullah and A. K. Jumaat, “Selective image segmentation models using three distance functions,” Journal of Information and Communication Technology, vol. 21, no. 1, pp. 95-116, 2022, doi: 10.32890/jict2022.21.1.5.
L. Khrissi, N. El Akkad, H. Satori, and K. Satori, “Clustering method and sine cosine algorithm for image segmentation,” Evolutionary Intelligence, vol. 15, no. 1, pp. 669-682, 2022, doi: 10.1007/s12065-020-00544-z.
X. Y. Liu, R. Zhu, D. Zha, J. Gao, S. Zhong, M. White, et al., “Differentially private low-rank adaptation of large language model using federated learning,” ACM Transactions on Management Information Systems, vol. 16, no. 2, pp. 1-24, 2025, doi: 10.1145/3682068.
F. Wu, C. Zhu, J. Xu, M. W. Bhatt, and A. Sharma, “Research on image text recognition based on canny edge detection algorithm and k-means algorithm,” International Journal of System Assurance Engineering and Management, vol. 13, no. Suppl 1, pp. 72-80, 2022, doi: 10.1007/s13198-021-01262-0.
L. I. Mochurad, “Canny edge detection analysis based on parallel algorithm, constructed complexity scale and CUDA,” Computing and Informatics, vol. 41, no. 4, pp. 957–980, 2022, doi: 10.31577/cai_2022_4_957.
Z. Xie and S. Song, “FedKL: Tackling data heterogeneity in federated reinforcement learning by penalizing KL divergence,” IEEE Journal on Selected Areas in Communications, vol. 41, no. 4, pp. 1227-1242, 2023, doi: 10.1109/JSAC.2023.3242734.
M. Al-Jarrah, E. Alsusa, and C. Masouros, “A unified performance framework for integrated sensing-communications based on KL-divergence,” IEEE Transactions on Wireless Communications, vol. 22, no. 12, pp. 9390-9411, 2023, doi: 10.1109/TWC.2023.3270390.
X. Yang, “Image-to-Image Search Method Based on CLIP Model,” Computer Science and Application, vol. 15, no. 1, pp. 177-186, 2025, doi: 10.12677/csa.2025.151018.
L. Cheng, R. Xiong, J. Wu, X. Yan, C. Yang, Y. Zhang, et al., “Fast segmentation algorithm of USV accessible area based on attention fast DeepLabV3,” IEEE Sensors Journal, vol. 24, no. 15, pp. 24168-24177, 2024, doi: 10.1109/JSEN.2024.3410403.