Application of AI Technology in Art Concept Map Based on Intelligent Information Technology
Main Article Content
Abstract
This study presents a dual-path collaborative generation framework for art concept maps based on multimodal inputs, including textual descriptions, hand-drawn sketches, and style reference images. The system integrates a precise control flow, leveraging ControlNet for structural and semantic alignment, with a creative inspiration flow guided by a style memory module to enhance artistic expression. Both streams are adaptively fused via a gated network, enabling dynamic weighting across spatial regions and generation stages. Experimental validation on a curated high-resolution concept art dataset demonstrates that the proposed framework achieves a Fréchet Inception Distance (FID) of 18.73 and a CLIP score of 0.321, outperforming baseline models including Stable Diffusion + ControlNet (FID 24.80, CLIP 0.293), Midjourney (FID 20.10), and LoRA-based variants (FID 23.50). Subjective evaluation by 150 professional concept artists confirms superior semantic accuracy, structural controllability, and stylistic consistency. By interpreting the dual-path framework as a multi-node signal acquisition and propagation system with dynamic fusion control, the study provides an engineering-oriented methodology for multimodal information fusion, precision guidance, and high-fidelity generation of structured visual content.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
References
M. Engler and A. Trnka, “Fundamental Knowledge behind Creation of Concept Art,” Eur. J. Media, Art Photogr, vol. 9, no. 2, pp. 106-115, 2021.
Z. Epstein, A. Hertzmann, L. Herman, R. Mahari, R. Frank, M. Groh, et al., “Art and the science of generative AI,” Science, vol. 380, no. 6650, pp. 1110-1111, 2023, doi: 10.1126/science.adh4451.
I. O. Adeleye, “The impact of artificial intelligence on design: Enhancing creativity and efficiency,” Journal of Engineering and Applied Sciences, vol. 3, no. 1, pp. 1-13, 2024, doi: 10.70560/vvsfej12.
Y. Wei and Z. Zhao, “Integration effect of artificial intelligence and traditional animation creation technology,” Journal of Intelligent Systems, vol. 33, no. 1, pp. 20230305-20230305, 2024, doi: 10.1515/jisys-2023-0305.
T. Chandrasekera, Z. Hosseini, and U. Perera, “Can artificial intelligence support creativity in early design processes?,” International journal of architectural computing, vol. 23, no. 1, pp. 122-136, 2025, doi: 10.1177/14780771241254637.
K. O’Toole, E. A. Horvat, “Extending human creativity with AI,” Journal of Creativity, vol. 34, no. 2, pp.100080-100080, 2024, doi: 10.1016/j.yjoc.2024.100080.
N. Dehouche and K. Dehouche, “What’s in a text-to-image prompt? The potential of stable diffusion in visual arts education,” Heliyon, vol. 9, no. 6, Art. no. e16757-e16757, 2023, doi: 10.1016/j.heliyon.2023.e16757.
V. Paananen, J. Oppenlaender, and A. Visuri, “Using text-to-image generation for architectural design ideation,” International Journal of Architectural Computing, vol. 22, no. 3, pp. 458-474, 2024, doi: 10.48550/arXiv.2304.10182.
S. Lee, M. Law, and G. Hoffman, “When and how to use AI in the design process? Implications for human-AI design collaboration,” International Journal of Human–Computer Interaction, vol. 41, no. 2, pp. 1569-1584, 2025, doi: 10.1080/10447318.2024.2353451.
Y. Jin, J. Yoon, J. Self, and K. Lee, “Understanding Fashion Designers’ Behavior Using Generative AI for Early-Stage Concept Ideation and Revision,” Archives of Design Research, vol. 37, no. 3, pp. 25-45, 2024, doi: 10.15187/adr.2024.07.37.3.25.
A. Aggarwal, M. Mittal, and G. Battineni, “Generative adversarial network: An overview of theory and applications,” International Journal of Information Management Data Insights, vol. 1, no. 1, pp. 100004-100004, 2021, doi: 10.1016/j.jjimei.2020.100004.
H. W. L. Mak, R. Han, and H. H. F. Yin, “Application of variational autoEncoder (VAE) model and image processing approaches in game design,” Sensors, vol. 23, no. 7, pp. 3457-3457, 2023, doi: 10.3390/s23073457.
B. Y. Archana, “An analysis on the use of image design with generative AI technologies,” International Journal of Trend in Scientific Research and Development, vol. 8, no. 1, pp. 596-599, 2024.
H. Li, L. Wang, and J. Liu, “A review of deep learning-based image style transfer research,” The Imaging Science Journal, vol. 73, no. 4, pp. 504-526, 2025, doi: 10.1080/13682199.2024.2418216.
M. D. M. Reddy, M. S. M. Basha, M. M. C. Hari, et al., “Dall-e: Creating images from text,” UGC Care Group I Journal, vol. 8, no. 14, pp. 71-75, 2021.
L. Tan and M. Luhrs, “Using Generative AI Midjourney to enhance divergent and convergent thinking in an architect’s creative design process,” The Design Journal, vol. 27, no. 4, pp. 677-699, 2024, doi: 10.1080/14606925.2024.2353479.
C. Zou and Y. Chen, “A Study of Controllability Paths for Generative AI Design Based on Stable Diffusion ControlNet,” International Journal for Housing Science and Its Applications, vol. 46, no. 3, pp. 2321-2332, 2025, doi: 10.70517/ijhsa463194.
Y. Chen and H. Ruan, “Deep Analogical Generative Design and Evaluation: Integration of Stable Diffusion and LoRA,” Journal of Mechanical Design, vol. 147, no. 5, pp. 051403-051403, 2025, doi: 10.1115/1.4066861.
D. Choi, J. Im, and Y. Sung, “LoRA Fusion: Enhancing Image Generation,” Mathematics, vol. 12, no. 22, pp. 3474-3474, 2024, doi: 10.3390/math12223474.
C. Shen, S. Luo, L. Fan, and C. Dai, “Leveraging AI and diffusion models for anime art creation: A study on style transfer and image quality evaluation,” Computer Science and Information Systems, vol. 22, no. 3, pp. 1331-1346, 2025, doi: 10.2298/csis241212045s.
G. Liu, H. Du, D. Niyato, J. Kang, Z. Xiong, D. I. Kim, et al., “Semantic communications for artificial intelligence generated content (AIGC) toward effective content creation,” IEEE Network, vol. 38, no. 5, pp. 295-303, 2024, doi: 10.48550/arXiv.2308.04942.
Y. Lou, “Human creativity in the AIGC era,” She Ji: The Journal of Design, Economics, and Innovation, vol. 9, no. 4, pp. 541-552, 2023, doi: 10.1016/j.sheji.2024.02.002.
Y. Sun, D. Sheng, Z. Zhou, and Y. Wu, “AI hallucination: towards a comprehensive classification of distorted information in artificial intelligence-generated content,” Humanities and Social Sciences Communications, vol. 11, no. 1, pp. 1-14, 2024, doi: 10.1057/s41599-024-03811-x.
C. Jiang, R. Huang, and T. Shen, “Generative AI-Enabled Conceptualization: Charting ChatGPT’s Impacts on Sustainable Service Design Thinking With Network-Based Cognitive Maps,” Journal of Computing and Information Science in Engineering, vol. 25, no. 2, pp. 021006-021006, 2025, doi: 10.1115/1.4067211.
H. U. Zi-Yang, “AIGC related context: A new communication culture for human,” Journal of Literature and Art Studies, vol. 14, no. 10, pp. 921-931, 2024, doi: 10.17265/2159-5836/2024.10.016.
L. Abrusci, K. Dabaghi, S. D’Urso, and F. Sciarrone, “AI4Design: A generative AI-based system to improve creativity in design–A field evaluation,” Computers and Education: Artificial Intelligence, vol. 8, no. 1, pp. 100401-100401, 2025, doi: 10.1016/j.caeai.2025.100401.
F. Jiang, C. Tang, L. Dong, K. Wang, K. Yang, and C. Pan, “Visual Language Model-Based Cross-Modal Semantic Communication Systems,” IEEE Transactions on Wireless Communications, vol. 24, no. 5, pp. 3937-3948, 2025, doi: 10.1109/TWC.2025.3539526.
Y. Alaluf, E. Richardson, G. Metzer, and D. Cohen-Or, “A neural space-time representation for text-to-image personalization,” ACM Transactions on Graphics (TOG), vol. 42, no. 6, pp. 1-10, 2023, doi: 10.48550/arXiv.2305.15391.
N. Manakitsa, G. S. Maraslidis, L. Moysis, Fragulis, and GF, “A review of machine learning and deep learning for object detection, semantic segmentation, and human action recognition in machine and robotic vision,” Technologies, vol. 12, no. 2, pp. 15, 2024, doi: 10.3390/technologies12020015.
D. Chen, L. Yuan, J. Liao, N. Yu, and G. Hua, “Explicit Filterbank Learning for Neural Image Style Transfer and Image Processing,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 43, no. 7, pp. 2373-2387, 2021, doi: 10.1109/tpami.2020.2964205.
K. Hu, Z. Wang, K. A. E. Martens, M. Hagenbuchner, M. Bennamoun, and A. C. Tsoi, “Graph fusion network-based multimodal learning for freezing of gait detection,” IEEE Transactions on Neural Networks and Learning Systems, vol. 34, no. 3, pp. 1588-1600, 2021, doi: 10.1109/TNNLS.2021.3105602.
L. G. Foo, H. Rahmani, and J. Liu, “Ai-generated content (aigc) for various data modalities: A survey,” ACM Computing Surveys, vol. 57, no. 9, pp. 1-66, 2025, doi: 10.48550/arXiv.2308.14177.
A. W. Sukkar, M. W. Fareed, M. W. Yahia, S. B. Abdalla, I. Ibrahim, and K. A. K. Senjab, “Analytical evaluation of Midjourney architectural virtual lab: Defining major current limits in AI-generated representations of Islamic architectural heritage,” Buildings, vol. 14, no. 3, pp. 786-786, 2024, doi: 10.3390/buildings14030786.
G. Buzzaccarini, R. S. Degliuomini, M. Borin, A. Fidanza, N. Salmeri, L. Schiraldi, et al., “The promise and pitfalls of AI-generated anatomical images: evaluating midjourney for aesthetic surgery applications,” Aesthetic plastic surgery, vol. 48, no. 9, pp. 1874-1883, 2024, doi: 10.1007/s00266-023-03826-w.
E. J. Hu, Y. Shen, P. Wallis, Z. Allen-Zhu, Y. Li, S. Wang, et al., “Lora: Low-rank adaptation of large language models,” ICLR, vol. 1, no. 2, pp. 3-3, 2022, doi: 10.48550/arXiv.2106.09685.