Domain-Specific Foundation-Model Customization: Theoretical Foundation and Key Technology
CSTR:
Author:
Affiliation:

1.Shenzhen Research Institute of Big Data, Shenzhen 518172, China;2.School of Science and Engineering, the Chinese University of Hong Kong (Shenzhen), Shenzhen 518172, China;3.China Academy of Information and Communications Technology, Beijing 100191, China;4.China Mobile Group Device Co. Ltd., Beijing 100033, China

Clc Number:

Fund Project:

  • Article
  • |
  • Figures
  • |
  • Metrics
  • |
  • Reference
  • |
  • Related
  • |
  • Cited by
  • |
  • Materials
  • |
  • Comments
    Abstract:

    As ChatGPT and other foundation-model-based products demonstrate powerful general performance, both academia and industry are actively exploring how to adapt these models to specific industries and application scenarios, a process known as the customization of domain-specific foundation models. However, the existing general-purpose foundation models may not fully accommodate the patterns of domain-specific data or fail to capture the unique needs of the field. Therefore, this paper aims to discuss the methodology for customizing domain-specific foundation models, including the definition and types of foundation models, the description of their general architecture, the theoretical foundations behind the effectiveness of foundation models, and several feasible methods for constructing domain-specific foundation models. By presenting this content, we hope to provide guidance and reference for researchers and practitioners in the customization of domain-specific foundation models.

    Reference
    Related
    Cited by
Get Citation

Chen Haolong, Chen Hanzhi, Han Kaifeng, Zhu Guangxu, Zhao Yichen, Du Ying. Domain-Specific Foundation-Model Customization: Theoretical Foundation and Key Technology[J].,2024,39(3):524-546.

Copy
Related Videos

Share
Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:April 09,2024
  • Revised:April 30,2024
  • Adopted:
  • Online: May 25,2024
  • Published:
Article QR Code