中图分类号：TP391.1文献标识码：ADOI:10.19358/j.issn.2097-1788.2025.11.004引用格式：宋元，张衎，任熠辉，等. 一种针对垂类模型的综合成效评测框架［J］.网络安全与数据治理，2025，44（11）：18-23,29.

A comprehensive effectiveness evaluation framework for domain-specific models

Abstract： This paper addresses the issues of single evaluation dimensions, lack of domain adaptability, and fragmented methods in the evaluation practice of domain-specific models, and proposes a comprehensive effectiveness evaluation framework. This study aims to address the "evaluation gap" between technology research and development and industrial application through standardized solutions, providing a scientific basis for the development, deployment, and supervision of domain-specific models. The research method includes constructing a multidimensional indicator system centered on security compliance, technical performance, and application value, and designing a supporting evaluation dataset construction strategy and a hybrid evaluation method. The latter integrates automated testing, manual evaluation, and large models as evaluation means. The research results form a structured evaluation system that covers the classification of evaluation objects, indicator definition, and method implementation, which can achieve a comprehensive and comparable evaluation of different types of domain-specific models. The conclusion shows that the framework helps to improve the objectivity and operability of the evaluation and promote the trustworthy application of domain-specific models in key areas. In the future, it will need to be verified in practice and dynamically optimized to adapt to technological development.

Key words : artificial intelligence; domainspecific model; model evaluation