期刊导航

论文摘要

AdaBoost算法的推广——一组集成学习算法

Ensemble Learning Algorithms: Generalization of AdaBoost

作者:付忠良(中国科学院成都计算机应用研究所);赵向辉(中国科学院成都计算机应用研究所);苗青(中国科学院成都计算机应用研究所);姚宇(中国科学院成都计算机应用研究所)

Author:Fu Zhong-Liang(Chengdu Institute of Computer Applications, Chinese Academy of Sciences.);Zhao Xiang-Hui(Chengdu Institute of Computer Applications, Chinese Academy of Sciences.);Miao Qing();Yao Yu()

收稿日期:2010-02-01          年卷(期)页码:2010,42(6):91-98

期刊名称:工程科学与技术

Journal Name:Advanced Engineering Sciences

关键字:集成学习;AdaBoost;分类器组合;弱学习定理

Key words:ensemble learning; AdaBoost; classification combination; weak learning theorem

基金项目:国家高技术研究发展计划(863)项目资助(No.2008AAO1Z402);四川省科技支撑计划项目资助(No.2007Z01-024,No.2009SZ0214)。

中文摘要

针对AdaBoost算法只适合于不稳定学习算法这一不足,基于增加新分类器总是希望降低集成分类器训练错误率这一思想,提出了利用样本权值来调整样本类中心的方法,使AdaBoost算法可以与一些稳定的学习算法结合成新的集成学习算法,如动态调整样本属性中心的集成学习算法、基于加权距离度量分类的集成学习算法和动态组合样本属性的集成学习算法,大大拓展了AdaBoost算法适用范围。针对AdaBoost算法的组合系数和样本权值调整策略是间接实现降低训练错误率目标,提出了直接面向目标的集成学习算法。在UCI数据上的实验与分析表明,提出的AdaBoost推广算法不仅有效,而且部分算法比AdaBoost算法效果更好。

英文摘要

Aiming at conquering the insufficiency that AdaBoost algorithm is only suitable to the unstable learning algorithm, the method of adjusting sample center with its weight was given based on the idea that adding new classifiers is always to reduce the training error of the ensemble classifier. By this method, AdaBoost algorithm could be generalized to be several new ensemble learning methods by combining some stable learning algorithms, such as the one of dynamically adjusting the centers of sample attributes, the one of classifying by weighted distance measurement, and the one of dynamically combining sample attributes. Therefore, the application scope of AdaBoost algorithm was greatly expanded. Different from that the combination coefficients and the adjustment strategy of sample weights in AdaBoost algorithm are indirectly set to reduce the training error, the direct goal-oriented ensemble learning algorithm was given. The experimental analysis on UCI dataset proves that the generalized AdaBoost algorithms are effective and some of them perform better than the ordinary AdaBoost algorithm.

关闭

Copyright © 2020四川大学期刊社 版权所有.

地址:成都市一环路南一段24号

邮编:610065