G2TT
来源类型Article
规范类型其他
DOI10.20309/jdis.201619
ISBN2096-157X
Can automatic classification help to increase accuracy in data collection?
Lang, Frederique; Chavarro, Diego; Liu, Yuxian
发表日期2016-09-09
出处Journal of Data and Information Science
出版者Journal of Data and Information Science
出版年2016
页码42-58
语种英语
摘要Purpose: The authors aim at testing the performance of a set of machine learning algorithms that could improve the process of data cleaning when building datasets. Design/methodology/approach: The paper is centered on cleaning datasets gathered from publishers and online resources by the use of specific keywords. In this case, we analyzed data from the Web of Science. The accuracy of various forms of automatic classification was tested here in comparison with manual coding in order to determine their usefulness for data collection and cleaning. We assessed the performance of seven supervised classification algorithms (Support Vector Machine (SVM), Scaled Linear Discriminant Analysis, Lasso and elastic-net regularized generalized linear models, Maximum Entropy, Regression Tree, Boosting, and Random Forest) and analyzed two properties: accuracy and recall. We assessed not only each algorithm individually, but also their combinations through a voting scheme. We also tested the performance of these algorithms with different sizes of training data. When assessing the performance of different combinations, we used an indicator of coverage to account for the agreement and disagreement on classification between algorithms. Findings: We found that the performance of the algorithms used vary with the size of the sample for training. However, for the classification exercise in this paper the best performing algorithms were SVM and Boosting. The combination of these two algorithms achieved a high agreement on coverage and was highly accurate. This combination performs well with a small training dataset (10%), which may reduce the manual work needed for classification tasks. Research limitations: The dataset gathered has significantly more records related to the topic of interest compared to unrelated topics. This may affect the performance of some algorithms, especially in their identification of unrelated papers. Practical implications: Although the classification achieved by this means is not completely accurate, the amount of manual coding needed can be greatly reduced by using classification algorithms. This can be of great help when the dataset is big. With the help of accuracy, recall, and coverage measures, it is possible to have an estimation of the error involved in this classification, which could open the possibility of incorporating the use of these algorithms in software specifically designed for data cleaning and classification. Originality/value: We analyzed the performance of seven algorithms and whether combinations of these algorithms improve accuracy in data collection. Use of these algorithms could reduce time needed for manual data cleaning.
URLhttp://sro.sussex.ac.uk/id/eprint/65034/
来源智库Science Policy Research Unit (United Kingdom)
引用统计
资源类型智库出版物
条目标识符http://119.78.100.153/handle/2XGU8XDN/468777
推荐引用方式
GB/T 7714
Lang, Frederique,Chavarro, Diego,Liu, Yuxian. Can automatic classification help to increase accuracy in data collection?. 2016.
条目包含的文件
条目无相关文件。
个性服务
推荐该条目
保存到收藏夹
导出为Endnote文件
谷歌学术
谷歌学术中相似的文章
[Lang, Frederique]的文章
[Chavarro, Diego]的文章
[Liu, Yuxian]的文章
百度学术
百度学术中相似的文章
[Lang, Frederique]的文章
[Chavarro, Diego]的文章
[Liu, Yuxian]的文章
必应学术
必应学术中相似的文章
[Lang, Frederique]的文章
[Chavarro, Diego]的文章
[Liu, Yuxian]的文章
相关权益政策
暂无数据
收藏/分享

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。