TY - GEN
T1 - Evaluation of answer quality in CQA websites
AU - Chua, Alton Y.K.
AU - Balkunje, Radhika Shenoy
PY - 2012
Y1 - 2012
N2 - Enabled by community-based natural language question answering, CQA websites have been drawing increasing number of users in the recent years. Researchers have attempted to study the impact of CQAs on the conventional concepts of information creation, acquisition and dissemination. However, limited efforts seem to be expended in assessing the quality of answers that these websites generate. Moreover, with the profusion of user-generated content, answer quality is paramount to sustain the real value of knowledge thriving in the CQAs. This paper therefore seeks to address the aforementioned concern by performing an evaluation of answer quality in six leading CQA websites, three English and three Chinese. The English websites include Wiki Answers, Yahoo! Answers and Answerbag whereas the Chinese websites include Baidu Knows, Tencent Soso WenWen and Sina iask. The evaluation framework for answer quality consists of four dimensions namely, content value, cognitive value, socio-emotional value and answer speed. Specifically, this paper aims to answer the following research questions: 1.) Is there any significant difference in answer quality between English and Chinese CQA websites? 2.) Is there any significant difference in answer quality across different CQA websites? A total of 1164 answers are extracted from the six websites and submitted for analysis. The results arising from the evaluation helped answer the two research questions. One, there was a significant difference in answer quality between English and Chinese websites in terms of cognitive value and socio-emotional value. This variation may be attributed to the different cultures, norms and beliefs of Western users and Chinese users. Two, there was significant difference in answer quality across all six websites in terms of content value, cognitive value and socio-emotional value. This variation can be explained by various factors such as the differences in information and communication technologies, information management strategies, user motivation methods and question types implemented by the websites.
AB - Enabled by community-based natural language question answering, CQA websites have been drawing increasing number of users in the recent years. Researchers have attempted to study the impact of CQAs on the conventional concepts of information creation, acquisition and dissemination. However, limited efforts seem to be expended in assessing the quality of answers that these websites generate. Moreover, with the profusion of user-generated content, answer quality is paramount to sustain the real value of knowledge thriving in the CQAs. This paper therefore seeks to address the aforementioned concern by performing an evaluation of answer quality in six leading CQA websites, three English and three Chinese. The English websites include Wiki Answers, Yahoo! Answers and Answerbag whereas the Chinese websites include Baidu Knows, Tencent Soso WenWen and Sina iask. The evaluation framework for answer quality consists of four dimensions namely, content value, cognitive value, socio-emotional value and answer speed. Specifically, this paper aims to answer the following research questions: 1.) Is there any significant difference in answer quality between English and Chinese CQA websites? 2.) Is there any significant difference in answer quality across different CQA websites? A total of 1164 answers are extracted from the six websites and submitted for analysis. The results arising from the evaluation helped answer the two research questions. One, there was a significant difference in answer quality between English and Chinese websites in terms of cognitive value and socio-emotional value. This variation may be attributed to the different cultures, norms and beliefs of Western users and Chinese users. Two, there was significant difference in answer quality across all six websites in terms of content value, cognitive value and socio-emotional value. This variation can be explained by various factors such as the differences in information and communication technologies, information management strategies, user motivation methods and question types implemented by the websites.
KW - Answer quality
KW - Answer speed
KW - Cognitive value
KW - Content value
KW - CQA websites
KW - Socio-emotional value
UR - http://www.scopus.com/inward/record.url?scp=84887458344&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84887458344&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:84887458344
SN - 9789728939724
T3 - Proceedings of the IADIS International Conference Web Based Communities and Social Media 2012, IADIS International Conference Collaborative Technologies 2012
SP - 49
EP - 56
BT - Proceedings of the IADIS International Conference Web Based Communities and Social Media 2012, IADIS International Conference Collaborative Technologies 2012
T2 - IADIS International Conference Web Based Communities and Social Media 2012, IADIS International Conference Collaborative Technologies 2012, Part of the IADIS Multi Conference on Computer Science and Information Systems 2012, MCCSIS 2012
Y2 - 19 July 2012 through 21 July 2012
ER -