Automatically Predicting Quiz Difficulty Level Using Similarity Measures

Chenghua Lin, Dong Liu, Wei Pang, Edward Apeh

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)
1 Downloads (Pure)

Abstract

In this paper, we present a semi-automatic system (Sherlock) for quiz generation using Linked Data and textual descriptions of RDF resources. Sherlock is distinguished from existing quiz generation systems in its ability to control the difficulty level of the generated quizzes. We cast the problem of perceiving the level of knowledge difficulty as a similarity measure problem and propose a novel hybrid semantic similarity measure using linked data. Extensive experiments show that the proposed similarity measure outperforms four strong baselines in both the pilot evaluation using a synthetic gold standard as well as with human evaluation, giving more than 47% gain in clustering accuracy over the baselines.
Original languageEnglish
Title of host publicationProceedings of The 8th International Conference on Knowledge Capture (K-Cap)
PublisherACM
Pages1-8
Number of pages8
ISBN (Print)978-1-4503-3849-3
DOIs
Publication statusPublished - 2015
EventK-CAP 2015 - The 8th International Conference on Knowledge Capture - USA, New York, United States
Duration: 7 Oct 201510 Oct 2015

Conference

ConferenceK-CAP 2015 - The 8th International Conference on Knowledge Capture
CountryUnited States
CityNew York
Period7/10/1510/10/15

Fingerprint Dive into the research topics of 'Automatically Predicting Quiz Difficulty Level Using Similarity Measures'. Together they form a unique fingerprint.

  • Cite this

    Lin, C., Liu, D., Pang, W., & Apeh, E. (2015). Automatically Predicting Quiz Difficulty Level Using Similarity Measures. In Proceedings of The 8th International Conference on Knowledge Capture (K-Cap) (pp. 1-8). [1] ACM. https://doi.org/10.1145/2815833.2815842