To main content

Cluster-based information retrieval using pattern mining

Abstract

This paper addresses the problem of responding to user queries by fetching the most relevant object from a clustered set of objects. It addresses the common drawbacks of cluster-based approaches and targets fast, high-quality information retrieval. For this purpose, a novel cluster-based information retrieval approach is proposed, named Cluster-based Retrieval using Pattern Mining (CRPM). This approach integrates various clustering and pattern mining algorithms. First, it generates clusters of objects that contain similar objects. Three clustering algorithms based on k-means, DBSCAN (Density-based spatial clustering of applications with noise), and Spectral are suggested to minimize the number of shared terms among the clusters of objects. Second, frequent and high-utility pattern mining algorithms are performed on each cluster to extract the pattern bases. Third, the clusters of objects are ranked for every query. In this context, two ranking strategies are proposed: i) Score Pattern Computing (SPC), which calculates a score representing the similarity between a user query and a cluster; and ii) Weighted Terms in Clusters (WTC), which calculates a weight for every term and uses the relevant terms to compute the score between a user query and each cluster. Irrelevant information derived from the pattern bases is also used to deal with unexpected user queries. To evaluate the proposed approach, extensive experiments were carried out on two use cases: the documents and tweets corpus. The results showed that the designed approach outperformed traditional and cluster-based information retrieval approaches in terms of the quality of the returned objects while being very competitive in terms of runtime.
Read the publication

Category

Academic article

Language

English

Author(s)

  • Youcef Djenouri
  • Asma Belhadi
  • Djamel Djenouri
  • Jerry Chun-Wei Lin

Affiliation

  • SINTEF Digital / Mathematics and Cybernetics
  • University of the West of England, Bristol
  • Kristiania University of Applied Sciences
  • Western Norway University of Applied Sciences

Date

17.10.2020

Year

2020

Published in

Applied intelligence (Boston)

ISSN

0924-669X

Volume

51

Page(s)

1 - 16

View this publication at Norwegian Research Information Repository