A fast algorithm to build new users similarity list in neighbourhood-based collaborative filtering

Abstract

Lecture Notes in Electrical Engineering 368Neighbourhood-based Collaborative Filtering (CF) has been applied in the industry for several decades because of its easy implementation and high recommendation accuracy. As the core of neighbourhood-based CF, the task of dynamically maintaining users’ similarity list is challenged by cold-start problem and scalability problem. Recently, several methods are presented on addressing the two problems. However, these methods require mn steps to compute the similarity list against the kNN attack, where m and n are the number of items and users in the system respectively. Observing that the k new users from the kNN attack, with enough recommendation data, have the same rating list, we present a faster algorithm, TwinSearch, to avoid computing and sorting the similarity list for each new user repeatedly to save the time. The computational cost of our algorithm is 1/125 of the existing methods. Both theoretical and experimental results show that the TwinSearch Algorithm achieves better running time than the traditional method.Recommender systems; Neighbourhood-based collaborative filtering; Similarity computation; Database application