skip to content

Planet Drupal

Diagram of the pivots recommendation system on d.o.

This is the diagram to illustrate our proposed pivots recommendation system deployment on d.o. To see the description in words, please refer to here.

Deployment structure of pivots module recommendation block for Drupal.org

We hope to deploy the pivots block to Drupal.org recently. The block displays on a module page its related discussions and related modules. This article explains how the pivots block will be deployed on Druapl.org.

4 algorithms used in Drupal module recommendation

At the heart of the pivots Drupal module recommendation system are the secret recommender algorithms. Currently we are playing with 4 algorithms.

  • Co-references: The more frequently module A and module B are mentioned together in the same forum discussion thread, the more related they are in the recommendation list. This algorithm is in favor of the most popular modules because they tend to get more co-references regardless of relevancy.

Latest usage analysis and future development plan

We now have two more weeks of usage data on authenticated D.O. users from 7/28/2008 to 8/11/2008. The data shows a steady pattern of usage overtime. Please refer to the attachment for a brief report. We are now quite confident that the pivots block has certain values to users in terms of module recommendation.

Switching "related projects" pivots algorithm

Previously we computed the "related projects" by using the frequency of project co-mentions in discussions. For example, if the module Fivestar and CCK were mentioned together in 33 different discussion threads, whereas Fivestar and jRating in 10 threads, then we would think CCK was more relevant to Fivestar than jRating because it has more co-mentions.

However, that algorithm ignores the fact that some very popular modules like CCK simply have more chances to get mentioned, even if it's not that relevant in the context.

Drupal users welcome the Pivots recommendation block

The pivots system was enabled on D.O. to all authenticated users on 2008-07-22. This analysis report is based on the data we collected from 2008-07-22 midnight to 2008-07-28 midnight (6 days in total). There were 10454 distinct user IDs from 14701 distinct IP addresses participating during this period.

Pivots recommendation system for Drupal.org: Help people find modules

Greetings all,

From now on, I'm going to report the project progress of the "pivots recommendation system for drupal.org" on this blog.

The "pivots" project is an attempt to generate module recommendations to D.O. users. The idea is to display on a module page the related forum conversations and related modules that are referenced in the same conversations. We think it could provide useful information to users when they evaluate the modules.

We have deployed the system on D.O. to site maintainers and CVS account holders since June 1, 2008. More than 900 users has tried using the system since then. Statistics shows that the conversation pivot block got a 2.76% click-through rate, the double pivot block got a 1.25% click-through rate. Survey shows that 73.8% feedback on the conversation pivot was positive, and 77% positive feedback on the double pivot. To see the brief report, please click here. To see the full report, please click here.

The study gives us reasons to believe that pivots would be helpful to D.O. users in finding module recommendations. And we are now planning to make it available to more users. In the meantime, we will continue to make the algorithm works better. People's feedback and suggestions would be much appreciated.

Lastly, I'd like to thank Kieran Lal and my advisor Prof. Paul Resnick for their constant support.

Thanks!

--Daniel

Syndicate content
Powered by Drupal. CrystalX theme created by Nuvio | Webdesign.