Roadmap for the pivots_block module recommendation on d.o.

Sun, 04/05/2009 - 10:32 — Daniel Zhou

A brief history to begin with ...

What's pivots_block?

The idea is to generate "related modules" recommendation based on co-citations. Suppose we have TinyMCE and FCKeditor co-mentioned together in many forum discussions, then we consider the 2 modules related to some extend. Here is a detailed explanation.

Where we are now?

With the help of d.o. infrastructure/webmaster team, we deployed pivots_block on d.o. Google Analytics reports showed that pivots_block invited 3 times higher click-throughs than the simple "New forum posts" block. Also, we found that the classical correlation coefficient algorithm received more click-throughs than the other 3 extended algorithms. In general, we think pivots_block works pretty fine for the d.o. community.

The roadmap to the future ...

The next major improvement

One key factor to pivots_block is to correctly detect module citations in forum discussions. Currently we used 1) the popular aliases such as CCK and 2) the module title names together with the keyword 'module' as detectors to match module citations in discussions. This might have missed quite a few module citations.

To fix that, we recruited a graduate student at University of Michigan and manually read through all 12,742 messages posted to d.o. forum in November 2008. By that we hope to collect a list of module aliases used by the community, and then use that to improve accuracy of detecting module mentions. The work is almost done, and we hope to apply it soon to d.o. and test if it improves the recommendation quality.

Other alternatives

One alternative is to generate module recommendations based on project usage data, which is current running on d.o. Its limitation, however, is that it tends to recommend complement modules than substitute modules, because people rarely use substitute modules in the same sites. Google Analytics showed that this algorithm had slighted lower click-through rates than the original co-citation algorithm, but not statistically significant.

Another alternative is to use ApacheSolr MoreLikeThis. This is promising because d.o. search is running on ApacheSolr already. However, to my knowledge (maybe limited), the relevancy matching algorithm of MoreLikeThis is text-based. That is, modules are related because their project text descriptions are similar. This might or might not work well for d.o. modules. But it's definitely a direction to explore.

The last alternative is to generate related modules based on module ratings such as http://drupalmodules.com/. This is a promising idea too. One concern is that it might be subjective to deliberative manipulation, indicated by some research literature. Besides, this approach is only possible after implementing a module voting system in d.o. redesign.

Action plan

First, I'd like to apply the next (probably last) major improvement of pivots_block to d.o., as described earlier, and measure its click-through rate. That would be the best we can get from the co-citation pivots algorithm.

Second, I'd like to work with the ApacheSolr team and see if we can use ApacheSolr MoreLikeThis to make "related modules" recommendations on d.o.

If ApacheSolr MoreLikeThis receives higher click-throughs, which would indicate that it's more helpful to the community, then it's better to keep MoreLikeThis. And vice versa. If we decide to keep pivots_block, my future plan then is to make it a more general-purpose module and build it on top of ApacheSolr (details will be announced later).

I'll try to finish this research in April and report it back to the community. Drupal ROCKS and hope we'll make d.o. module recommendations work better!!

Comments

Well, this is my first visit

Mon, 11/23/2009 - 08:30 — James (not verified)

Well, this is my first visit to your blog! But I admire time and effort you put into it, especially into interesting articles you share here!
James,
web messenger software

I like the side of the

Sun, 11/22/2009 - 08:41 — Christian Louboutin (not verified)

I like the side of the article, and very like your blog, to write well and hope to continue their efforts, we can see more of your articles.Christian Louboutin shoes. Recommend you to take a look at it, is now being discounted, Louboutin Fall-Winter Collection in hot!

liberty reserve

Sat, 11/21/2009 - 20:10 — iklan bisnis indonesia (not verified)

Thanks for sharing

liberty reserve
libertyreserve
Jual liberty reserve
beli liberty reserve
jual beli libertyreserve
jual lr
beli lr
jual beli lr

iklan bisnis indonesia
iklan baris bisnis
bisnis indonesia
iklan bisnis
iklan indonesia

that has already become part

Sat, 11/21/2009 - 02:31 — alex (not verified)

that has already become part of Officine rolex watches Panerai's history: the Radiomir P.999 42 mm tag heuer Gold combines the unmistakable design of an icon in high-end, sport news:replica watches with the new mechanical movement, the replica tag heuer watches P.999, designed and produced at the Neuchâtel manufacture. replica rolex watches and Louis Vuitton's Monogram pattern perhaps the most louis vuitton replica representative of the brand, starting today you can enjoy the unparalleled Ardentes series of Louis Vuitton. replica louis vuitton handbags to say Ardentes will bring to the breitling replica watches from this new era is no exaggeration.

ugg boots

Fri, 11/20/2009 - 23:35 — ugg boots (not verified)

UGG Boots uk | ClassicUGG Boots sale-To ensure your toes are in heaven,UGG Boots made by UGG Australia are your must-have boots.50-70% off.Love UGGs.
UGG Bailey Button boots
Classic Tall UGG Bootseee

Creative post!It is cool to

Fri, 11/20/2009 - 13:02 — Abercrombie and Fitch (not verified)

Creative post!It is cool to have the same Abercrombie and Fitch
shoes for a family in the school Family Day.

Excellent post! Just wanna

Fri, 11/20/2009 - 13:00 — jack wills (not verified)

Excellent post! Just wanna thank you for what you have shared. Look forward to reading nice articles from you. jack wills

cheap pumas

Thu, 11/19/2009 - 13:29 — puma shoes (not verified)

Thanks! Puma shoes online store provide us cheap puma shoes and puma women shoes .Prepared to give you a pleasant shopping trip. Enjoy shopping, enjoy cool shoes and low price from www.pumaforever.com

uggs on sale

Thu, 11/19/2009 - 13:29 — discount UGG Boots (not verified)

Thanks for taking the time to check us out. Here I will be happy to recommend some cheap sale informations.
Ugg Shoes online store, you could enjoy low price sexy cheap Ugg Boots and the best service from www.cosycentral.com

Thank you for your sharing.

Thu, 11/19/2009 - 05:33 — Anonymous (not verified)

Thank you for your sharing. Supposed to attack these head-on and you will find a deep sense of gratification that will fuel your happiness. Maybe you are also interested in Abercrombie and Fitch. I'm just hearing the curiosity behind it.

Abercrombie and Fitch

Thu, 11/19/2009 - 03:26 — Abercrombie and Fitch (not verified)

Thanks for yoursharing. This is a good access to
Abercrombie and Fitch

NFL JERSEYS

Thu, 11/19/2009 - 03:17 — NFL JERSEYS (not verified)

follow the fashion stream, like sports, love football. this is the

best choice for you to know football jersey. also it will bring you to
the home of NFL JERSEYS
NFL JERSEYS

thnks

Wed, 11/18/2009 - 20:03 — beyzam (not verified)

Sohbet Odalari
Sohbet Siteleri
Seviyeli Sohbet
sohbet Chat
Sohbet Kanallari
Sohbet Sayfalari
Chat Sayfalari
Kaliteli Sohbet
Dini Sohbet
Cet odalari
Muhabbet Kanallari
Sohbet adresleri

Air Max

Wed, 11/18/2009 - 05:16 — Anonymous (not verified)

Thanks for sharing the nice post with me, an Air Jordan girl who

firmly follows the fashion trend, especially

Air Jordan sneakers.

It really brings me some fresh feelings with addtional insights into today's world.

Air Jordan

Air Max

Wed, 11/18/2009 - 05:07 — Anonymous (not verified)

Great topic Any nike air max 90/95 fans liketo read it, and also,we are

also glad to share with you nice and unique nike air max 90/95 shoes, on

Different nike air max 90/95 made with

fashionable nike air max 90/95 Trendy, all seemed charming

on nike air max 90/95, welcome...

Air Max

Wed, 11/18/2009 - 05:04 — Anonymous (not verified)

Thanks for sharing the nice post with me, an Air Jordan girl who

firmly follows the fashion trend, especially

Air Jordan sneakers.

It really brings me some fresh feelings with addtional insights into today's world.

Air Jordan

Air Max

Wed, 11/18/2009 - 05:03 — Anonymous (not verified)

Great topic Any nike air max 90/95 fans liketo read it, and also,we are

also glad to share with you nice and unique nike air max 90/95 shoes, on

Different nike air max 90/95 made with

fashionable nike air max 90/95 Trendy, all seemed charming

on nike air max 90/95, welcome...

the top brand handbags and shoes

Wed, 11/18/2009 - 04:34 — babara (not verified)

puma shoes
wholesale shoes
jordan shoes
Gucci Handbags
Chanel Handbags
Wholesale Handbags

ugg sale

Wed, 11/18/2009 - 04:24 — CHEAP UGG (not verified)

Buy Cheap Ugg Boots, UGG Boot Sale women's Ugg Boots,Genuine Australia UGG Boot,cheap uggs,uggs discount boots,uggs on sale

Pass4sure is the best choice

Wed, 11/18/2009 - 04:19 — 642-825 (not verified)

Pass4sure is the best choice for IT candidates who want to pass any IT exams. Popular certifications like Cisco, Microsoft, IBM, Sun, compTIA, HP, etc, ensure that customers could find the exactly one they need. Product forms at Pass4sure are various, software, hardcopy, video, E-Zine and so on.
The Most Popular exams List :
220-603 | xk0-002 | 642-642 | 640-802 | sk0-002 | 220-602 | 642-446 | 642-436 | 642-436 | 640-553 | 640-802 | sk0-002 | 350-018 | VCP-310 | 640-863 | 642-901 | 350-029 | 350-029 | xk0-002 | 642-446 |
Click P4S to get more information!

L2 Adena

Wed, 11/18/2009 - 03:23 — Anonymous (not verified)

Lineage 2 Adena is one of important items when you would like to play the game. There are many L2 Adena online stores where you can buy Lineage 2 Adena. If you choose a reputable online retailer, you can get cheap Lineage 2 Gold. In our online store, we will offer you the cheapest L2 Gold and the best service

aion gold

Tue, 11/17/2009 - 22:49 — aion gold (not verified)

In here I found that all the gold were cheap and the aion gold was the cheapest, you can come here to buy aion gold, you can introduce your friends to come to here to buy the aion gold we will give you some preferential, and also you can bought the aion gold, we can sure that in the market our aion goldwas the cheapest.

Watches replica

Tue, 11/17/2009 - 21:37 — Anonymous (not verified)

plica exact replica Panerai review watch . The replica watches for sale IWC (International Watchmaking exact replicas rolex Company) watch is replica Bvlgari a world-famous, top-of-the-line Regulateur Moonphase C_SWISS-20-403 review quality watch that exact replica Cartier review is known for replica Roger Dubuis review its high cost Jacob&Co Five Time Zone FullSize JAC-11-561 review and beautiful look exact replica Baume & Mercier for sale of prestige. The exact replica Montblanc new 2009-10 line Quality exact replicas of IWC watches Ferrari Ferrari exact imitation includes an impressive Blancpain Blancpain exact imitation variety of popular swiss Rolex replicas watches, as well genuine swiss for sale as the famous replica watch diving watches exact Panerai Luminor Marina PANE-23-724 imitation imitation Tag Heuer watches replica watches exact Cartier Must de Cartier Unisex CART-114-280 imitation

true religion wholesale

Tue, 11/17/2009 - 22:01 — true religion wholesale (not verified)

nfl jerseys wholesale
wholesale nfl jersey
replica nfl jerseys
GHD
cheap jordans
nike shoes wholesale
nfl jerseys
jordan shoes
tomic
replica handbags wholesale

ake-prada-bags

Tue, 11/17/2009 - 05:35 — Anonymous (not verified)

replica Mulberry Handbags handbags framework world. notoriety Loewe Handbags handbags replicas lousy with ways cheap replica Bally Handbags handbags that prosperity is replica louis vuitton wallets at the uncommonly Coach Handbags handbags replicas focus of orientation replica Christian Dior Handbags handbags itself. By inquiry Monogram Canvas Beverly XXL M40123 material, or natural, Gucci Snow Glam Medium Hobo Black 181522 explanations since what Dior Gaucho Medium Saddle Bag-Cream we reckon with replica AH Handbags handbags also experience, material replica louis vuitton purses has mismated the replica Bally Handbags handbags creation – or replica handbags at numero uno Louis Vuitton Handbags handbags replicas our sentiment of Monogram Canvas Keepall 55 with Shoulder Strap tangible. We no Balenciaga "Giant Work" Motocycle Bag Red longer leer fo Gucci Mini Wallet Silver 181594 Chanel Paris Biarritz Tote Bag Black 34210 replica AH Handbags handbags cheap replica Jimmy Choo Handbags handbags

coach handbags

Tue, 11/17/2009 - 22:03 — coach handbags (not verified)

electronic cigarette
bose in-ear headphones
abercrombie fitch wholesale
nfl jersey
ed hardy shirt
nhl jerseys
nfl jerseys wholesale
jordan shoes

weight loss tips

Tue, 11/17/2009 - 22:02 — weight loss tips (not verified)

nfl jerseys
ed hardy wholesale
wholesale jerseys
ed hardy shirt
nike dunks
replica watches wholesale
ed hardy clothing
jordan shoes wholesale
weight loss tips

high replicas

Tue, 11/17/2009 - 02:12 — Anonymous (not verified)

der cheap Vacheron Constantin store that dealt stow discount replica watches away the roast Richard Mille replica watches of corporations embracing cheap replica watches blogging.Suw Charman suggested replica watch that the open Longines Evidenza Mens Watch L2.642.8.73.2 interrogate is not replica watches sales whether enterprises onus Cartier Tonneau 18kt White Gold Diamond Midsize Watch WE400251 do blogs (the Longines Master Collection Mens Watch L2.669.4.78.6 guide is sign) Seiko replica watches but HOW they Concord Replica should adjust this. cheap replica watches commercial whether blogs great quality replica duty speak for Breitling Aeromarine Superocean Steelfish X-Plus Steel Blue Rubber Mens Watch A1739010-C6-586 used moment corporations Omega Seamaster Aqua Terra Ladies Quartz Watch 2579.75 is a stunt Zenith Class Open sale groove on invitation cheap replica watches whether pound besides Omega Constellation Quartz Ladies Watch 1458.75.00 free trust perform Panerai Ferrari Granturismo Chronograph Mens Watch FER00011 used weight business.The Omega Constellation Automatic Ladies Watch 1292.10.00 catechize is what close you crave to interest them whereas. What backbreaking carry out we count on that blogs incumbency winder Louis Vuitton Replica Watches that dealt stow Tissot Replica Watches away the roast Movado Replica Watches of corporations embracing Vacheron Constantin Patrimony Mens Watch 47200.000J-9018 watch blogging.Suw Charman suggested Parmigiani Replica Watches that the open replica watches release interrogate is not replica watches whether enterprises onus Bedat & CO Replica Watches do blogs (the Chopard Ice Cube replicas guide is sign) Movado SE Sports Edition watches but HOW they Panerai Replica Watches should adjust this. Longines Replica Watches commercial whether blogs Franck Muller Replica Watches duty speak for Omega Speedmaster replicas used moment corporations Mont Blanc Replica Watches is a stunt replica watches 2009 release groove on invitation replica Tag Heuer Aquaracer Diamond Pink Ladies Watch WAF141H.BA0813 whether pound besides Baume & Mercier Replica Watches free trust perform A Lange & Sohne Replica Watches used weight business.The Cartier Tankissime Diamond 18kt Yellow Gold Ladies Watch WE70017H watch catechize is what close you crave to interest them whereas. What backbreaking carry out we count on that blogs incumbency win

football jerseys

Sun, 11/15/2009 - 21:40 — cheap nfl jersys (not verified)

If a man join together to pursuit knowledge, no one can take it from him.cheap nfl jersys Books are to human beings which as nba jerseys sale emory to the individuanl nhl Jerseys.We cannot change anything mlb jerseys unless we learn and accept it, Damn does not liberate it, it oppresses.A classic adidas jerseys book which people praise but don't read.A man dies still if he has done nothing, as one who has done football child jerseys much.Education is something? which remains ofter one has forgotten everything football jerseys he learned in school.Education is something remains ofter one has forgotten everything he learned in school.http://www.nfljerseymlb.com/

ugg 5817 style boots

Sun, 11/15/2009 - 21:39 — ugg 5359 nightfal (not verified)

Sorrow is peace in my heart like the ugg 5806 boots evening among the tall upside lace uggs silent trees.if you tears when you miss the ugg 5817 style boots sun, you will also miss the stars.her eager ugg 5819 fur boots face bothers my ugg 5842 classic boots dreams as the ugg 30th anniversary rain at ugg 5691 lo pro button night.once we dreamt that we were ugg 5202 infant's erin strangers. when we wake up we find that we were to love each other's.http://www.uggboots4buy.com/

Thank you for your

Sun, 11/15/2009 - 11:16 — Anonymous (not verified)

Thank you for your sharing.!
sesli sohbet sesli chat

Thanks for sharing this

Fri, 11/13/2009 - 06:53 — Anonymous (not verified)

Thanks for sharing this information. I found it very informative as I have been researching a lot lately on practical matters such as you talk about.

Oes Tsetnoc
Internet Gratis
Kerja Keras Adalah Energi Kita

出会い系サイト

Fri, 11/13/2009 - 05:48 — 出会い系サイト (not verified)

人妻と話しをしていると楽しいねメール好きな人はメル友がたくさんいる。癒し系の人妻と親しくなれたラッキーやっぱり上品なセレブ人妻から上品さを学ぶいま話題のハッピーメールの人気の秘密とは！禁断の恋、不倫のドキドキ感たまらないであえる出会いサイトの秘訣。エッチが好きな淫乱人妻から目をはなすな！出会いチャンスをゲットできる超おススメだよーいい感じでみつかるハッピーメール出逢い初心者でもいけてるハッピーメールの出逢い！伝説のコミュニティーサイト、スタビは凄かった。いやらしいセフレは最高です。

chenghugege

Fri, 11/13/2009 - 03:53 — chenghugege (not verified)

ed hardy

[url=http://www.brandname-clothing.com]ed hardy[/url]

UGG BOOTS

Thu, 11/12/2009 - 23:16 — ugg boots (not verified)

ugg boots sale-Warm ugg boots for all the family remain at the heart of our collection,find your favorite UGGs from stunning designs-ugg boots uk.
All kinds of adidas shoes On Sale
UGG Boots saleertre

ugg boots

Thu, 11/12/2009 - 23:08 — ugg boots (not verified)

ugg boots sale-Warm ugg boots for all the family remain at the heart of our collection,find your favorite UGGs from stunning designs-ugg boots uk.
All kinds of adidas shoes On Sale.
bailey button ugg

ugg boots sale

Thu, 11/12/2009 - 22:04 — ugg boots sale (not verified)

Eliminating the need for the extra trouble to wear ugg boots uk 、
ugg boots sale、 uggs

great

Thu, 11/12/2009 - 20:34 — Download Mp3 Terbaru (not verified)

This was a very interesting

Thu, 11/12/2009 - 16:15 — Jules (not verified)

This was a very interesting post, thank you! weight loss tips

bARRICADE

Thu, 11/12/2009 - 11:02 — apidj (not verified)

Mbah Gendeng bertanya Mengenai Apa Sih Asyiknya Belajar SEO? dalam kontes Launching BeBlog..hahahaha..Maklum amatir

cheap jordans nike

Thu, 11/12/2009 - 00:42 — wholesale jordans (not verified)

wholesale jordans
cheap jordans
wholesale nike
wholesale nike shox
air jordans
jordans
wholesale coach bags
jordan shoes
wholesale air jordans
cheap air jordans
wholesale nikes
nike shoes
air jordan
jordan
wholesale bags
jordan sneakers
wholesale jordans shoes
cheap jordans shoes
wholesale nike jordans
cheap nike shox
nike air jordans
jordans boots
wholesale coach boots
air max
wholesale air max
cheap air max
wholesale air force ones
air force ones
af1s
cheap af1s
cheap wholesale

cheap jordans nike

Thu, 11/12/2009 - 00:38 — wholesale jordans (not verified)

ugg boots

Wed, 11/11/2009 - 21:48 — ugg boots (not verified)

ugg boots sale-Warm ugg boots for all the family remain at the heart of our collection,find your favorite UGGs from stunning designs-ugg boots uk.

ny iudsirefwevfeg

Nice Share

Wed, 11/11/2009 - 12:12 — Mengembalikan Jati Diri Bangsa (not verified)

Nice sharing. Thanks. I Regards for this sharing in

Mengembalikan Jati Diri Bangsa

Download Free Movie.( Artikel Tentang Islam )

Great Post Thank for

Wed, 11/11/2009 - 04:53 — Execter (not verified)

Great Post Thank for share!

Best Roth IRA
Best Roth IRA Choosing Guide
1 Hour Payday Loans
More for Info
Rich Retirement Guide

womens mbt shoes

Wed, 11/11/2009 - 03:13 — cheap mbt (not verified)

For sell mbt shoes man is man and master of his mbt walking shoes fate. Have an aim in mbt anti shoes life, or your energies will all be wasted. What makes life dreary is the want of mbt uk motive. When the fight begins within himself, a man's mbt shoes worth something.

come to see

Tue, 11/10/2009 - 23:10 — christian louboutin (not verified)

haha , thanks all the time, These Christian louboutin shoes was one of fashion's best-kept secrets:means Christian louboutin has attracted a growing clientele for whom the fact that he is not a household name is all part of the appeal.

Chat | Sohbet | Sohbet

Tue, 11/10/2009 - 17:05 — chattube (not verified)

This is some very valueable information

Tue, 11/10/2009 - 12:57 — us drugstore (not verified)

This is some very valueable information, thank you very much.

esmaül hüsna dinle tesbihat

Tue, 11/10/2009 - 12:52 — Anonymous (not verified)

esmaül hüsna dinle
tesbihat dinle
ender tekin dinle
kervan ilahisi
kürtçe ilahiler
minik dualar dinle

kral oyun
özel yurtlar
pirina

Daniel Zhou 周晓丹 Mens sana in corpore sano