shabda
24th Oct., 2010
4
Comments
11
Reactions

Getting trending Github projects via YQL
By : Shabda Raaj

Github.com/explore allows you to see the trending Github topics. They use repopular.com for this, which use twitter retweets to find out the popular Github repos.

Since neither Repopular, nor Github have a RSS of these trending repos, I wanted to get a list of these. Here is how easy it is with YQL.

How we do it

  • Go to YQL console. Give the SQL query to get the data from the webpage.

  • where url="repopular.com" and css="div.pad a" is the magic which select the webpage, and also what DOM elemenst we are interested in.

  • We get this data in JSON format which is munged to get the list of links.

  • This list of links is passed via is_github_project which gets me just the Github projects.

  • And we are done.

PS. YQL is amazing.

Related Posts

Can we help you build amazing apps? Contact us today.

Topics : django API

Comments

Caio Romao 24th Oct., 2010

Hey, cool stuff :)

Just in case you don't check your thread on reddit (I've replied there):

I've just hacked a feed generator on appengine using your YQL! Check it out: http://ghtrends.appspot.com/atom.xml

Source code on Github: github.com/caio/ghtrends

commmenttor
Caio Romao 24th Oct., 2010

By the way, your blog is not properly handling non-latin characters. I get an error if I try to comment using my name as Caio Romão.

commmenttor
Shabda Raaj 24th Oct., 2010

Caio:

This is the code. http://github.com/agiliq/django-blogango

You can fork and fix it. We will pull it back.

commmenttor

Reactions

proggitarticles 24th Oct., 2010

Getting trending Github projects via YQL: submitted by shabda [link] [comment] http://bit.ly/ctnP1o

commmenttor
phunt 24th Oct., 2010

Getting trending Github projects via YQL http://bit.ly/ahx2fg

commmenttor
alexdong 24th Oct., 2010

RT@phunt: Getting trending Github projects via YQL http://bit.ly/ahx2fg

commmenttor
caioromao 25th Oct., 2010

@github n atom feed generator for gh trending repos: goo.gl/Wg02 (source: goo.gl/sdKS) - The YQL was from: http://goo.gl/FVxa CC:@asksol

commmenttor
caioromao 25th Oct., 2010

Atom feed gerenator for@github trending repos: http://goo.gl/Wg02 (src: http://goo.gl/sdKS) - Reference: http://goo.gl/FVxa CC:@asksol

commmenttor
chesterbr 25th Oct., 2010

I sure did, thanks. :-) Indeed, YQL is amazing! RT:@lucasfontes:@chesterbr thought you might like http://bit.ly/aKdnOH

commmenttor
tek_news 25th Oct., 2010

Reddit/p: Getting trending Github projects via YQL http://bit.ly/cspQ2r

commmenttor
opexxx 25th Oct., 2010

RT@tek_news: Reddit/p: Getting trending Github projects via YQL http://bit.ly/cspQ2r

commmenttor
shabda 25th Oct., 2010

RT@phunt: Getting trending Github projects via YQL http://bit.ly/ahx2fg

commmenttor
jaredortner 26th Oct., 2010

Getting trending Github projects via YQL - http://agiliq.com/blog/2010/10/getting-trending-github-projects-via/

commmenttor
Post a comment Name :

Email :

Your site url:

Comment :

© Agiliq, 2009-2012