shabda
Comments
Reactions

Getting trending Github projects via YQL

By : Shabda Raaj

Github.com/explore allows you to see the trending Github topics. They use repopular.com for this, which use twitter retweets to find out the popular Github repos.

Since neither Repopular, nor Github have a RSS of these trending repos, I wanted to get a list of these. Here is how easy it is with YQL.

How we do it

  • Go to YQL console. Give the SQL query to get the data from the webpage.

  • where url="repopular.com" and css="div.pad a" is the magic which select the webpage, and also what DOM elemenst we are interested in.

  • We get this data in JSON format which is munged to get the list of links.

  • This list of links is passed via is_github_project which gets me just the Github projects.

  • And we are done.

PS. YQL is amazing.


Related Posts


Can we help you build amazing apps? Contact us today.

Topics : django API

Comments

Caio Romao

Hey, cool stuff :)

Just in case you don't check your thread on reddit (I've replied there):

I've just hacked a feed generator on appengine using your YQL! Check it out: http://ghtrends.appspot.com/atom.xml

Source code on Github: github.com/caio/ghtrends

commmenttor
Caio Romao

By the way, your blog is not properly handling non-latin characters. I get an error if I try to comment using my name as Caio Romão.

commmenttor
Shabda Raaj

Caio:

This is the code. http://github.com/agiliq/django-blogango

You can fork and fix it. We will pull it back.

commmenttor

Reactions

proggitarticles

Getting trending Github projects via YQL: submitted by shabda [link] [comment] http://bit.ly/ctnP1o

commmenttor
phunt

Getting trending Github projects via YQL http://bit.ly/ahx2fg

commmenttor
alexdong

RT@phunt: Getting trending Github projects via YQL http://bit.ly/ahx2fg

commmenttor
chesterbr

I sure did, thanks. :-) Indeed, YQL is amazing! RT:@lucasfontes:@chesterbr thought you might like http://bit.ly/aKdnOH

commmenttor
tek_news

Reddit/p: Getting trending Github projects via YQL http://bit.ly/cspQ2r

commmenttor
opexxx

RT@tek_news: Reddit/p: Getting trending Github projects via YQL http://bit.ly/cspQ2r

commmenttor
shabda

RT@phunt: Getting trending Github projects via YQL http://bit.ly/ahx2fg

commmenttor
caioromao

@github n atom feed generator for gh trending repos: goo.gl/Wg02 (source: goo.gl/sdKS) - The YQL was from: http://goo.gl/FVxa CC:@asksol

commmenttor
caioromao

Atom feed gerenator for@github trending repos: http://goo.gl/Wg02 (src: http://goo.gl/sdKS) - Reference: http://goo.gl/FVxa CC:@asksol

commmenttor
jaredortner

Getting trending Github projects via YQL - http://agiliq.com/blog/2010/10/getting-trending-github-projects-via/

commmenttor
© Agiliq, 2009-2012