We love designing and developing websites, but what really drives us is solving problems and cultivating strong relationships with our clients
Getting trending Github projects via YQL
By : shabda
Github.com/explore allows you to see the trending Github topics. They use repopular.com for this, which use twitter retweets to find out the popular Github repos.
Since neither Repopular, nor Github have a RSS of these trending repos, I wanted to get a list of these. Here is how easy it is with YQL.
How we do it
-
Go to YQL console. Give the SQL query to get the data from the webpage.
-
where url="repopular.com" and css="div.pad a"is the magic which select the webpage, and also what DOM elemenst we are interested in. -
We get this data in JSON format which is munged to get the list of links.
-
This list of links is passed via
is_github_projectwhich gets me just the Github projects. -
And we are done.
PS. YQL is amazing.
Comments
By the way, your blog is not properly handling non-latin characters. I get an error if I try to comment using my name as Caio Romão.
Caio:
This is the code. http://github.com/agiliq/django-blogango
You can fork and fix it. We will pull it back.
I posted an implementation in Factor:
http://re-factor.blogspot.com/2010/10/trending-github-projects.html
Reactions
Getting trending Github projects via YQL: submitted by shabda [link] [comment] http://bit.ly/ctnP1o
@github n atom feed generator for gh trending repos: goo.gl/Wg02 (source: goo.gl/sdKS) - The YQL was from: http://goo.gl/FVxa CC:@asksol
Atom feed gerenator for@github trending repos: http://goo.gl/Wg02 (src: http://goo.gl/sdKS) - Reference: http://goo.gl/FVxa CC:@asksol
@chesterbr thought you might like http://agiliq.com/blog/2010/10/getting-trending-github-projects-via/
I sure did, thanks. :-) Indeed, YQL is amazing! RT:@lucasfontes:@chesterbr thought you might like http://bit.ly/aKdnOH
RT@tek_news: Reddit/p: Getting trending Github projects via YQL http://bit.ly/cspQ2r
Getting trending Github projects via YQL - http://agiliq.com/blog/2010/10/getting-trending-github-projects-via/
- Test Driven Development in Python
- Deploying Django apps on Heroku
- Developing android applications from command line
- Deploy Django App in 5 Easy Steps
- Project Management Tools for Start-Ups
- Generating a pdf from an image using PIL and django
- Dynamically attaching SITE_ID to Django Caching
- Screencast: How to deploy Django on Heroku
- Deploying Django apps on Heroku
- How to use pep8.py to write better Django code
- rails
- django
- linkroundup
- django opinion
- opinion
- business
- API
- appengine
- python
- satire
- startup
- Uncategorized
- marketing
- personal
- rambling
- search
- interviews
- seo-interviews
- 5startupideas
- ideas
- seo
- tips
- forms
- paypal
- utilities
- datetime
- web2.0
- Amazon
- algorithms
- presentations
- products
- pinax
- satchmo
- ecommerce
- microsoft
- yahoo
- book
- tutorial
- models
- aggreagtion
- meta
- India
- apps
- about
- CSS
- Design
- wordpress
- test slug
- vim
- urls
- reviews
- javascript
- xmpp
- emacs
- Typography
- Grid Theory
- Color Theory
- iphone
- android
- titanium
- mobile applications
- CSS3
- Browser Compatibility
- mobile
- jobs
- lamson
- django setup
- files
- upload
- jsTree
- hierarchical view
- web page
- Treeview
- coffeescript
- request
- response
- South
- django south
- django migration
- --fake
- screencasts
- django caching
- SITE_ID prefix
- review
- code hosting
- comparison
- unfuddle
- fogbugz
- assembla
- github
- project management
- ticketing system
- gunicorn
- deploy
- nginx
- ubuntu
- vps
- android terminal
- terminal
- programming
- TDD
- Test Driven
- Development
- May 2012
- April 2012
- March 2012
- February 2012
- January 2012
- December 2011
- October 2011
- September 2011
- July 2011
- June 2011
- April 2011
- February 2011
- January 2011
- December 2010
- November 2010
- October 2010
- September 2010
- June 2010
- April 2010
- March 2010
- January 2010
- December 2009
- November 2009
- October 2009
- September 2009
- August 2009
- July 2009
- June 2009
- April 2009
- March 2009
- February 2009
- November 2008
- October 2008
- June 2008
- May 2008
- April 2008
Hey, cool stuff :)
Just in case you don't check your thread on reddit (I've replied there):
I've just hacked a feed generator on appengine using your YQL! Check it out: http://ghtrends.appspot.com/atom.xml
Source code on Github: github.com/caio/ghtrends