Eliot's Ramblings

Streaming Twitter into MongoDB

Fri, 19 Mar 2010 21:18:00 -0400

curl http://stream.twitter.com/1/statuses/sample.json -u<user>:<pass> | mongoimport -c twitter_live

One thing that you can do with mongo is have 1 streaming master and 1 read/write master

server A:

./mongod —master —dbpath /tmp/a

server B

./mongod —dbpath /tmp/b —master —slave —source localhost:27017 —port 9999

You can then pipe the stream into server a, and it will only process the live stream.

Server B will replicate all changes. You can also write to it, query on it, etc… This way you can do operations that block writing on server B, but server A will never backlog.

Blogging

Fri, 05 Mar 2010 11:28:25 -0500

I think I’m going to try blogging again. Its not from a lack of opinions that I don’t, just a lack of time :) And perhaps a small algorithm somewhere in my brain that prevents me from putting all my thoughts out there…

I think I’m sick of the iPhone keyboard (or lack there of). Back to a blackberry? Or see what...

Sat, 30 May 2009 13:10:01 -0400

I think I’m sick of the iPhone keyboard (or lack there of). Back to a blackberry? Or see what android phones come out this year?

Got fc10 working on old ppc mac hardware. Now we can use that 4 year old stuff

Fri, 10 Apr 2009 17:12:22 -0400

Got fc10 working on old ppc mac hardware. Now we can use that 4 year old stuff

So i went to the gym for the first time since Sara was born. Ouch This got me thinking about locks...

Sat, 04 Apr 2009 18:10:35 -0400

So i went to the gym for the first time since Sara was born. Ouch

This got me thinking about locks at the gym. Shouldn’t the weight know I haven’t been there in months? Even if they don’t track me, can’t they see my physique? “whoa that’s too heavy!”.

The whole gym should be smart. Making fun of you to prod you. Encouragement on those rare times you meet a goal. Telling you not to lift that weight… even though younused to be able to…

And bybyhe way, no one wants to hear you (yes you) grunt.

Photo

Sat, 04 Apr 2009 14:15:23 -0400

*nix package management

Fri, 03 Apr 2009 15:28:44 -0400

boost boost-dev boost-devel: all names for the same thing in different package managers. a _tiny_ bit of standardization would be nice.

Scheme on Android

Fri, 03 Apr 2009 14:53:03 -0400

Wish I had a valid reason to play with this: http://github.com/dyoo/moby-scheme/tree/master

Don’t have an android phone or an app (or time).

http://buildbot.mongodb.org/waterfall

Fri, 03 Apr 2009 13:19:54 -0400

http://buildbot.mongodb.org/waterfall:

its all green! for now…

Who said this had to be just coding stuff? Testing iPhone app.

Fri, 03 Apr 2009 12:43:24 -0400

Who said this had to be just coding stuff? Testing iPhone app.

Testing the dashboard widget. This might be an easy way to post really quick thoughts.

Fri, 03 Apr 2009 12:32:49 -0400

Testing the dashboard widget. This might be an easy way to post really quick thoughts.