Here's the biggest thing that seems off to me: these indexes need to be fully populated by the programmer, right? I saw a bunch of "You could search Twitter, think about the Sunlight foundation, here's some firehoses" but then this (and the rest of) the tutorials seem to be all about me feeding it data directly.
If I wanted to search the Twitter firehose, say, I'd have to do all of the scraping and insertion myself, right? I can't just hook it up and head off? That's what makes sense, but some of the marketing seemed to imply otherwise.
First off, thanks! To answer your question: what we'd like to do is have some readily available data sources that you could select from a directory/list (a lot of people have asked for that). Right now you have to write your own listener to connect a source with our api.
I'll take a look at our docs, I want to make sure this is not misleading.
I'm in the same boat as you. I thought there was built in ways of searching things like that so I started to think of some ideas for an entry. Was disappointed when I realized I'd have to sit down and scrape and populate a ton of data. Though I'll still probably wind up doing this.
Comments
This is awesome.
Here's the biggest thing that seems off to me: these indexes need to be fully populated by the programmer, right? I saw a bunch of "You could search Twitter, think about the Sunlight foundation, here's some firehoses" but then this (and the rest of) the tutorials seem to be all about me feeding it data directly.
If I wanted to search the Twitter firehose, say, I'd have to do all of the scraping and insertion myself, right? I can't just hook it up and head off? That's what makes sense, but some of the marketing seemed to imply otherwise.
First off, thanks! To answer your question: what we'd like to do is have some readily available data sources that you could select from a directory/list (a lot of people have asked for that). Right now you have to write your own listener to connect a source with our api.
I'll take a look at our docs, I want to make sure this is not misleading.
No worries. It makes sense, really.
I just tried to look for the copy that made me think this, and I can't find it.
I'm in the same boat as you. I thought there was built in ways of searching things like that so I started to think of some ideas for an entry. Was disappointed when I realized I'd have to sit down and scrape and populate a ton of data. Though I'll still probably wind up doing this.