Comment on Using Google Refine to Clean a Data SetparentComments−guard-of-terra14yThis thingy opens 2.3 million lines file in something under a minute. Excel will choke, I guess.Still unix toolset - awk, grep, sort - beats both for most tasks and huge data sets.−craig552ukOP14yYeah, GR chocked on a 7GB file the other day, had to chop it up in the shell before importing each in turn.That's when the export/import processing steps feature comes in handy.
Comments
This thingy opens 2.3 million lines file in something under a minute. Excel will choke, I guess.
Still unix toolset - awk, grep, sort - beats both for most tasks and huge data sets.
Yeah, GR chocked on a 7GB file the other day, had to chop it up in the shell before importing each in turn.
That's when the export/import processing steps feature comes in handy.