Comment on Using Google Refine to Clean a Data SetparentComments−bockris14yAlso check out Data Wrangler. http://vis.stanford.edu/wrangler/It focuses on more mechanical transformations but has the ability to save the steps to a program which you can then use in a process pipeline.(disclaimer, I haven't played with it in a few months so this is from memory)−craig552ukOP14yGR also allows you to export/import steps to reuse. Though I think DataWrangler is easier to integrate in to an automated pipeline.−etrain14yYeah, Wrangler will turn your "manipulation" steps into scripts in Python/MapReduce/Javascript.
Comments
Also check out Data Wrangler. http://vis.stanford.edu/wrangler/
It focuses on more mechanical transformations but has the ability to save the steps to a program which you can then use in a process pipeline.
(disclaimer, I haven't played with it in a few months so this is from memory)
GR also allows you to export/import steps to reuse. Though I think DataWrangler is easier to integrate in to an automated pipeline.
Yeah, Wrangler will turn your "manipulation" steps into scripts in Python/MapReduce/Javascript.