Comment on Using machine learning to choose compression algorithmsComments−mattnewport6yFrom the data shown it's not obvious that some of the options would ever be best, would be interesting to see if any of the non csv options ever beat the csv options and for what type of data.−kootenpvOP6yI can give you this... the larger the data the more useful parquet and compression on it will be...−mattnewport6yFrom the brief description it seems like Parquet is just a weaker version of what a decent LZ style compressor will do anyway
Comments
From the data shown it's not obvious that some of the options would ever be best, would be interesting to see if any of the non csv options ever beat the csv options and for what type of data.
I can give you this... the larger the data the more useful parquet and compression on it will be...
From the brief description it seems like Parquet is just a weaker version of what a decent LZ style compressor will do anyway