Comment on Ask HN: Software for exploring billion row sized datasetsComments−teyc13ySQL Server and Excel PivotTables uses Vertipaq. The main idea is data along columns tend to not change very much. Therefore, one is able to compress data in memory in columns, achieving a very high degree of compression.Perhaps you can roll something like this as well.
Comments
SQL Server and Excel PivotTables uses Vertipaq. The main idea is data along columns tend to not change very much. Therefore, one is able to compress data in memory in columns, achieving a very high degree of compression.
Perhaps you can roll something like this as well.