Comment on BTables: A fast, compact format for Machine LearningComments−blt10yWondering why they chose row-major storage. I think it's far more common to only care about a subset of columns than a subset of rows.−nostrademons10yFTA:"First, we knew we only cared about row-by-row access over the entire file; we do not need things like random row or column reads."It sounds like they don't care about subsets of either columns or rows, and are looking to optimize table size and time for full table scans.
Comments
Wondering why they chose row-major storage. I think it's far more common to only care about a subset of columns than a subset of rows.
FTA:
"First, we knew we only cared about row-by-row access over the entire file; we do not need things like random row or column reads."
It sounds like they don't care about subsets of either columns or rows, and are looking to optimize table size and time for full table scans.