Lance table format explained with simple animationstontinton.com 30 pointswild_pointer7 months ago2 commentsSaveHideCopy link On HNComments−willtemperley6moIt's interesting to look at the relationship between this and Apache Arrow."The data types generally have a 1-1 correspondence with the Apache Arrow data types." [1]So it would probably be relatively simple to set up an Arrow Flight endpoint working with LanceDB.[1] https://lance.org/format/table/#manifest−data_ders6molove the animations! I’ve been dreaming of doing the same to get people from csvs to something like Lance but with stops at page files, parquet, and Iceberg along the way
Comments
It's interesting to look at the relationship between this and Apache Arrow.
"The data types generally have a 1-1 correspondence with the Apache Arrow data types." [1]
So it would probably be relatively simple to set up an Arrow Flight endpoint working with LanceDB.
[1] https://lance.org/format/table/#manifest
love the animations! I’ve been dreaming of doing the same to get people from csvs to something like Lance but with stops at page files, parquet, and Iceberg along the way