What I don't like about these ACID storage layers is they reduce compatibility between different query engine. For example, Spark cannot read Hive ACID tables natively and Hive cannot read Spark Delta tables either. Then there's other tools such as Presto or Drill which can read neither.
When you use an ACID storage layer, you're kinda locked into one solution for both ETL and query, which is not nice.
Comments
What I don't like about these ACID storage layers is they reduce compatibility between different query engine. For example, Spark cannot read Hive ACID tables natively and Hive cannot read Spark Delta tables either. Then there's other tools such as Presto or Drill which can read neither.
When you use an ACID storage layer, you're kinda locked into one solution for both ETL and query, which is not nice.