no, it should not. The point of modern data warehouses like Snowflake is that you run the transformations in the warehouse, vs. some external transformation layer (think Informatica).
In the old approach, you would run the transform BEFORE loading data into the warehouse. The disadvantage of that approach is that you loose all fidelity of the raw data.
In the new approach (Airbyte's approach), you load the raw data into the warehouse, and then run your transform jobs in the warehouse. You can do that because modern warehouses are cheap and scalable. The benefit of that approach is that you keep your raw data with all its fidelity, opening up endless opportunities for exploratory slicing and dicing.
That's why it's called "ELT" (new) these days, to distinguish from "ELT" (old).
Comments
no, it should not. The point of modern data warehouses like Snowflake is that you run the transformations in the warehouse, vs. some external transformation layer (think Informatica).
In the old approach, you would run the transform BEFORE loading data into the warehouse. The disadvantage of that approach is that you loose all fidelity of the raw data.
In the new approach (Airbyte's approach), you load the raw data into the warehouse, and then run your transform jobs in the warehouse. You can do that because modern warehouses are cheap and scalable. The benefit of that approach is that you keep your raw data with all its fidelity, opening up endless opportunities for exploratory slicing and dicing.
That's why it's called "ELT" (new) these days, to distinguish from "ELT" (old).