Edit an In-Memory Model's Target Table?
With an In-Memory Model target table, is it possible to edit the table's records? For an example, we have a user who takes daily snapshots of data. One of their historical dates has duplicates and they would like to edit the table to remove the duplicates. It would be nice if there were a direct method to edit the target table.
2 replies
-
Pyramid does not (yet?) offer the option to manually edit data in a database, row by row, cell by cell. If you want to fix and clean the data, you should use its in-built data ETL tools or an external ETL application. Specifically, you can try the duplicate remover function to address your problem. Worst case, try and use the Python functionality to edit your data in the table.
-
Generally speaking - you should avoid editing Pyramid IMDB, it wasn't made to play the role of a materialized relational database.
That being said - for both IMDB and other databases, Pyramid Model doesn't offer editing existing data, however you can delete rows from the target database, and load them again using the data flow.In master flow - add a SQL Script component, and write the delete script for the rows you want to delete from the target. (If it is IMDB, make sure you check the "commit database changes" checkbox.
Then, create a data flow that will populate this table with the relevant rows - make sure the target is appended, not replaced.
Again - this should be done in a SQL database where data is saved, backed up etc. - doing this in IMDB is not recommended as it only lives in memory.