Partial Model Update in IMDB
Suppose I have a single IMDB model, which feeds of different sources.
These sources may not be available in the same time, or may not update in the same time.
Right now, if I update a model, I have to do it using a specific model file.
It would be great if we could have the ability to only update some IMDB tables every time, and keep the others as they were.
Thank you
7 replies
-
Hi Mosche,
You can do this today using Master Flows.
This allows you to test conditions and run particular data flows depending on the outcome.
Check out the Office Hours recordings, there is at least one that covers this topic.
Hope that helps.
Ian
-
Hi Moshe,
Yes.
In your master flow, you create multiple data flows, each of which loads from different source. You then run none, one or more if them based on a variable value or other test set depending on if they exist etc.
Each data flow updates the same IMDB database, handling perhaps different tables.
You then create a Direct Query model into the same database that is the final model used by your users etc.
Remember that a Model is a description (optionally with data flows) or view of a database. Multiple models can point to the same physical database, IMDB or other SQL database.
Hope that helps.
Ian
-
Ian Macdonald said:
Each data flow updates the same IMDB database, handling perhaps different tables.Is this possible? when I tried, the model didn't include tables from more than one data flow.
Anyway I think the direction is clear, thank you very much.
-
Each Data Flow in the Master flow will have its corresponding Model (make sure you add the "Model" block to that data flow in the Master flow so that when you double click it, it can be edited in the Model tab - it's a bit confusing I know!) that will only contain the tables you want to manage in that flow. Each flow will therefore only update the tables contained in that flow's respective model. Taken together though, the combined flows will handle all tables in the database, but each flow will refer to a model that only contains the tables managed in that flow.
You now have (in your case) an IMDB database with all the tables required for your data set.
Create a new Model choosing IMDB as the data source and select the IMDB database managed by the flows in your master flow. Select all the tables and check the Direct Query check box.
Move onto the Model tab, define the table relationships required, aggregation rules, hierarchies etc. and save.
You now have a Model which addresses all your tables and can be used as the Model to query and analyse your data, while the orchestrated flows in your Master Flow model manages the data update.
Hope that helps.
Ian
-
Ian Macdonald That's terrific!
Thank you very much for the detailed answer.
-