Edit Parquet Data Sources¶
Analysis Models - Power BI provides the opportunity to Edit the created Parquet Data Sources. All the Data Sources that are created and Loaded are in the Config layer, and these Data Sources can be edited.
The Parquet Data Source Details page displays the available edit options.
Editing columns¶
Selecting the Edit Columns button opens the Edit Data Source Columns assistant. It will display the default column selection of the respective Parquet Data Source (included /excluded) and enables further including and excluding of columns according to the preference.
Once the column editing is completed, selecting OK closes the Edit Data Source Columns assistant and updates the Oracle source columns section on the Parquet Data Source Details page.
As the column selection is completed, Loading can be performed to trigger an update of the .parquet file. This updates the Refresh History upon successful completion.
Editing Data Source details¶
In the Parquet Data Source Details page, the Edit icon enables the available data fields that can be edited.
| Field | Data Source Load Type | Scope of Modification |
|---|---|---|
| Max Age | Full & Incremental | The numerical value can be changed by typing in the new value. |
| Description | Full & Incremental | A description can be added. |
| Destination | Full & Incremental | The value(s) can be selected or deselected based on the requirement. (Visibility of the Destination values will depend on the available solution.) |
| DataPump Flush Size | Full & Incremental | The numerical value can be added or changed by typing in a new value. This value cannot be defined when creating the Parquet Data Source. Therefore it can be added or modified using the Edit option. For the Datapump Flush Size, if no value is set in the Parquet Data Source Details page but it is set in the Setup Parameters page, it will be initialized with the respective value of the Setup Parameters page. The effective flush size is logged in the Data Service Log with the log message as the below example where the DataPump Flush Size parameter is set to 100000: ''FlushSize initialized as: 100000''. Default Minimum value for Flush Size is 500. If the Datapump Flush Size value is set below 500 in the Parquet Data Source Details page, then the minimum value will be used as the Flush Size. The effective flush size is logged in the Data Service Log with the log message as the below example where the DataPump Flush Size is set to 200: "FlushSize initialized as: 500; FlushSize for DataSource is: 200 which is below minimum value of: 500 " If no value is set in the Parquet Data Source Details page and the Setup Parameters page for the Datapump Flush Size, the default value is 50000. |
| Partition Column | Incremental | The column can be changed by selecting via LoV. |
| Detect Changes Column | Incremental | The column can be changed by selecting via LoV. |
| Detect Changes Function | Incremental | The current selection can be changed if required. |
| Include Row Count | Incremental | The current selection can be changed if required. |
Editing Load type == Full
Editing Load type == Incremental
