Loading data from external datasources onto Analytical Workspace
Introduction¶
This module describes the data processing that allows data from external datasources such as calculation files or databases to be loaded onto the physical partitions of the Analytical Workspace datasets in the following contexts:
- scheduling of data processing via application jobs
- integration of data processing between process workflow tasks
- execution of processing when closing a data entry web form
- inclusion of data processing in the Data Transformation Package
For the data upload to be successful, the following conditions must be fulfilled:
- the datasource mapping must exist for an Analytical Workspace dataset
- the dimensions of the dataset must have been mapped to the specific dataset and the data loading mode defined
Use in the application job¶
Below is the list of parameters required for configuration.
| Parameter | Description |
|---|---|
| Analytical Workspace | Allows you to indicate the Workspace to which the target dataset belongs |
| Analytical Workspace Dataset | Allows you to indicate the target Dataset belonging to the previously selected Workspace. |
| Analytical Workspace Dataset typology | Allows you to specify the dataset type selected previously. |
| Datasource | Necessary to obtain the mapping on which both the loading mode on the Analytical Workspace and the relationship between the dimensions of the datasource and those of the dataset are defined. |
All these parameters are mandatory.
The following parameters are instead necessary both to identify the partition of the dataset on which to write the data and for editability checks before uploading to the Analytical Workspace:
- Process, mandatory
- Scenario, mandatory if the selected process is scenario / period submission.
- Period, mandatory if the selected process is scenario / period submission.
- Entity, optional, cannot be defined if Entity Hierarchy and Entity Node have been defined.
- Entity hierarchy, optional, cannot be defined if Entity has been defined.
- Entity Node, optional, cannot be defined if Entity has been defined; it is mandatory if Entity Hierarchy has been defined.
Note: At runtime, if the datasource configuration requires the value of Aanalytical workspace or reporting parameters to be specified, a blocking error is returned that does not allow the job to be executed.
Use in the process workflow task¶
Below is a list of the parameters required for setting up data processing as a task in a workflow task (see Create a task workflow and the relative tasks).
| Parameter | Description |
|---|---|
| Analytical Workspace | Allows you to indicate the Workspace to which the target dataset belongs. |
| Analytical Workspace Dataset | (Mandatory) Allows you to indicate the target Dataset belonging to the previously selected Workspace. |
| Analytical Workspace Dataset typology | (Mandatory) Allows you to select the previously selected dataset type. |
| Analytical Workspace Dataset Datasource | (Mandatory) Indicates the datasource mapping belonging to the previously selected dataset on which both the loading mode and the relationship between the datasource and dataset dimensions are defined. |
| Process, Scenario, Period, Entity, Hierarchy and Node | They are automatically inherited by the execution context and are needed both for editability checks and to identify the partition of the dataset. |
Note: At runtime, if the datasource configuration requires uploading a file, or specifying the value of Analytical Workspace or Reporting parameters, a dedicated window pops up.
Data processing run when saving a form¶
Below is the list of parameters required for configuration.
| Parameter | Description |
|---|---|
| Analytical Workspace Dataset typology | (Mandatory) Allows you to indicate the dataset type on which to load data. |
| Analytical Workspace Dataset Datasource | (Mandatory) Required to obtain the mapping on which the loading mode on the Analytical Workspace and the relationship between the dimensions of the datasource and those of the dataset are defined. |
| Process, Scenario, Period, Entity, Hierarchy and Node | They can either be inherited automatically from the form or entered manually and are needed both for editability checks and to identify the partition of the dataset. |
Note: At runtime, if the datasource configuration requires you to specify the value of Analytical Workspace or Reporting parameters, a dedicated window pops up.
Data processing run in a Data Transformation Package (DTP)¶
It is possible to run the data processing by inserting it within a Data Transformation Package either by uploading it to Analytical Workspaces (see Data Transformation Package (DTP) and Loading to Analytical Workspace) or by uploading it via Write to another dataset.