Data Source window
Admin |
ETL > ETL Domains > Data Source
Note: if the ETL domain is locked, the window will open in read-only mode.
Purpose of window¶
This window allows you to define the data sources from which to extract the values.
Actions on this page
| Element | Description |
|---|---|
| This filters the data shown on the page. | |
| This adds a row in order to insert a new Data Source | |
| This duplicates the selected row with all the information inserted, except for the code. | |
| Deletes the element contained in the selected row. | |
| Enables/Disables the grid modify function. This allows you to change the characteristics of the selected elements directly in the table, and to hide the configuration tabs. | |
| Enables multi-row selection to allow mass changes. | |
| Selects the columns to be shown/hidden in the table and those to be locked when scrolling the table. | |
| Exports the data in Excel format so they can be edited and reimported into CCH Tagetik. | |
| Imports data from a previously prepared Excel file. | |
| Copy from: this attributes the characteristics of another data source of choice to the selected data source. |
Attributes tab
| Field | Description |
|---|---|
| Code | Identification code of the data source to be used in the extraction tasks |
| Description | Data source description |
| Link | Description |
|---|---|
| Fields definition | opens the Data source fields definition window, where it is possible to relate the values contained in the data sources defined by the selected data source to the dimensions of the ETL domain. |
Files tab
This tab allows you define File type data sources for the selected data source.
Note: To complete the activation of certain types of data source, it is necessary to fill out additional fields.
| Data source | Available options |
|---|---|
| Excel files | Excel (xls) enables the possibility of extracting data from an Excel (xls) file. The file must have a defined data area that contains a header record and the records of values. The name of the data area must be reported, paying attention to uppercase and lowercase, in the Excel (xls) area field. Excel (xlsx) enables the possibility of extracting data from an Excel (xlsx) file. The file must have a defined data area that contains a header record and the records of values. The name of the data area must be reported, paying attention to uppercase and lowercase, in the Excel (xlsx) area field. |
| Text files | - Fixed length: enables data to be extracted from a text file with a fixed length. Every record must always contain the same number of characters, every item of information must always start from the same position (index of the character within the record) and must have the same number of characters; if the length, in characters, of the value is not equal to the number of characters reserved for the information item, space characters must be added (before or after, depending on whether you want to give the value numerical formatting) so that the subsequent information item starts in the pre-established position. In this option, the Record types link is active: it allows you to define the Record types if the file to be extracted includes records that are not related to the values to be extracted but contain additional information that will automatically define certain fields of the Staging table for every record extracted from the file - Text Delimited: enables the possibility of extracting data from a Text delimited file. In this type of text file, the records may have different lengths, in characters, but they must always be separated by a specific character defined in the Separator field. - Tab Delimited enables data to be extracted from a Text tab delimited file Charset: field dedicated to text files, which allows you to indicate the character coding with which the same file was created. This information will be used in the extraction step to correctly interpret the processed characters. If not defined, the system will try to detect the charset automatically. |
| Other files | Xml enables the possibility of extracting data from an Xml (eXtensible Markup Language) file with a pre-established structure. The file must be made up of a root and as many tags, with the same name, as there are records to be extracted; the tag name must be defined in the Xml node field. Each tag must contain as many sub-tags as there are items of information to be extracted; the sub-tags are all repeated, identically, for each tag The names of these tags must then be related to the dimensions in the data source fields definition. Xbrl enables data to be extracted from a standard zip file containing information related to the Xbrl. You can tell the system what information is contained in the file by selecting, for the Xbrl type field, the Item, Context and Instance values. |
Database tab
This tab allows you to define database type data sources for the selected data source.
| Data source | Available options/fields |
|---|---|
| CCH Tagetik | CCH Tagetik database option: enables data to be extracted from the CCH Tagetik database. Field CCH Tagetik database type: indicates the extraction type: - Object: from Table or from View as indicated in the CCH Tagetik database table field. - Query: from a query indicated in the CCH Tagetik database query field. ETL’s dynamic syntax can be used when writing the query (see ETL syntax). |
| Other | Other database option: enables data to be extracted from another database Other database connection field defines the JDBC connection. Other database type field: indicates the extraction type: - Object: from Table or from View as indicated in the Other database table field. - Query: from a query indicated in the Other database query field. The ETL’s dynamic syntax can be used when writing the query (see ETL syntax). |
OData service tab
This tab allows you to define Odata type data sources for the selected data source.
| Data source | Available options |
|---|---|
| Data service | This enables the possibility of extracting data from an OData service by defining: - EntitySet name: the name of the entity displayed by the OData service - Query option: the query options to be specified using the standard OData syntax |
Note: in the ETL job extractions or execution definition step, it will be possible to select the OData type Endpoint on which the service URL is defined, as well as any authentication method.
Rest API tab
This tab allows you to define REST API type data sources for the selected data source.
| Data source | Available options |
|---|---|
| REST API | REST API: enables data to be extracted via a REST API service; in the Query option field, the syntax is defined by the API |
Note: in the ETL job extractions or execution definition step, it will be possible to select the REST API type Endpoint on which the service URL is defined, as well as any authentication method.