4.2 Getting the objects and filtering

Navigate to the “Select Objects” tab.

If “FILE” was selected as Source Type, the

button will appear. This will allow you to upload your source files.

The following steps are the same regardless of the choice of Source Type.
Click

to have the application search all tables (and views) in the source.
You can track the progress by pressing the red button:

Once completed, refresh the list by clicking

and you should see all your objects appear.
Objects can be included by turning on the Selected Flag. To easily include all the objects that were found, click the tick mark next to Selected Flag:

The search bar can be used to filter on table name and include or exclude all tables in the current filter using the respective buttons. It is also possible to upload .csv files containing all the names of objects you want to include by clicking

Note the Exists in Source Flag. This flag will be set to “No” if the table was added to a release previously but is no longer found in the source.

If everything is correct, your screen should look somewhat like this:

The Excludes tab can be used to define a filter to exclude objects and attributes.

For example, if temp tables have to be excluded, navigate to the Objects subtab, select

and choose to exclude type “temp%”.

After adding the exclusion rule, an impact check can be done.

In the Attributes subtab, an exclusion rule for an attribute (e.g.
“update_timestamp”) can be chosen by pressing

This attribute will be removed from all objects in this source.

The Remove Object Name Patterns tab allows you to remove a pattern from the objects (e.g. if you have some tables with the prefix “tws_”), if they do not provide any additional information.

You can specify a pattern to remove by pressing

When ready, move on to the Releases & Builds tab.

Click

This may take a while to complete. Click the red button

to check the task status.
Creating a release consists of 3 tasks:

– Reading the metadata from your source with the agent.
– Sending the metadata from the agent to the cloud.
– Creating the release

After a while, refresh the running tasks overview to see if the task’s status has changed to “Done”.

Refresh the release screen by pressing the

button. A new release will now be visible.button. A new release will now be visible.

The Release status reads “WORK IN PROGRESS”, this means that this source is not yet finished. Once the source is complete, it will read “COMPLETED”. This means that it is ready to be included in your data vault. The lock icon shows whether the release has been locked in terms of objects, attributes and relation definitions, i.e. if the release is locked, its objects cannot be modified anymore.
When you click on the new release, several tabs will appear in the top bar.