MinIO+Presto as Historical Database for Entities

Available as of version 3.1.0

EN | ES

How to use?

Onesait Platform allows entities to be generated on a historical database supported by MinIO + Presto.

The data of these entities are stored in files in MinIO, which can be consulted through the Presto distributed queries engine. +Info: https://onesaitplatform.atlassian.net/wiki/spaces/OP/pages/1968570383

This type of Entities can be accessed from the menu: Development → My Entities

 

From this option you can access the list of entities, where you must click on the '+' button:

 

 

This will take us to the screen for the creation of different types of entities in which we must click on the corresponding option:

Once this is done, the form for the creation of the entity on the historical database appears.

As in other entities we must fill in the mandatory fields (name, meta-information, description), and add one by one the fields that we want our entity to contain through the UI:

The next step is to select the format of the file in which we want the data to be saved in the entity or the file to be uploaded:

If no option is selected, the data will be stored in ORC format.

Likewise, if we want to store in CSV, the escaping, quotation marks and separator characters must be indicated, if they are not indicated, the default values will be taken. This is very important when uploading a file so that the data is readable by the engine.

There is also the option to partition the data by selecting one or more fields of the entity we want to create. These must be the last fields in the creation query and be in the same order:

Once the data that apply to the entity to be created have been filled in, click on the 'Update SQL' button to generate the query to create the table that can be edited:

After this, you must generate the JSON schema that will allow you to create the entity on the platform by clicking on the 'Generate Schema' button:

When clicking on the 'Create' button, if the entity has been generated correctly, a popup will appear allowing us to upload a file to the database:

This option is also available in the entity edition, through the 'Upload file to Entity' button.