Published Release 3.0.0 (jailbreak) of Onesait Platform
EN | ES
General Info
On April 16, 2021, Release 3.0.0 of the Onesait Platform (JailBreak version) has been published, following our release policy.: Version Policy onesait Cloud Platform.
You can follow our roadmap at Roadmap onesait Platform
Below you can see the main features of this release.
Engine
This platform distribution supports the development of microservices and all types of applications. To assist in this type of development, the platform allows visual development with a LowCode approach incorporating a centralized web console that supports administration, configuration, development and deployment.
In this version we have incorporated important features:
New UX for the Control Panel after months of hard work in this version you will see a new graphic design of the Platform Control Panel adapted to the new version 3 of the ODS design system (Onesait Design System).
We are still working on the complete adaptation to this new graphic design, in future versions you will see a new UI for the main screens.
New Ontology Type Non-Persistent or Control Ontology: So far the concept of Ontology has represented the Entities managed by Platform and persisted in one of the platform repositories, although in many scenarios ontologies are used as "Control Ontologies" that allow us to trigger processes such as: Launching a Rule, Execution of a Flow from FlowEngine, Execution of a Pipeline from DataFlow, Communication with Broker Kafka for insertion and notification...For this we have created the concept of Non Persistent Ontology/Control Ontology, which is a new type of ontology that will not be persisted but will trigger all the processes that can be launched in platform after insertion of an ontology. It can be created from the Advanced Settings option when creating an ontology:
ç
Centralized log integrated in Control Panel: in the previous release we integrated Graylog as a solution to centralize the platform logs and in turn be used by the solutions built on platform. In this release we have integrated Graylog's powerful UI with the Control Panel allowing access to admin users. We have also made available its REST API as you can see here.
Keycloak integration as Identity Manager Advanced: although this functionality was completed in Q4 we have included functionalities that you requested. Platform includes an Identity Manager built on top of Spring Cloud Security that covers typical security use cases such as authentication, authorization, realms, plugins, ..... We have integrated Keycloak as an alternative Identity Manager for advanced scenarios, mapping Keycloak realms with platform verticals, Keycloak Clients with Platform Realms and as default Provider the platform ConfigDB (although LDAP can also be used).
More information about integration in this guide: Soporte a Keycloak como Identity Manager Avanzado
Kafka Platform Broker updated to Kafka Confluent Version 6.1.1: Kafka, Zookeeper and KSQL (now KsqlDB) have been updated to Confluent version 6.1.1, with this update we now have Kafka version 2.7.0.
Adjustments to the deployment of microservices on Onesait DevOps: the deployment of microservices on Onesait DevOps has been adjusted so that the user of this functionality does not need to configure more than the essential. You can take a look at the use of this functionality here
New configuration options in integration with Elasticsearch: The configuration possibilities of ontologies defined on Elasticsearch have been increased allowing the configuration of Shards and Replicas for each ontology as well as the configuration of Templates (to store audit data, logs, timeseries, etc.). Elasticsearch recommends creating several indexes per time block, especially if the data is more or less homogeneous per time block. For example, create an index per month, or per week, or per day, etc.). More details at this post.
Intelligence
This distribution of the platform supports the development of systems that use the capabilities of Platform Intelligence, either with its AI capabilities, ingest from different sources, analytics, visualization,....
And in this quarter we have worked on this:
New Data Lineage Tool: extending our Data Governance capabilities (and what is yet to come!) we have incorporated this functionality to query the relationships of an element (Ontology, Dashboard...) with all the other elements of the Platform, which will help to give a global view of the impact that a change in one of the elements of the lineage may have. A new menu item DATA GOVERNANCE has been created with this option:
which allows to show the traceability on the selected ontology:
At this post we explain how to use it.
New Version of the Rules Engine: the functionality of the Rules Engine has been extended according to the requests you have sent us.
In this version, rules can be defined through decision tables that can be loaded through the UI. You can see details in this post.
In addition, a utility is available in the engine to consult ontologies, which will allow us to cross-reference the input data to the rule with other context conditions. (details here)
Test testing capabilities have also been improved. (see more).
New version of the Python client library has been published a new version of Python client library (1.4) which includes several new features, including the BaseModelService class that supports easy training, retraining, deployment and model inference., you can see an example here.
Wrapper to create Models on Notebooks: In this platform version, in collaboration with the Onesait Data team, improvements have been included in the Python client allowing among other functionalities to store/retrieve in a transparent way the files of the models generated by the trainings in the File Repository, to use ontology data as input data of the models, to manage an ontology of meta-information of the different associated models and the retrieval of the most accurate model.. In addition to this, a complete tutorial has been prepared on its use in Notebooks for Model creation. as you can read in this guide.
Favorite Gadgets in Dashboards: this feature allows each user to assign favorite gadgets so that they can then quickly add them to their dashboards.
These favorite gadgets can be represented as drag and drop components and dragged on top of our dashboards to add them to our dashboards.
Update of the component that supports DataFlow: in this release the Streamsets version has been updated from 3.10 to 3.18.1, which includes several improvements in the nodes of the Streamsets own libraries, among them
This new version includes the orchestrator library that will allow us to plan the execution of flows of Dataflow instances deployed on the platform., including Cron Scheduler:
Improvements in the creation of ontologies on external databases Until this release, it was only possible to generate ontologies from external databases that came directly with the connection (and, therefore, forcing to include the database and/or schema, depending on the database type, in the connection url). With the new platform version, it is possible to choose the database and/or schema (as applicable in each database) before selecting the table.
More details in this post.
Things
This platform distribution supports the development of IoT systems, both in the Cloud and Edge environments.
In this quarter we have made progress in:
Dashboard Broker: Integrated with Prometheus and Grafana, the version of IoT / Edge HUB included in this release now provides a tool for monitoring the IoT / Edge Broker based on EQMX.v.4.0. With a complete set of KPIs already packed, it is possible to easily view parameters such as: number of connected clients, number of messages exchanged, current message reception concurrency per second, load of Erlang cluster nodes, etc.
Project creation wizard: It is now possible to create IoT/Edge Computing projects in Things through an intuitive wizard. It will guide you for associating and registering devices, connecting container registries, editing edge device operating commands, setting Gitlab / Gitea repositories for configuration and code base.
Landscape improvement: in this new version the visibility of device landscape availability has been improved, providing information on the control and business communication channels, the device-2-cloud and cloud-2-device information, Unique identification (urn) following the RFC-8141 standard has been included, QRs are also provided (url for device information access) and a set of context tips have been added that provide help on dealing with devices.
Connectors for DataFlow and FlowEngine: The feature for defining bi-directional connectors to Data Flow and FlowEngine has been added. This allows automatic ingest of device measurements and command routing using simple ontologies models. The transports of these two connectors are carried out securely over TLS> = 1.2 and user secrets of configurable cryptographic algorithms.
Docker Registry.v.2 Browser: now explore the image registry integrated with IoT / Edge HUB for at the edge containers it's possible, check versions, sizes, analyze the different layers and automatically select the tags to be included in your deployment projects. Verify the upload of your images and the status of the versions in a simple way.
KMS-Vault: a whole new section for the management of the life cycle of keys and secrets has been added. Thanks to this new module, it is possible to generate a large number of cryptographic tokens, their secure storage in HMS (hardware and software) and to ensure regulatory compliance in the protection of distributed digital assets. Things uses this module to protect devices and communications.
DevOps
Within this line of work we include all the tools, utilities and platform capabilities that assist in Development and Operation.