Published Release 3.0.0 (jailbreak) of Onesait Platform

Owned by DevPortal Editor (Unlicensed)
10/09/21
10 min read

EN | ES

General Info

On April 16, 2021, Release 3.0.0 of the Onesait Platform (JailBreak version) has been published, following our release policy.: Version Policy onesait Cloud Platform.

You can follow our roadmap at Roadmap onesait Platform

Below you can see the main features of this release.

Engine

This platform distribution supports the development of microservices and all types of applications. To assist in this type of development, the platform allows visual development with a LowCode approach incorporating a centralized web console that supports administration, configuration, development and deployment.

In this version we have incorporated important features:

  • New UX for the Control Panel after months of hard work in this version you will see a new graphic design of the Platform Control Panel adapted to the new version 3 of the ODS design system (Onesait Design System).

We are still working on the complete adaptation to this new graphic design, in future versions you will see a new UI for the main screens.


  • New Ontology Type Non-Persistent or Control Ontology: So far the concept of Ontology has represented the Entities managed by Platform and persisted in one of the platform repositories, although in many scenarios ontologies are used as "Control Ontologies" that allow us to trigger processes such as: Launching a Rule, Execution of a Flow from FlowEngine, Execution of a Pipeline from DataFlow, Communication with Broker Kafka for insertion and notification...For this we have created the concept of Non Persistent Ontology/Control Ontology, which is a new type of ontology that will not be persisted but will trigger all the processes that can be launched in platform after insertion of an ontology. It can be created from the Advanced Settings option when creating an ontology:

ç


  • Centralized log integrated in Control Panel: in the previous release we integrated Graylog as a solution to centralize the platform logs and in turn be used by the solutions built on platform. In this release we have integrated Graylog's powerful UI with the Control Panel allowing access to admin users. We have also made available its REST API as you can see here.

More info here.


  • Keycloak integration as Identity Manager Advanced: although this functionality was completed in Q4 we have included functionalities that you requested. Platform includes an Identity Manager built on top of Spring Cloud Security that covers typical security use cases such as authentication, authorization, realms, plugins, ..... We have integrated Keycloak as an alternative Identity Manager for advanced scenarios, mapping Keycloak realms with platform verticals, Keycloak Clients with Platform Realms and as default Provider the platform ConfigDB (although LDAP can also be used).

 

 More information about integration in this guide: Soporte a Keycloak como Identity Manager Avanzado


  • Kafka Platform Broker updated to Kafka Confluent Version 6.1.1: Kafka, Zookeeper and KSQL (now KsqlDB) have been updated to Confluent version 6.1.1, with this update we now have Kafka version 2.7.0. 


  • Adjustments to the deployment of microservices on Onesait DevOps: the deployment of microservices on Onesait DevOps has been adjusted so that the user of this functionality does not need to configure more than the essential. You can take a look at the use of this functionality here


  • New configuration options in integration with Elasticsearch: The configuration possibilities of ontologies defined on Elasticsearch have been increased allowing the configuration of Shards and Replicas for each ontology as well as the configuration of Templates (to store audit data, logs, timeseries, etc.). Elasticsearch recommends creating several indexes per time block, especially if the data is more or less homogeneous per time block. For example, create an index per month, or per week, or per day, etc.). More details at this post.

Intelligence

This distribution of the platform supports the development of systems that use the capabilities of Platform Intelligence, either with its AI capabilities, ingest from different sources, analytics, visualization,....

And in this quarter we have worked on this:

  • New Data Lineage Tool: extending our Data Governance capabilities (and what is yet to come!) we have incorporated this functionality to query the relationships of an element (Ontology, Dashboard...) with all the other elements of the Platform, which will help to give a global view of the impact that a change in one of the elements of the lineage may have. A new menu item DATA GOVERNANCE has been created with this option:

which allows to show the traceability on the selected ontology:

At this post we explain how to use it.


  • New Version of the Rules Engine: the functionality of the Rules Engine has been extended according to the requests you have sent us.
    In this version, rules can be defined through decision tables that can be loaded through the UI. You can see     details in this post.


In addition, a utility is available in the engine to consult ontologies, which will allow us to cross-reference the input data to the rule with other context conditions. (details here)

Test testing capabilities have also been improved. (see more).


  • New version of the Python client library has been published a new version of Python client library (1.4) which includes several new features, including the BaseModelService class that supports easy training, retraining, deployment and model inference., you can see an example here.


  • Wrapper to create Models on Notebooks: In this platform version, in collaboration with the Onesait Data team, improvements have been included in the Python client allowing among other functionalities to store/retrieve in a transparent way the files of the models generated by the trainings in the File Repository, to use ontology data as input data of the models, to manage an ontology of meta-information of the different associated models and the retrieval of the most accurate model.. In addition to this, a complete tutorial has been prepared on its use in Notebooks for Model creation. as you can read in this guide.


  • Favorite Gadgets in Dashboards: this feature allows each user to assign favorite gadgets so that they can then quickly add them to their dashboards.

These favorite gadgets can be represented as drag and drop components and dragged on top of our dashboards to add them to our dashboards.


  • Update of the component that supports DataFlow: in this release the Streamsets version has been updated from 3.10 to 3.18.1, which includes several improvements in the nodes of the Streamsets own libraries, among them  

    This new version includes the orchestrator library that will allow us to plan the execution of flows of Dataflow instances deployed on the platform., including Cron Scheduler:

Details here.


  • Improvements in the creation of ontologies on external databases Until this release, it was only possible to generate ontologies from external databases that came directly with the connection (and, therefore, forcing to include the database and/or schema, depending on the database type, in the connection url). With the new platform version, it is possible to choose the database and/or schema (as applicable in each database) before selecting the table.

More details in this post.

Things

This platform distribution supports the development of IoT systems, both in the Cloud and Edge environments.

In this quarter we have made progress in:

  • Dashboard Broker: Integrated with Prometheus and Grafana, the version of IoT / Edge HUB included in this release now provides a tool for monitoring the IoT / Edge Broker based on EQMX.v.4.0. With a complete set of KPIs already packed, it is possible to easily view parameters such as: number of connected clients, number of messages exchanged, current message reception concurrency per second, load of Erlang cluster nodes, etc.


  • Project creation wizard: It is now possible to create IoT/Edge Computing projects in Things through an intuitive wizard. It will guide you for associating and registering devices, connecting container registries, editing edge device operating commands, setting Gitlab / Gitea repositories for configuration and code base.


  • Landscape improvement: in this new version the visibility of  device landscape availability has been improved, providing information on the control and business communication channels, the device-2-cloud and cloud-2-device information,  Unique identification (urn) following the RFC-8141 standard has been included, QRs are also provided (url for device information access)  and a set of context  tips have been added that provide help on dealing with devices.


  • Connectors for DataFlow and FlowEngine: The feature for defining bi-directional connectors  to Data Flow and FlowEngine has been added. This allows automatic ingest of device measurements and command routing using simple ontologies models. The transports of these two connectors are carried out securely over TLS> = 1.2 and user secrets of configurable cryptographic algorithms.

  • Docker Registry.v.2 Browser: now  explore the image registry integrated with IoT / Edge HUB for at the edge containers it's possible, check versions, sizes,  analyze the different layers and automatically select the tags to be included in your deployment projects. Verify the upload of your images and the status of the versions in a simple way.


  • KMS-Vault: a whole new section for the management of the life cycle of keys and secrets has been added. Thanks to this new module, it is possible to generate a large number of cryptographic tokens, their secure storage in HMS (hardware and software) and to ensure regulatory compliance in the protection of distributed digital assets. Things uses this module to protect devices and communications.

DevOps

Within this line of work we include all the tools, utilities and platform capabilities that assist in Development and Operation. 

  • Helm Charts for Onesait Platform CE: Helm allows you to package the Onesait Platform deployment to be deployed in Kubernetes, allowing you to "clone" your files or manifest, such as Deployment, Service, PersistentVolumeClaim, Ingress, Secret, etc... in Helm templates or Templates and packaged in a Chart. In this version we have released the code of a Helm chart to be able to deploy the Community Edition of Onesait Platform on k8s. You can fin code on github and on Artifact HUB:


  • Stack for advanced Platform Monitoring: another new feature of this version, in terms of Operation, is the integration of advanced monitoring tools of the different modules of the Platform (or external to the Platform), for this purpose the stack has been chosen formed by: Telegraf as a metrics collector agent from different sources (Mysql, Mongo, Redis, Apache, Cassandra, etc...), InfluxDB as a TimeSeries database in charge of storing the metrics sent by the Telegraf agent and Grafana, as a tool to visualize the InfluxDB metrics.


  • Certification of the Platform under OpenJDK 15: another new feature of the Platform in this first Q of 2021 is the certification of the Platform on OpenJDK 15, on demand and in those environments where it is required. This version is the Open Source implementation of Java SE version 15, it is offered with GNU open source license, but the commercial version with support (GA) is also offered since September 2020. 


  • Migration from Platform-integrated Elasticsearch to OpenDistro for ElasticSearch: The free version of Elasticsearch provided by Elastic, which is its developer, does not have many basic features that are necessary for a production deployment. For example, it does not have security or SSL support for communications,... Therefore we have integrated OpenDistro platform, which is a distribution of Elasticsearch with Apache 2.0 license that does include security, ssl support, SQL support, it is also maintained by Amazon and is the version used by AWS. 


  • New TRAINING section in documentation: in this release we have created new documentation for the TRAINING sessions, a basic, an advanced and an operation training, containing a presentation to guide the training and a set of video tutorials to explain each topic:


These manuals are available to users with an active platform subscription.

Onesait Platform Community

This line of work includes the tasks we carry out in relation to the Platform Community, of which the Open Source version of Onesait Platform forms part, as well as the Platform's different communication channels.

Throughout this first quarter of 2021, we have worked on:

  • Curitiba Smart Hack: we have participated in the realization of this event at Brasil, providing logistical support on the Platform, as well as conducting a two-and-a-half hour training workshop in Portuguese, which was attended by over 100 participants:


  • Onesait Platform Webcast: this quarter we have conducted two webcasts:
    • One with the new features of the 2.3.0 release of the Platform:


    • this one on the management of Digital Twins in the Onesait Platform:

If you want to keep up to date with our webcasts, be sure to sign up at our Meetup Community, where there are already +700 subscribers.

  • Community Channels: we continue to grow in social networks and our web channels. During the quarter we reached the following milestones:
    • We have surpassed 1,000 users in our environment CloudLab, wih +100 new users in this period.
    • We grew by +35 new subscribers in our YouTube channel, surpassing 130 total subscribers, totaling +210 hours of viewing and achieving +12,000 impressions during this quarter.
    • We reached 70 cloning operations in GitHub of our Community version of the Platform, with up to 244 developers following the project.
    • We continue writing in DZone with two new publications (Making a Dashboard About COVID-19 in Portugal and Map Viewers: Main Open Source Libraries) and +48,000 readings of our articles.
    • We maintain the pace of publication in our Blog, with 49 new entries and +21,000 quarterly readings.
    • Finally, we continue to grow in Twitter, reaching almost 52,000 impressions.
  • CloudLab Environment updated with last quarter's version (version 2.3-immortal).