PUBLICADA RELEASE 2.19.0 DE SOFIA2

Ya está disponible la release 2.19.0 deSofia2, esta release también se ha disponibilizado en la Plataforma de Experimentación Sofia2CloudLab.

Ver releases

Esta versión añade a la Plataforma las siguientes funcionalidades:

· Dashboards y Gadgets v3.0:

En esta release se ha hecho una revisión completa de esta funcionalidad añadiendo grandes mejoras que permiten construir auténticos cuadros de mando operacionales al estilo BAM.

Los nuevos Gadgets son completamente personalizables, permiten añadir funciones, transformaciones, representar diversos valores,…

Sofia2 Tutorial 5: Creacion de Gadgets

Se soporta el paso de parámetros al Gadget, de modo que se le pasen un conjunto de parámetros para renderizar:

Se ha incluido un nuevo Gadget Tabla:

También se soporta la funcionalidad Maestro-Detalle de modo que un Gadget tipo Tabla actúe de maestro para otro Gadget de visualización:

Sofia2 Tutorial 7: Creacion Gadget Tabla e Interaccion otros Gadgets

Los nuevos Dashboards son más sencillos de manejar y soportan un gran número de layouts.

Desde uno sencillo:

A un gran Dashboard:

Sofia2 Tutorial 6: Creacion de un Dashboard

· Entorno Integrado CloudLab con Sofia2+eVidens:

En nuestro Entorno de Experimentación gratuito se ha disponibilizado una versión integrada de ambas Plataformas.

y también se usa en el Portal Smart Coruña como visor web.

eVidens es un sistema integral de visualización avanzada e interactiva que permite una gestión de información geolocalizada asociándola a un entorno de visualización tridimensional y multimedia.

eVidens está completamente integrado con Sofia2 a través de un conector (en este post se explica la integración entre ambos productos: Cómo crear un Visor eVidens a partir de una Ontología Sofia2).

· Soporte Informes multiformato:

La Plataforma añade soporte para crear informes sobre el potente motor de Informes JasperReports. JasperResports es el motor de informes open-source más usado, y permite generar informes en formatos como PDF, HTML, Word, OpenOffice, Excel,…

Estos informes pueden crearse a través de cualquier de los editores visuales que soporta el motor (nosotros usamos iReport Designer) atacando a la BDTR y BDH de Sofia2.

Una vez creados los informes pueden cargarse en Sofia2 desde la propia Consola Web

y ejecutarlos desde la consola:

se pueden pasar los parámetros que requiera el informe:

El resultado del lanzamiento de un informe puede generarse en diversos formatos:

Los informes generados puede también almacenarse en la Plataforma para su posterior explotación

Un usuario puede otorgar permisos sobre sus informes a otros usuarios:

Sofia2 Tutorial 8: generación de informes

· Simulador de datos

Esta sencilla pero potente herramienta Web será de mucha utilidad a la hora de poder probar integraciones entre diversos verticales a través de Sofia2.

Permite generar datos (instancias de Ontologías) en función a unas reglas que se definen vía web.

E indicar el generador asociado a cada atributo:

En este vídeo se muestra

Sofia2 Tutorial 4: Creacion y lanzamiento de datos sobre un Widget

· Soporte BDTR sobre Base de datos relacional completo:

Esta release completa la funcionalidad que permite de forma transparente usar Sofia2 no sólo sobre MongoDB como BDTR si no sobre cualquier base de datos relacional con driver JDBC (Oracle, MySQL, PostgreSQL, SQLServer,..)

En estos videotutoriales pueden verse algunos ejemplos:

Soporte BDTR Relacional 1: Creacion de Ontologias

Soporte BDTR Relacional 3: Insercion desde el CRUD

Soporte BDTR Relacional 2: Insert Nativo

· Creación de diversos webcasts sobre el uso de la Plataforma:

En el Canal de Youtube de Sofia2 se han disponibilizado varios videotutoriales sobre cómo usar las diversas capacidades de la Plataforma, desde generación de Dashboards, creación de ontologías, uso del CRUD, visualización de ontologías en el Visor Holístico eVidens,…

Estos vídeos permiten de forma rápida hacerse una idea de lo sencillo que es usar Sofia2 incluso para funcionalidades complejas.

· Migración a MongoDB 3 en Entorno CloudLab:

En el entorno CloudLab de Sofia2 se ha actualizado la versión de MongoDB usada en la BDTR a la release 3.0. Esta versión de MongoDB aporta grandes mejoras en rendimiento.se usa como BDTR la versión 3 de MongoDB, que ofrece grandes mejoras a nivel de rendimiento entre otras:

PUBLICADA RELEASE 2.19.0 DE SOFIA2

SOFIA2 RELEASE 2.19.0 PUBLISHED

Sofia2 new release 2.19.0 is now available. This release has also been deployed in the experimentation platform Sofia2 CloudLab.

View releases

This new version adds the following features to the platform:

· Dashboards and Gadgets v3.0:

On this release it has been made a complete functionality review, adding great features that allow to compose fully operational BAM style dashboards.

New functionalities include gadgets fully customizable, javascript-like function included, transformations, muti values display,…

Sofia2 Tutorial 5: Gadget Creation

It is allowed to pass arguments to Gadgets. This way gadgets can be configured on an initial state when rendering:

It has been included a new Table Gadget:

Master-Detail relationship is supported now. This way Table like gadgets act as data controller for a detail visualization:

Sofia2 Tutorial 7: Table Gadget Creation and Gadgets Interaction

New Dashboards are easy to handle and admit several layout variations.

In example, a simple layout:

Or a complex Dashboard:

Sofia2 Tutorial 6: Dashboard Creation

· Integrated CloudLab Environment Sofia2+eVidens:

It is been released a new integrated version of both platforms on the free Experimentation Platform.

and it is also used on Smart Coruña Portal as a web viewer.

eVidens is an advanced integral visualization and interaction system that allows a geolocated information management on a multimedia and 3D environment.

eVidens is whole integrated with Sofia2 through a connector (it is explained on this post how integration was made on both products: Cómo crear un Visor eVidens a partir de una Ontología Sofia2).

· Multiformat Reports Support:

Platform adds support to create reports using a powerful report engine JasperReports. JasperResports is a widely used open-source motor engine, and allows to generate reports using different formats like PDF, HTML, Word, OpenOffice, Excel,…

Those reports can be created through several visual editors supported by Jasper engine (for example iReport Designer) wich is connected to Sofia2 RTDB and HDB.

When reports are created they can be loaded on Sofia2 through Web Console, where can be executed. Web Console allow to pass required parameters.

Report results can be stored on Sofia2 platform for a later analisys.

· Data Simulator

This simple yet powerful web tool will be very useful when testing integrations between different vertical through Sofia2.

This tool allows to generate data (instances of ontologies) based on rules that are defined via the web.

And indicate the generator associated to every attribute:

This video shows

Sofia2 Tutorial 4: Creation and launch of data on a Widget

In this release there has been included a random data generator, to insert in ontologies instances of the ontology from time to time. It has several generators for each type predefined:

They can be modified and new ones can be created from these:

At the bottom of the form, we have all the ontology fields where for each one, you can select your own field generator. Under the scheme we can view the instance that was generated at the time, as well as the Start / Stop button to generate instances:

· Complete Support RTDB on relational Databases:

This release completes the functionality that allows the transparent use of Sofia2 not only on MongoDB as BDTR also on any relational database with JDBC driver (Oracle, MySQL, PostgreSQL, SQLServer, ..)

In these video tutorials you can see some examples:

Soporte BDTR Relacional 1: Create Ontologies

Soporte BDTR Relacional 3: Insert from CRUD

Soporte BDTR Relacional 2: Native Insert

· Creation of various webcasts about the use of the Platform:

In YouTube Channel Canal de Youtube de Sofia2 there are several video tutorials on how to use different capabilities of the platform, from Dashboard generation, ontology creation, use of the CRUD, visualization of ontologies in the Evidens Holistic Viewer, …

These videos allow to quickly get an idea of how easy it is to use Sofia2 even for complex functionalities.

· Migration in the CloudLab Environment MongoDB 3:

The Sofia2 CloudLab environment has been updated to the version of MongoDB BDTR 3.0. This version of MongoDB provides significant improvements in performance.It is used as BDTR version 3 of MongoDB, offering major improvements in terms of performance included:

SOFIA2 RELEASE 2.19.0 PUBLISHED

Cómo crear un Visor eVidens a partir de una Ontología Sofia2

En estos webcasts se muestra el proceso de creación de un visor eVidens a partir de información cargada en la Plataforma Sofia2. Como podéis ver la integración eVidens-Sofia2 es completa y permite visualizar de forma inmediata en el Visor Holístico información Sofia2.

A continuación se muestran los 4 pasos a seguir:

1. Generación de Ontología y carga de datos: en nuestro caso lo haremos través de un Excel que contiene datos de SmartBenchs en la ciudad de Barcelona. Ver vídeo

2. Creación de Visor eVidens: desde la consola de administración crearemos de forma sencilla un Visor eVidens. Este Visor de momento sólo tendrá cargada la ortofoto. Ver vídeo.

3. Creación de Recurso eVidens: un recurso eVidens sería el equivalente a una Capa. Este recurso va a cargar información de una ontología Sofia2. En el recurso podemos definir la consulta que se ejecutará sobre la BDTR Sofia2 de esa ontología: Ver vídeo

4. Lanzamiento Visor eVidens: una vez creado el visor y asignado el recurso ya puedo lanzar el Visor eVidens. Ver vídeo.

Además se ha disponibilizado un Entorno CloudLab en Google Cloud Engine con Sofia2+eVidens, de modo que se pueda generar un visor sobre información cargada en Sofia2 de forma asistida.

Los interesados pueden contactar con este correo

Cómo crear un Visor eVidens a partir de una Ontología Sofia2

IoT según Oracle /IoT by Oracle

El término IoT se usa para definir un sistema en el que los sensores están conectados al mundo real a través de Internet.

La visión de IoT es integrar diversos conjuntos de datos desde sensores físicos y el resto de Sistemas TI para habilitar la analítica que pueda anticipar eventos, problemas y otras necesidades.

Como resultado de esto, el sistema como un todo puede tener una vista de que está pasando en cualquier localización y momento en el tiempo.

Esta visión nos guía hacia un mundo de sistemas conectados que servirán para reducir costes y eliminar pérdidas para cualquier actividad Human-Machine y Machine-Machine.

The term IoT is used to define a system in which the Internet is connected to the real world via ubiquitous sensors.

The vision of IoT is to integrate diverse sets of data from physical sensors and the rest of IT to enable analytics that can anticipate events, issues, and other needs.

As a result, the system as a whole can have a view of what’s taking place at any location and any point in time.

This vision leads to a world of connected systems that could greatly reduce waste, lower costs, and eliminate loss for just about any human-machine and machinemachine activity.

IoT según Oracle /IoT by Oracle

Analysis of the Total Cost of Ownership (TCO) of Sofia2 vs Custom development

In this post we have put together a simple analysis about the TCO of Sofia2 vs a Custom development on a relational database.

The Total Cost of Ownership (TCO) of MongoDB and Oracle includes upfront and ongoing costs including software, hardware and personnel.

UPFRONT COSTS:

The initial costs include:

  • Initial developer effort: Personnel costs + Developer coding required to get the application and data store working together
  • Initial administrative effort: Personnel costs + Admins to install and configure software, cluster machines, set up sharding, etc
  • Software licenses
  • Server hardware: Servers required to run database (excludes storage).  Driven primarily by the number and type of processors and RAM. Other costs include enclosures, network connectivity, cabling, and power supplies.
  • Storage hardware: Storage required to store the data, varies depending on whether internal or shared (SAN) storage is used, the amount of storage and whether hard disk drives (HDDs) or solid state drives (SSDs) are used.

ONGOING COSTS:

Consistes of:

  • Ongoing developer effort: Personnel + Coding needed to adapt data store to the customer, market and business needs.
  • Ongoing administrative effort: Personnel + Administrative effort required to keep the data store healthy and running.
  • Software maintenance and support: Maintenance: Upgrades and bug fixes for software + Support: On-call assistance for troubleshooting technical problems with software.
  • Hardware maintenance and support: Maintenance: Upgrades and bug fixes for firmware and any software that may come with the hardware + Support: On-call assistance for troubleshooting technical problems with hardware.
  • Miscellaneous Deployment Costs: Other costs associated with keeping database up and running. Includes cloud/hosting/colocation costs, bandwidth charges, electricity feed, etc.

Here is how Sofia2 reduces various costs that make up the TCO of a system:

INITIAL DEVELOPER EFFORT

The initial developer effort refers to the cost of time spent by the developer to ensure that the application and data warehouse work together.

In the case of a development on a relational database, the initial development effort includes tasks such as defining the data model, creating a layer of object-relational mapping (ORM), write the business logic for the application and make the presentation layer for this logic.

 

Sofia2 is designed to reduce development time, so that a developer can use the platform easily with any language.

With Sofia2 Console developers can:

  • Create their own entities (Ontologies in Sofia2, tables in an RDBMS, collections in MongoDB)
  • Define their business rules in a simple and guided way
  • Provide secure access to their entities
  • CRUD access (create, read, update, delete, …) to all these entities through any language (Java, Javascript, C, Android, …) allowing you to develop Web MVC applications (API Java, Python, Node js), HTML5 applications (API Javascript), mobile applications (API Android, iOS, Javascript …) or business modules (Java, Python, C, …)
  • Ability to subscribe to events, queries, rules, … easily and independently of the messaging protocol (JMS, MQTT, AMQP, …)
  • Assisted Publishing and APIs REST website based on entities
  • Integrated GIS Capabilities
  • Integrated Dashboards
  • Integrated reporting
  • Integrated Big Data Repository

 Therefore, we can say that it is much more profitable to develop with Sofia2 that to do a custom development on a relational database.

Another important productivity advantage of Sofia2 is its design of Entities (Ontologies) oriented to dynamic documents and schemas. The way in which the platform stores data from the application corresponds with the technology and current development practices that have evolved considerably since the beginning of the industry of the relational databases 30 years ago.

Some reasons that support the productivity benefits of Sofia2 are:

  • Usability: Sofia2 is compatible with existing development methodologies, allows developers to iterate quickly and continuously on the data model and all from a Web interface. In contrast to a traditional  relational model development that imposes a strict set of constraints to develop, both in terms of data model, rule creation, changes, …
  • Data Model. With Sofia2, the developer only has to create the data model in one place: the product´s own Web Console. In a traditional development developers need to create and maintain the data model in three places using different interfaces: the application, the database itself and the ORM layer.
  • Data flexibility. Unlike a RDBMS, Sofia2 allows developers to easily store polymorphic data and semi-structured and structured data in a individual data store.
  • JSON support. Storage in JSON, mainstay of many current applications, is done smoothly and does not require conversion. With a RDBMS, developers need to “flatten” and transform JSON to store it in relational tables, and then they have to recover the layers to make the extraction of the database.

INITIAL ADMINISTRATIVE EFFORT

The Installation and configuration of Sofia2 is cheap and easy. The Platform consists of:

  • CDB (Configuration DataBase): can be any relational database. By default it runs on a MySQL embedded DB.
  • RTDB (Real Time DataBase): where in the RI it is MongoDB making the initial administrative effort is low, an administrator must take into account a single variable: the number of nodes in the cluster. There is only a small set of configuration settings to put the system into operation. MongoDB administrators do not need to integrate layers of cache or create custom logic horizontal partitioning to direct queries to the correct server node. Instead, the memory storage, cache and the horizontal partitioning are core capabilities of MongoDB.
  • HDB (Historical DataBase): It can run on MongoDB or Hadoop depending on the needs or preferences.
  • SIB + Console + Tools + API Manager + Process: all business modules are built on Java, deployed as Web applications on any JEE application server. The bulk of the configuration goes in the CDB so it is not necessary to create complex configuration files.

SOFTWARE LICENSES

Sofia2 is a platform with a free version for the open source community (Apache license) and an issue for business subscribes that can be used in different modes: On Premise or Cloud.

This version includes support in various forms (from 8×5 without SLAS to 24×7 with strict SLAS), software updates and solution to errors and some additional functions.

The commercial edition of Sofia2 is billed continuously instead of timely (ie, an annual fee per server).

SERVER HARDWARE

In general, the cost of Sofia2 servers is considerably lower than in a traditional development on a relational DB for similar workloads and availability. This applies to all components.

Sofia2 is designed to use basic hardware in scalable architectures.

Sofia2 deployments typically use basic and economic Linux servers, which cost only $3.000, even a low-power and high performance can cost just $4.000 (excluding storage).

STORAGE HARDWARE

The scalable architecture of Sofia2 significantly reduces storage costs.

Sofia2 can use local economic storage and allows to efficiently use the solid state drives (SSD).

ONGOING DEVELOPER EFFORT

The dynamics of current development efforts are lower than the initial development effort.

With a traditional development, the cost of making changes in the application is greater, whether they are changes in the schema of a database that is already in production (greater costs than for a database that has not yet been delivered) as in the development of logic, rules, security settings.

For example with Sofia2 it is easy for developers to add fields to entities, create new APIs, which leads to significantly lower costs and allows developers to adapt applications as the demands evolve.

ONGOING ADMINISTRATIVE EFFORT

The ongoing administrative effort includes activities that keep the system in good working order (for example, updating software or hardware, performing backups and recovery times of unexpected interruptions).

Managing Sofia2 requires much less time and effort compared with traditional development.

Administration of a Sofia2 deployment primarily involves administering Linux configurations and hardware itself; so you only need to know and manage a few parameters.

SOFTWARE MAINTENANCE AND SUPPORT

Sofia2 subscriptions are billed annually per core. This includes access to product support, software updates and bug fixes as well as certain functionalities that are only available in the paid edition.

OTHER ADVANTAGES OF SOFIA2

In addition to tangible cost savings, the model oriented to documents and Sofia2´s flexible schema, the platform also provides greater agility and flexibility to companies, which in turn provide advantages to generate income.

Once the Sofia2 Platform is implanted in a company, they can use the Platform (without the need to build a new infrastructure) for new deployments and to integrate data from other systems so they have them centralized in a common repository with Big Data capabilities. You can also develop Sofia2 applications with any technology and language.

Analysis of the Total Cost of Ownership (TCO) of Sofia2 vs Custom development

Mejoras en Dashboards Sofia2

En la última versión de Sofia2, se añadieron nuevos gadget a la plataforma y se actualizaron los ya existentes. Complementando a esto, se han incorporado mejoras en los Dashboards de Sofia2, permitiendo en esta nueva versión, asignar nuevos layouts y temas para el Dashboard.

Podemos ver, al pulsar en cada opción del mismo, como se reestructura el Dashboard actual con la configuración dada.

Cuando pulsemos en el botón de añadir Gadget, nos aparecerá la selección de los Gadgets nuevos (Area, Bar, Pie y Gauge), así como los que ya existían en la plataforma, que pondrán ser añadidos y desplazados donde necesitemos, dentro de nuestro Dashboard:

Posteriormente, como ya se realizaba anteriormente , se podrán añadir un Gadget creado y configurado anteriormente:

A continuación, mostramos un ejemplo básico de Dashboard de una estación meteorológica con los nuevos Gadgets, nuevo estilo y con un nuevo layout:

Mejoras en Dashboards Sofia2

Presentación Sofia2 en Evento Smart Cities Microsoft en Mondragón

Smart Cities

ETIC (Smart Cities Innovation Center) y Microsoft le invitan a conocer soluciones innovadoras y buenas prácticas para la transformación digital del territorio. La iniciativa CityNext de Microsoft facilita a las ciudades y administraciones públicas en general, el diseño y la implantación de su propia hoja de ruta con el objetivo de crear entornos sostenibles, prósperos y competitivos.
Fecha: 29 de abril del 2015

Agenda:

Hoy en día es viable afrontar los retos asociados a la transformación digital para generar territorios y ecosistemas inteligentes, donde sus infraestructuras se integren o evolucione su operación, se fomente la participación del ciudadano y la empresa, pero también se acelere localmente la promoción económica y social. Venga a conocer cómo ya lo están haciendo otras ciudades y administraciones públicas.

Presentación Sofia2 en Evento Smart Cities Microsoft en Mondragón