LOGICAL DATA WAREHOUSE RELEASE 2.0

New look & feel and major technical upgrades – DataVirtuality Logical Data Warehouse Release 2.0

From a new look & feel to some great technical improvements: Our release 2.0 is a big one and just right to make your life with big data the fastest it can get.

Fancying a short overview?

Our new features include a new mail notification component, an overview of the history of changes, a LDAP authentication module, an improvement of the query monitor module, a multi-tenancy feature, improvements of the REST service, migration to the latest Eclipse RCP 4.6.2, as well as a lot of improvements of the overall usability and a new helpful feature for you – the performance monitor module.

Next to the very technical parts a nice look & feel and a good usability are our major goals while improving our Logical Data Warehouse for you. Data Integration can be a really hard and time-consuming job. But with us, you can save a lot of resources and we are constantly improving to make the effects on your daily work even better.

What about a fresh Look & Feel?

First of all the overall usability and the look & feel got a fresh makeover. We improved the SQL code completion, for a more stable process and better granularity. Most importantly, code completion is now available on the column level. We also fixed bugs and made our solution more stable. Additionally you can now have a closer look at your failed data sources and format your date and time in the DataVirtuality Studio views. This sounds great to you? Yes, we know. But there is a lot more new stuff we want to tell you about…

 

DataVirtuality Studio with a new look & feel

 

Better User Experience – History of Changes

When planning a new release we are always talking to our customers and asking them for their needs. The history of changes (versioning) was one of the wishes and it really makes your daily work with data integration a lot easier and safer, as mistakes can be solved quickly and without the chance of losing important information.

So, how does it work?

With the history of changes you have the possibility to track all changes of the DataVirtuality entities, like views, procedures, datasources, users, permissions, jobs and many others. This feature is very useful for you, especially if you are working in a multi-user environment since you can track every single change and – if something goes wrong… it can always happen.. Or you change your mind. And yes, we all know this will happen – you can easily recover and restore a previous state.

Just to make sure, that all processes are as easy and time-saving as you need them. 🙂

For each change that was made, a user is now logged. Changes of the entities that you can check are views, procedures, data sources and the logged users. Furthermore we save additional information related to the specific event such as a clear definition, the operation type and the operation time for you. The following screenshot shows a simple history of changes.

 

The Logical Data Warehouse history of changes

 

LDAP Authentication Module

The LDAP Authentication Module now makes your multi-user environment even more efficient.

With our new users authentication process you can authenticate all users in the system and manage them with your directory of users. Before the release 2.0 the users were stored locally. Now with our new LDAP module you can use enterprise wide user management solutions like Microsoft Active Directory to seamlessly integrate DataVirtuality into the security concept of your organization.

Query Monitor Module

Talking about an efficient and more clear user experience the following addition will make you very happy: We updated the query monitor module by adding more granular statuses of query executions as the parsing, running, fetching, success, failed and interrupted processes. You can now easily have a look at the exact state of your queries. You furthermore have the chance to monitor the queries and have a closer look in case a query runs too long or too slow. In addition to your query monitor module your process monitoring in total will get A LOT easier. Believe us. We worked hard on it. But if you continue reading this blog post, you will find out more very soon.

 

New functions of the query monitor module

 

Mail Notification Component

Before our 2.0 release the only way of checking the status of your jobs was checking on them in the system. This probably was sometimes a very time consuming task with a high possibility of missing important information that you should be aware of to work better with your data. We now created global and local mail notifications. Global notifications will inform you about every job, local notifications about specific jobs. Now you are always 100% up to date! And it is just the right feature to fit your individual needs: You can individually configure the details of the notifications on how often and how detailed you want to receive them.

Multi-tenancy

With our new multiple virtual databases and isolated user environments feature you can now create additional databases within one system. This is especially helpful for you, if you are working in a big company with several branches and want to use one system with several multiple customized virtual databases (VDBs).

Migrated to the latest Eclipse RCP 4.6.2

We fixed some (tiny) bugs for you – especially for Mac users – and improved the performance through migrating to the latest Eclipse Rich Client Platform (RCP) 4.6.2.

REST API

Some customers were asking for an additional way (besides for example jdbc and odbc) to expose data to the user. This is why we implemented REST (representational state transfer) architecture. (As you probably already know, the initial version of the REST Service was already released in our Logical Data Warehouse 1.9, but as you definitely know by now… we are always striving to become better and better and this is why we improved REST again for our 2.0 release)

REST services allow accessing and manipulating web sources using the HTTP protocol. As an alternative to web services, the idea behind REST is to use simple HTTP, that you know from your daily web use, to query data. This is why it makes things much easier for you to access your data and to post it to many different applications like Google Spreadsheets. You can use the DataVirtuality REST API to build web services on top of the DataVirtuality Logical Data Warehouse using modern technologies to develop integrations with other applications.

With REST you now have the possibility to access data in an easy way by just using HTTP for example via your browser.

 

Our new REST API reference guide to show you all the new functions

 

Performance Monitor Module

Do you have resource intensive queries or are you running several services on a single system? Do you want to optimize the system load by changing the schedules and running less important jobs in after-hours? We now have a great improvement for you!

Our performance monitor frontend module provides a new level of control over your data integration platform performance. It is a combination of a server-side service and an easy to use web frontend application. You don’t need any configuration. It is ready to use and shows you different charts about resources consumed by queries.

Performance Monitoring of the CPU utilization during the past 24 hours.

 

 

Overview of the queries and the server capacity utilization

 

 

The query history and a detailed overview of a selected query

 

Detailed overview of the queries and the server resource usage

 

The main page is an overview page with the collection of charts representing different kinds of resources available in the system, such as CPU, memory or disk buffers. Each resource can be reviewed more detailed after clicking the particular chart.

Visualizing your query history in a great overview provides you more control as you can find particular queries easily and check the query plan in a brief overview. Additionally you can now collect and display your sources consumed by selected queries.

And just to mention another great thing: The performance monitor module has no impact on your system performance and still provides enough of your data to monitor queries that require noticeable resources to perform.

So HAPPY RELEASEDAY to our DataVirtuality Logical Data Warehouse 2.0! We are delighted to welcome you and are really excited to see what will happen next.

Just to let you know: We are always happy to help!

Do you have any features that are still missing? Or do you have questions regarding our release 2.0?

Please tell us more about your ideas, comments and questions and we will find a solution. Because even good things can and should become constantly better.