New look & feel and major technical upgrades – Data Virtuality Logical Data Warehouse Release 2.0

From a new look & feel to some great technical improvements: Our release 2.0 is a big one and just right to make your life with big data the fastest it can be.

Fancy a short overview?

New features include a new email notification component, an overview of the history of changes, an LDAP authentication module, an improvement of the query monitor module, a multi-tenancy feature, improvements to the REST service, migration to the latest Eclipse Rich Client Platform (RCP) 4.6.2, as well as a lot of improvements to the overall usability and a helpful new feature for you – the performance monitor module.

In addition to the very technical aspects, a nice look & feel and optimum usability were our major goals while improving our Logical Data Warehouse for you. Data integration can be a really difficult and time-consuming job. But with our products, you can save a lot of resources. And we are constantly improving to make the impact on your daily work even better.

What about a fresh look & feel?

First of all, the overall usability and the look & feel got a fresh makeover. We improved the SQL code completion so it now has a more stable process and better granularity. Most importantly, code completion is now available on the column level. We also fixed bugs and made our solution more stable.

Additionally, you can now have a closer look at your failed data sources and format your date and time in the Data Virtuality Studio views. Sounds great? But wait, there’s more …

Data Virtuality Studio with a new look & feel

Better User Experience – History of Changes

When planning a new release, we are always talking to our customers and asking them about their needs. The history of changes (versioning) was one of their wishes. And it really makes your daily work with data integration a lot easier and safer, as mistakes can be solved quickly and without the risk of losing important information.

 

So, how does it work?

With the history of changes, you now have the ability to track all changes to the Data Virtuality entities, such as views, procedures, data sources, users, permissions, jobs and many others. This feature is very useful, especially if you are working in a multi-user environment since you can track every single change and – if something goes wrong – which can always happen, or if you change your mind – you can easily recover and restore a previous state.

Just to make sure that all processes are as easy and time-saving as you need them to be. 🙂

For each change that was made, a user is now logged. Changes to the entities that you can check are views, procedures, data sources and the logged users. Furthermore, we save additional information related to the specific event, such as a clear definition, the operation type and the operation time. A simple history of changes may look like this:

The Logical Data Warehouse history of changes:

LDAP Authentication Module

The LDAP Authentication Module now makes your multi-user environment even more efficient.

With our new users authentication process, you can authenticate all users in the system and manage them with your directory of users. Before release 2.0, the users were stored locally. Now with our new LDAP module you can use enterprise wide user management solutions like Microsoft Active Directory to seamlessly integrate Data Virtuality into the security concept of your organization.

Query Monitor Module

Talk about an efficient and clearer user experience, the following addition will make you very happy: We updated the query monitor module by adding more granular statuses of query executions for the parsing, running, fetching, success, failed and interrupted processes. You can now easily take a look at the exact state of your queries. You also have the chance to monitor the queries and have a closer look in case a query runs too long or too slow. In addition to your query monitor module, your process monitoring in general will get A LOT easier. Sounds too good to be true? Keep reading and see for yourself!

New functions of the query monitor module:

Email Notification Component

Before release 2.0, the only way to check the status of your jobs was to check on them in the system. This was sometimes a very time-consuming task with a high possibility of missing important information that you should be aware of to work better with your data. We have now created global and local email notifications. Global notifications inform you about every job, local notifications about specific jobs. Now you are always 100% up to date! And it is just the right feature to fit your individual needs: You can individually configure the details of the notifications in terms of how often you want to receive them and how detailed you want them to be.

Multi-tenancy

With our new multiple virtual databases and isolated user environments feature, you can now create additional databases within one system. This is especially helpful if you are working in a big company with several branches and want to use one system with multiple customized virtual databases (VDBs).

Migration to the latest Eclipse RCP 4.6.2

We fixed some (tiny) bugs for you – especially for the Mac users among you – and improved the performance by migrating to the latest Eclipse Rich Client Platform (RCP) version 4.6.2.

REST API

Some customers asked for an additional way (besides, for example, JDBC and ODBC) to expose data to the user. This is why we implemented a REST (Representational State Transfer) architecture. As you probably know already, the initial version of the REST Service was already released in our Logical Data Warehouse 1.9. But as you definitely know by now: we are always striving to become better and better and this is why we improved REST again for our 2.0 release.

REST services allow you to access and manipulate web sources using the HTTP protocol. As an alternative to web services, the idea behind REST is to use simple HTTP, which you know from your daily web use, to query data. This is why it makes things much easier for you to access your data and to post it to many different applications like Google Spreadsheets. You can use the Data Virtuality REST API to build web services on top of the Data Virtuality Logical Data Warehouse using modern technologies to develop integrations with other applications.

With REST you now have the possibility to access data in an easy way just by using HTTP, for example, via your browser:

Our new REST API reference guide to show you all the new functions:

Performance Monitor Module

Do you have resource intensive queries or are you running several services on a single system? Do you want to optimize the system load by changing the schedules and running less important jobs during after-hours? We now have a great improvement for you!

Our performance monitor frontend module provides a new level of control over your data integration platform performance. It is a combination of a server-side service and an easy to use web frontend application. You don’t need to do any configuration. It is ready to use and shows you different charts related to resources consumed by queries.

Performance Monitoring of the CPU utilization during the past 24 hours:

 

 

Overview of the queries and the server capacity utilization:

 

 

The query history and a detailed overview of a selected query:

 

 

Detailed overview of the queries and the server resource usage:

 

 

The main page is an overview page with a collection of charts representing different kinds of resources available in the system, such as CPU, memory or disk buffers. Each resource can be reviewed in more detail by clicking the particular chart.

Visualizing your query history in a great overview provides you with more control because you can find specific queries easily and check the query plan in a brief overview. Additionally, you can now collect and display your resources consumed by selected queries.

And the best thing: The performance monitor module has no impact on your system performance and still provides enough of your data to monitor queries that require noticeable resources to perform.

So HAPPY RELEASE DAY to our Data Virtuality Logical Data Warehouse 2.0! We are delighted to welcome you and are really excited to see what will happen next.

Just to let you know: We are always happy to help!

Are you missing any features? Or do you have questions regarding our release 2.0?

Please let us know your ideas, comments and questions and we will find a solution. Because, even if it’s good, you should constantly improve it!