Getting your data in the cloud with Snowflake and Data Virtuality

Cloud analytics databases are the rising stars of data centralization technologies. They combine the familiarity of a traditional data warehouse, the scalability of data platforms and the elasticity of the cloud. Combining all these advantages, cloud databases make your daily work as effective and agile as you need it to be. Read on and learn more about the facts and technology of integrating your data into a cloud target storage.

Your data with no limits - Snowflake

Snowflake is the only data warehouse built for the cloud. Snowflake’s high-performing cloud analytics database combines the power of data warehousing, the flexibility of big data platforms, the elasticity of the cloud, and true data sharing, at a fraction of the cost of traditional solutions.

Snowflake has the vision to make modern data warehousing effective, affordable and accessible to all data users. One special thing about Snowflake is its ability to efficiently separate the storage capacity from computing capacity. This eliminates the limitation common to cloud databases which does not allow growing the storage capacity without paying more for the computing capacity – which you may not need at all.

Snowflake’s Bing native cloud database has an important ability which is vital for data warehouses – namely elastic scalability. This means that Snowflake is able to dynamically scale up resources as needed in order to load the data into the database. In this way, loading data into the data warehouse does not negatively affect the execution of user queries.

What comes first? Move and model your data!

Data Virtuality provides next-generation data integration solutions (you can download the complete guide to data integration here) that enable detailed insights from real-time and historical data with any Business Intelligence (BI) tool. By combining data virtualization with an automated ETL engine, customers benefit from reducing their data integration effort by up to 80%.

Taking a closer look at the Data Virtuality platform, you have several options you can use together with Snowflake: Pipes and the Logical Data Warehouse.

Get to know Pipes - Your data movement solution

Young digital businesses in particular typically lack the technical capabilities required to connect heterogeneous data sources for analysis. Pipes is the perfect choice when it comes to moving your data into your Snowflake cloud database. With Pipes, you profit from more than 200+ connectors and an easy-to-use interface.

Pipes offers not only self-service capabilities for BI beginners, but also the flexibility and the enterprise connectors required to handle complex enterprise scenarios.

You can use existing data extraction templates – the intuitive interface will guide you through the process. As easy as buying a new sweater while shopping online, you can add data sources into a data warehouse. It only takes a couple of minutes.

At the same time, you can also configure custom data extractions, enjoy complex data transformations and connect custom systems. Data Virtuality’s solution engineers help you connect and configure the data pipelines – or even take over the job, so that you can fully concentrate on your business.

Move, model and access your data with a logical data warehouse

For those of you who want to go beyond simple data movement, there is the Logical Data Warehouse.

The Data Virtuality Logical Data Warehouse connects, models, and moves data for analytics and process automation purposes. Combining data virtualization and next generation ETL enables a revolutionary agile data infrastructure with high performance. Data Virtuality can analyze data from any databases with over 200 pre-built connectors. By simply using SQL, you can work with the Logical Data Warehouse in a time and cost-saving manner. The Data Virtuality SQL processor even works for Hadoop and NoSQL databases that do not support SQL natively.

A self-learning algorithm optimizes each and every query and provides you with the high-performance solution that your business needs.

You can set up your data infrastructure in under 5 minutes, access data silos, and use SQL to query raw data for insights.

Data Virtuality moves your data into a cloud database or builds a central data model for you. Snowflake delivers the performance, concurrency and simplicity needed to store and analyze all your data. And both solutions work together perfectly using only SQL.

A list of all ready-to-use Data Virtuality connectors to Snowflake is here.

What about data security?

Snowflake and Data Virtuality follow European data protection laws and enterprise requirements. You have the option to host both systems at a European hosting location (Frankfurt). With Data Virtuality, you also have the possibility to choose between doing it on premise or in the cloud.

For those who have concerns about having your data in the cloud: Snowflake is the most secure version of the modern cloud data warehouse while using VPS.

Integrate all your data in any BI tool and get a central data model

Knowledge is the power for your business and the road to your success. This knowledge lies within your data. Having powerful solutions helps you to integrate your data from several sources and centralize it – making it ready for your preferred way of analyzing it.

Imagine having several different data sources with totally different requirements and you want to save both the structured and unstructured data in your Snowflake analytical cloud database so that you can analyze it with your BI tool, such as Tableau. Data Virtuality has ready-to-use connectors to more than 200 data sources. The Logical Data Warehouse can now move and model the data within one day. Your data is structured and therefore ready to load into, and save it in, your Snowflake cloud database. From there, it is always accessible with any BI tool you choose. Thanks to the data virtualization layer, you don’t have to run useless queries which block the capacity of your server. Users from every department can access the data that they really need, without manually starting and maintaining queries.

In our example use case above, the BI Stack would be as described below. 

Data sources that need to get integrated in the data warehouse for data analytics:

  • Salesforce
  • Facebook
  • Google Analytics
  • … and all your other data sources

Data warehouse to store this data in:

  • Snowflake

BI tool to visualize the data sources:

  • Tableau
  • Looker
  • … and any other BI tool of your choice

Data integration and data modeling platform to connect the data sources with the BI tool and to build a central data model:

  • Data Virtuality

Do you want to learn more and see how it works for your own individual use case? 

The hybrid approach: for cloud data warehousing plus traditional data warehouses

In case you have some parts of your data in your Snowflake cloud database and some in a traditional data warehouse, such as Oracle or Hadoop, the Data Virtuality Logical Data Warehouse functions as a homogeneous data layer that makes all your data accessible for your BI tools. And the best thing: you can decide where you want to store your data! Through this hybrid approach, you don’t have to worry about having your data in different data warehouses or databases.

By combining the Snowflake cloud database and Data Virtuality’s data integration solution you will have a safe, flexible, agile, and high-performance data infrastructure that scales perfectly with your business needs. And everything by using one language only – SQL. Take a look at a comprehensive list of all connectors available to Snowflake here.

 Find out more about Snowflake at snowflake.net!