How we revolutionize the BI infrastructure with our new solution: Pipes


This blog post will provide more information, how we revolutionize the BI infrastructure for businesses with simple to sophisticated data needs by creating our new solution: DataVirtuality Pipes.

Launching a new solution is an awesome feeling. Everybody worked very hard for the past weeks and months. And as the launch date comes closer and closer the whole team gets very excited. All the hard work, the process with so many sophisticated people makes us very sentimental, especially when we think of where we started.

In 2012, when data integration really was a huge challenge, we launched our first solution: The Logical Data Warehouse. It started in 2008 at University of Leipzig as a research project. And wow, this was so much work, but it was worth it. Through this new automated data management architecture we changed the way enterprises can integrate their data forever.

A colleague of us once said: “Data integration before 2012 was like riding a carriage from the US West to the US East Coast.” It was a big challenge, took a lot of time and at some point – it really got on your nerves (in case you are wondering – we still love data integration a lot!).

Now everybody can go by plane. It is so much easier, more comfortable and faster than before. A true improvement.

Our mission, to make data integration for companies as easy as it can get, seemed pretty close.

During the next couple of years the Logical Data Warehouse got a lot of attention. Talking to our customers showed us, that it was worth the effort and they really appreciate, that we helped them to spend more time on concentrating on the analysis of their data rather than wasting time on building a BI infrastructure (which normally takes months and months. But with us, you can get it in one day – just saying).

But where are we now? Launching a new data integration solution?

Yes, we are.

The Logical Data Warehouse is awesome, but a lot of people reached out to us, telling us that the Logical Data Warehouse is two steps ahead of where they are in their BI setup process. Firstly BI developer want to copy all their data into a target storage to start from here.

Tell us all more about it – we are always happy to hear from you.

Using data for business purposes is important, but especially smaller companies who just started using their data, have a small budget on BI and couldn’t build a full data infrastructure yet, really don’t need the full solution. They would like to use it, but they are not there yet. So we thought of what exactly they could need and how we could help them growing, while using their data even better.

Time is a significant factor for business success.

Time is money. While wasting your time, you are wasting your money. And more time would help you understand your business needs even better.

This sounds really wise – we know. But it is true! And you know it.

Digital businesses need to reach certain goals within a short period of time. To know if business and marketing operations are successful all activities need to be tracked, customer journeys need to be clear to react quicker on the customer’s needs. The aim is to achieve a 360 degree customer view and ideally an automated supply chain management. Without fully collecting and understanding data, companies have to make decisions by intuition and not based on facts.

Everyone is starting small.

Especially young digital businesses are lacking of technical possibilities to connect heterogenous data sources for analysis. At some stage even these companies should take a step forward and improve their business intelligence operations. The data is there. It is really close. You just need to use it. And we will help you!

Intuition is important. But honestly – we prefer logical decision-making.

And to help you make your decisions based on hard facts through your own data: Here we are – proudly presenting DataVirtuality Pipes. Our newest solution especially for BI starters.


Data Virtuality Pipes Overview Graphic


18 months ago we started creating Pipes as a smaller version of our Logical Data Warehouse, for those who have a limited use case, started experimenting with data and don’t need the full solution. Data Virtuality Pipes is an affordable solution that builds data pipelines for you, integrating your data into a data warehouse of your choice, so that you can analyze it with your most favorite tools.

Sounds like a miracle? We know. But it is true. Let us explain it to you a little more…

The big data easy – no development, no coding, no maintenance of APIs.

No development, no coding, no maintenance of APIs – Pipes is truly a revolution of the BI infrastructure setup. You can create data pipes from your already existing data sources within minutes. The intuitively to use interface will guide you through the process. Easy as buying a new sweater while shopping online, you can add data sources into a data warehouse.

The benefits of Pipes:

  • Quick setup in minutes
  • Ease of use through a simple interface
  • No coding or programming required
  • 150+ connectors and APIs available without programming
  • Extract data easily into the most common databases, such as: Amazon Redshift, Google BigQuery, HP Vertica and Oracle
  • Custom import schedules
  • Secure cloud hosting
  • The most cost-effective way to start Business Intelligence
  • Your BI infrastructure scales with you: Pipes is fully upgradeable to our Logical Data Warehouse

To set-up Pipes we measured an average time of only 20 minutes. Just sign-up on the internet and get started. Your data pipelines are as well created within just a few minutes. Add a data storage you prefer (and already use), such as Amazon Redshift, HP Vertica, Oracle or more than 10 other databases. In the next step you can connect your data sources, from one of our more than 150 connectors, click-by-click. The system will automatically connect with any database you can find listed in Pipes.

Pipes is extremely flexible and agile.

Just in case you can’t find the data source you want to use: Please fill in the short contact form. We will take care of it and make Pipes the individual solution that you need.

You will also decide how often you want to have your data imported. Just choose a timeframe that you prefer: From once a week to every hour, or even more often – you decide. And in case you want to define your own schedule to run as often as you want. Feel free to contact us. We will make it happen.

Pipes is built for big data. This is why we created Pipes to grow along with your business with an unlimited data volume.

To make sure, that things are very secure and still flexible for you, we are storing your centralized data in a cloud. The cloud hosting is always according to European and US data protection laws.

Growing too fast and need a Logical Data Warehouse?

Data Virtuality Logical Data Warehouse Architecture


One of the best things about our new solution: Pipes is the first step in becoming a fully data driven company. It guides you on the way to becoming high level business intelligence professional. Pipes will grow as your company will become more successful. Pipes is at any time fully upgradable to a Logical Data Warehouse with real-time data access, data modelling and virtual views. You can seamlessly transform your big data BI structure from Pipes to the DataVirtuality Logical Data Warehouse without changing your vendors and losing your work which you have invested until then.

Let us show you the way how to become a real data champion.

Do you want to learn more about Pipes? Feel free to contact us whenever you want to. You are always welcome at one of our offices in San Francisco, Leipzig or Frankfurt. Or write us an email. We are happy to hear from you!