MOVE YOUR DATA IN ORACLE AUTONOMOUS DATA WAREHOUSE CLOUD (ADWC)
DATA VIRTUALITY HELPS YOU TO INTEGRATE YOUR DATA FROM >200 DATABASES, APIS, AND FLAT FILES INTO ORACLE ADWC FOR VARIOUS USE CASES
Data Virtuality offers two solutions:
- Data Virtuality Pipes: In this near real-time data architecture, data is moved in your target storage, ADWC
- Data Virtuality Logical Data Warehouse: This real-time logical data warehouse architecture solution works with a semantic data layer where data is modelled into ADWC, the repository, using SQL.
How to integrate your data using Oracle ADWC as your...
…central target storage in a near real-time data warehouse architecture
Data Virtuality Pipes is an intuitive visual cloud-based data integration solution. With the 60+ ready to use connectors which include databases and APIs, you can integrate data from various data sources in your Oracle ADWC and make them available in your BI tools. The set-up is very easy and quick as a wizard walks your through every single step.
In the following video, we demonstrate how to easily move your data from Amazon Redshift in Oracle ADWC using Data Virtuality Pipes in more detail:
As you could see, there are basically only four easy steps until you can start to analyze your data from Amazon Redshift in Oracle ADWC:
1. Step: Set up Oracle ADWC as the target storage for your data.
2. Step: Add your data source by selecting Amazon Redshift and fill in the credentials.
3. Step: Go back to the dashboard and follow with the last step, to create a Pipe to integrate the data. Choose from Amazon Redshift the data that you’d like to move.
...and check the preview. Do you see all the data that you were expecting?
4. Step: Now you’re done moving your data from Redshift to Oracle ADWC with Data Virtuality Pipes and can review the moved data in Oracle SQL Developer.
How to integrate your data using Oracle ADWC as your...
…repository in a real-time logical data warehouse architecture
Data Virtuality Logical Data Warehouse is a next generation solution that enables agile data infrastructure with high performance. By combining data virtualization and next generation ETL (Extract-Transform-Load), this solution creates an entirely new way of integrating your data into your system.
What does this mean for the use with Oracle ADWC? Oracle ADWC and Data Virtuality Logical Data Warehouse combine high-performance data warehousing which is enabled by the flexibility of the semantic data layer.
Watch the following video to get a first glimpse into Data Virtuality Logical Data Warehouse:
So let’s summarize the four steps to set up Data Virtuality Logical Data Warehouse:
1. Step: Connect to your data sources
Data Virtuality Logical Data Warehouse (LDW) connects to multiple data sources and allows querying data in from there by using SQL. Data sources can either be relational or non-relational.
2.Step: Create a central data logic
LDW also allows you to create a central data logic that covers the business logic as well as the logical connections between the different systems. This layer can easily be implemented by using SQL views and/or stored procedures.
3. Step: Get your data in a data warehouse
Data Virtuality LDW gathers statistics about the usage of the data and uses these statistics to create a data warehouse in a special database on a database server of your choice. This is done through automatic recommendations for the internal structure of the data warehouse that are then proposed to the database administrator. Data gets eventually updated in your data warehouse with different time schedules. The Logical Data Warehouse copies or replicates data for you using SQL commands. It transforms these SQL commands into SQL commands on the source systems, into API calls, into access to various filesystems and finally into access to CDC (Change Data Capture) interfaces of different systems and databases. Data Virtuality provides predefined jobs for the most common transformations.
4. Step: Make data accessible
Finally, LDW supports the standard interfaces (JDBC, ODBC, REST) to deliver data to the data consumers. This could for example be reporting tools, advanced analytics tools, or custom programs in various programming languages.
Request your free demo call to learn more about Data Virtuality Logical Data Warehouse.
1. How can I get started?
- Data Virtuality Pipes: Start your 14 days free trial on AWS (If you don’t have an AWS account, just email us at firstname.lastname@example.org).
- Data Virtuality Logical Data Warehouse: Schedule your personal free demo call
2. Which databases and APIs are supported?
- Data Virtuality Pipes: We offer 60+ connectors that you could use to integrate your data in the system of your choice.
- Data Virtuality Logical Data Warehouse: Take a look at the 200+ connectors that are ready to use for your specific need.
3. What is the supported frequency of data movement?
- Data Virtuality Pipes: You can determine how often the data should be moved yourself. In the third step “Create Pipes to integrate the data”, you have the option to schedule the frequency of data movement under the load settings. We recommend not to check the incremental button as with that setting the whole table will be moved every time.
- Data Virtuality Logical Data Warehouse: With the sophisticated scheduling of Data Virtuality Logical Data Warehouse, you can replicate your data every minute, if needed. Dependencies on other replication jobs are also configurable. Watch the following video to get more detailed insights: https://vimeo.com/175877949
4. What types of data movement are supported?
Data Virtuality supports multiple data movement types depending on the different use cases. Learn more about the specific algorithmic concepts behind each type and usage: https://datavirtuality.com/docs/#doc=User%20Guide&version=2.0&page=Replication_and_Materialization.html
The following topics are covered in this user guide:
- Complete Materialization
- Incremental Replication (Movement)
- Batch Replication (Movement)
- History Update (slowly-changing-dimension)
- Copy Over
- Upsert Update
- Overview of Replication (Movement) Types
Take a look at all integration possibilities:
Visit our connector site and simply enter your data source that you’d like to move in Oracle ADWC in the search bar.