In the real world, the migration between two OBIEE environments is really take time .The last time we did this for a customer migrating from 10g to 11g, we had to spend roughly 2 weeks just running through the dashboards clicking on all objects to do the 1st pass of the upgrade. When a customer asked us to migrate from 11g to 12c we were bracing ourselves for a similar ordeal. But the folks at Oracle have really done a great job this time with the Baseline Validation Tool (BVT). It allowed us to very quickly do a 1st pass through all the catalog objects and do a quick sanity check of the catalog and RPD after the upgrade.
The challenge is you need to make sure the content (analysis, catalog object, charts…) in two environments is same after the migration. BVT is FREE tool that enables the creation of a baseline set of data that can be compared with data from another system. While we used it for the upgrade it can be used in any situation where we need to run through 2 environments
- May be the result of an upgrade, patch or migration, or any change
- Automated regression testing on any two compatible Oracle BIEE environments
BVT as a tool is quit well thought thru and allows for several checks to be done in an automated manner.
Data Validation: Allows to check the numbers in the reports between the baseline and new environment.
- Check on actual data values exported from OBI
- Exported to CSV format
- Comparison report generated
BVT even downloads the data from the report as excel or CSV and it can be used to analyze the differences later.
Visual Verification: The purpose of this is to make sure that visually the 2 environments look the same. During the launch they spoke about using some sophisticated analytics to do the comparison, but whatever they have done it does pretty good job to compare the outputs. BVT generates reports for both analyses and dashboards
- Comparison report allows quick scan of (many) results in addition to a threshold test
- Use in conjunction with data validation
- Can be used to check various prompt combinations.
The tool checks all the reports and dashboards in the catalog and produces a report which can even be shared with the customer.
The output is exported and can be manually checked later of passed to the customer as evidence.
BI Catalog Verification: Compares the metadata of catalog objects (rather than objects themselves)
Logical Query validation: Used to validate the logical query between the 2 environments. Used in conjuction with the data and visual validation gives a complete picture of the 2 environments.
The logical query query is captured as evidence and for the failed ones can be used to determine the reason for the failure. Using the logical query in conjuction with the data and visual verification gives us complete confidence on the outcome of the testing.