Model Compare Component

Use the Model Compare component with the Model Statistics component to learn the best algorithm for your predictive problem in all scenarios (HANA and non-HANA).

Comparing Models

Expert Analytics can compare the performance of two or more algorithms in an analysis and indicate the best one with the Model Compare component. You use first the Model Statistics component to calculate performance statistics for either classification or regression algorithm types. After which, the Model Compare component compares the calculated performance statistics to pick the best algorithm of those run at execution. In addition, the Model Compare component merges the results to provide a detailed summary on the best performing component.

Configuring Partitions and KPIs

You can configure partition types and KPIs in the Model Compare component for more control over your analysis chain. In the Properties Panel of the component, you can select either a Validate or Test partition to compare the performance of the connected models. Also, you can choose the required KPIs and sort the order in which they should be compared. Control over the order is important because if the top KPI cannot identify a winning algorithm, the component can perform calculations with the second KPI in the list, and so on. In addition, a precise percentage can be configured for the Gain and Lift parameters. The result is an even more accurate calculation when comparing two or more components.

The below image is of the Column Mapping panel of the Model Compare component in which you can configure the Partition and the KPIs (using the English language version as an example):

Adding Child Components

You can add child components to Model Compare. The best scenario in which to use the feature is with two parent components. With two components connected for comparison, the results mapping section becomes enabled. From there, you can define how to manage the results from the two components. In a two-component compare, the Model Compare component displays the following icon::

When you can compare more than three or more components at a time, the Model Compare component becomes a terminal (or leaf) component. This means that you cannot add a child node to perform further analysis When comparing three or more components, the Model Compare component displays the following icon: