Generating Performance Statistics

Generate performance statistics for classification and regression algorithms in the Model Statistics component. Use charts in the Model Statistics component to visualize model performance results for Train, Validate and Test datasets and selected KPIs.

To configure the Model Statistics component to generate peformance statistics and visualize results in the Model Statistics component, take the following steps:

  1. Launch Expert Analytics, connect to a dataset, and navigate to the Predict Room.
  2. From the Component List add the Partition component.
    Note You must add a Partition component if you want to see the charts when using Model Statistics. The purpose of the charts is to display the curves for different partition datasets.
  3. Double-click the Partition component, configure the required data fields for the Train, Validate and Test datasets, and click Done.
  4. In the Algorithms section, drag-and-drop selected algorithms to the analysis editor, and configure them. For example, if solving a classification problem, you might choose three classification algorithms, Auto Classification, R-CNR Tree, and Naïve Bayes.
  5. From the Component List add a Model Statistics component to the analysis editor for the appropriate algorithm, regression or classifiction.
  6. Double-click the Model Statistics component to open the configuration options.
  7. Click the Properties tab to configure the appropriate algorithm type, set the Target Column on which to run the algorithm, and then set the Predicted Column. Optionally, click the General tab and add a component Alias and Description. Click Done.
  8. Click the Run Analysis icon.
  9. Select the Results tab of Model Statistics component to see a summary of the results.
  10. Optionally, view the data in the following chart formats:
    1. Gain/profit: Y-axis shows Gain/profit and X-axis shows the percentage.
    2. Standardized (KS): Y-axis shows Standardized profit and X-axis shows the percentage.
    3. Lift: Y-axis shows Lift profit and X-axis shows the percentage.
    4. ROC: Y-axis shows Sensitivity and X-axis shows specificity.
    Note

    For each chart, you can view Train, Validate and Test curves overlapping on the same chart. There is one curve for each partition and for each chart.

You have generated performance statistics in summary and chart format for the required alogorithm.