Managing and Monitoring Source Systems

As a user with the catalog administrator role, you can manage and monitor data sources that are connected to the catalog. You can ensure that the catalog contains the most up-to-date content and troubleshoot any issues that arise.

You can use Metadata Extractions page to monitor all source systems connected to the catalog. The Remote Systems table displays a list of all connected data source systems, along with overview information and their synchronization statuses. You can select a source system from the table and use a toolbar action to manage it. You can also select (Navigation) to view the system details page that includes the system's extraction summary logs.

Source systems are organized into the following groups:
  • Assets and Data Products: This section includes SAP Datasphere source systems that contain both assets and data products. Systems that are part of SAP Business Data Cloud formations may have dual entries. One row is for managing the metadata extraction for catalog assets, while the other row is for managing the metadata extraction for APIs.

  • Assets Only: This section includes source systems that contain only assets, such as models and stories (for example, SAP Analytics Cloud).

  • Data Products Only: This section includes source systems that contain only data products. These systems, like SAP S/4HANA, are part of SAP Business Data Cloud formations.

Remote Systems table showing high-level overview of all systems connected to the catalog.

The table contains the following columns:

Column

Description

Name

Displays the user-defined name for the source system and its system type (for example, Local SAP Datasphere or SAP Analytics Cloud).

Details

Displays the following source system details (if available or applicable):

  • A system description

  • The system's URL

  • The name of the authorized user (metadata extracted to the catalog is based on this user’s access permission on the source system)

    An information status for the authorized user also appears in the following situations: the authentication for the user has expired or is about to expire or the authorized user has changed or has not been set up.

Synchronization

Displays the following synchronization details (if available):

  • Status of the latest extraction

    • Deleted: The source system is not synchronized because its connection to the catalog has been deleted. For more information on deleted source systems, see Deleting Connections to Source Systems.

    • Outdated: The source system is not synchronized and its objects are out of date. This issue can occur for any of the following reasons: the system connection was just added, the system was restored, the system user was reauthenticated, or the system was restored from a backup. To fix this status, select the source system and then choose Synchronize to manually synchronize it.

    • Synchronization failed: The source system failed to synchronize, and it is unknown how many objects encountered issues. For troubleshooting information, see Monitoring Metadata Extractions.

    • Synchronized: The source system is synchronized and its objects are up-to-date.

    • Synchronized with errors: The source system is synchronized, but some objects encountered issues. The Errors columns shows the number of objects that have errors. For troubleshooting information, see Monitoring Metadata Extractions.

    • In progress: The source system synchronization is in progress and its objects are being updated.

  • Date and time the system was last synchronized

  • Schedule for the extraction

    • SAP Datasphere and SAP Analytics Cloud systems show Automatic.

    • BW systems shows the next scheduled synchronization date and time.

For BW systems, the following actions are available when the current logged-in user matches the authorized system user:
  • Configure: Opens a dialog where you select the InfoAreas that you want to synchronize with the catalog.

  • Schedule: Opens a dialog where you can set up a synchronization schedule for the source system.

For an SAP Datasphere system that is migrating, you'll see the migration status and one of the following actions:
  • Monitor Catalog Migration: Appears for systems that have a migration status of In progress. Choose this action to open a dialog where you can monitor and manage the catalog migration.

  • Migrate Catalog: Appears for systems that have a migration status of Not Started. Choose this action to migrate catalog content from the previous standalone setup to the new setup with SAP Business Data Cloud. After choosing this action, you'll get a notification and notice that the migration status changes to In progress and the action available becomes Monitor Catalog Migration.

  • Confirm Migration: Appears for systems that have finished the migration process. Choose this action to open the Monitor Catalog Migration dialog and use this final checkpoint to review the migration outcome to make sure you're satisfied with it.

For more information about catalog migration, see Migrating Catalog Content to SAP Business Data Cloud.

Last Configuration Change

The date and time when the system connection details were last changed. The user's name who made the change is also displayed. This column is hidden by default, choose (Select Columns) to show it.

Auto Publish

The automatic publishing option. This column is hidden by default, choose (Select Columns) to show it.

  • Enabled: After each synchronization and each automatic extraction, all new objects in the source system are automatically published as assets to the catalog and will be visible and discoverable by all catalog users. Only objects that have been excluded are not automatically published.

  • Disabled: After each synchronization and each automatic extraction, new or unpublished objects in the source system are not automatically published to the catalog. Users with the Catalog Administrator role must manually publish them to the catalog.

  • N/A: The automatic publishing feature does not apply to systems that have data products.

For more information, see Publishing Content to the Catalog.

Objects

The total number of objects for the source system that are in the catalog. This count includes all objects of any state (current, unavailable, and so on). For objects published in the catalog, the updated metadata is available to users who have the Catalog User role. For unpublished or new objects, users with the Catalog Administrator role can edit, enrich, and then publish them.

Errors

The count of objects that failed during the last synchronization. The statuses for objects already in the catalog are set to Outdated. New objects are not available in the catalog, but a record of the failed metadata extraction is available on the extraction log. For troubleshooting information, see Monitoring Metadata Extractions.

The tools in the Remote Systems toolbar help you mange the source systems.

Tool

Description

Search

Use the free text search to find a system by its name.

Synchronize

Manually synchronize a connected source system and extract updated metadata.

Manually synchronizing a source system might take considerable time and resources and should only be run in certain situations. See Manually Synchronizing a System.

Synchronize is available for BW systems only when the current logged-in user is the authorized user.

Create

Create a new connection to a source system for extracting metadata for assets in the catalog. Make sure you have the following information:
  • The identifier for the source system.

  • Logon credentials of the authorized user for metadata extraction of object properties from the source system.

    When you create the connection, you can also enable automatic publishing of assets, so that they can be visible and discoverable by all catalog users.

Edit

Edit the settings for a system connection.

For an SAP Datasphere or SAP Analytics Cloud system, you can make the following changes:
  • Change the user-defined system name that identifies the system throughout the system monitoring pages and extraction logs.

  • Reauthenticate the source system user. You can reauthenticate the system user after you restore a deleted system or need to update the system user.

  • Set the source system to automatically publish assets to the catalog.

For BW systems, the edit feature is available if the current logged-in user is not the authorized user. If the current user has the necessary permissions for the system, they can choose Edit to become the authorized user. They can also set the source system to automatically publish assets to the catalog.

When viewing the system details, you can access this action by choosing (Edit) in the toolbar.

Delete

Delete a system connection. Catalog assets for the system are not available in the catalog, but they do remain stored for 90 days. Within this time, you can restore the connection and the assets will be available in the catalog again. After 90 days, the connection and all assets are permanently deleted.

View Tools

Use the view tools to help you find the system you want:

  • (Sort): Sort the table by choosing either Ascending or Descending sort order and then choosing the column you want to sort by.

  • (Filter): Filter the table by the extraction status or last synchronization status. You can select a single status to filter the table by or a combination of the three filter options.

  • (Select Columns): Select which columns you want to show in the table.

  • (Download): Download the extraction log file for the source system. The information in the CSV-formatted file is the same as on the Extraction Summary tab on the system's synchronization details page.

  • (Refresh): Refresh the information in the Remote Systems table, such as the timestamps and statuses for the last manual or automatic synchronizations, number of assets, and number of errors.