SAP Commerce Data Hub
SAP Commerce Data Hub
Content
Data Hub
– Pre-Installation Planning Guide –
– Data Hub Deployment Checklist –
Start Your Data Hub Journey
Data Hub Fundamentals
SAP Commerce Data Hub Business Advantages
SAP Commerce Data Hub Basic Data Flow
Install the Basic Prerequisites
Install SAP Commerce Data Hub
Configure Data Hub for a Test Environment
Tutorial: Setting Up and Running Hello World
Creating Your Data Models
Loading Data
Composing Data
Publishing Target Data
Summary: Fundamentals
Overview and Concepts
The SAP Commerce Data Hub Workflow
The Backoffice Data Hub Cockpit
Data Handling
Data Hub Extensions
Summary: Concepts
Building upon Hello World
Working with the Extension XML File
Tutorial: Using Simple Expressions
Tutorial: Using SpEL Expressions
Tutorial: Overriding Target Item Definitions
Summary: Basics of Manipulating Data
Build Essential Data Hub Knowledge
Data Hub Use Cases
A Generic Use Case
Data Hub – SAP ERP Integration Use Case
Data Hub – SAP C4C Integration Use Case
Summary: Use Cases
Basic Aspects of Load, Compose, and Publish
Data Flow Overview
Error Identification and Handling in Data Hub Processing
Load
Throttling Data Load
Compose
Publish
Summary: Data Hub Processes
Managing Data
Feeds and Pools
Feeds and Pools Examples
Configuring Data Pools for Automatic Data Deletion
Introduction to Item Structure (Metadata)
Raw Item Data Structure
Canonical Item Data Structure
Target Item Data Structure
Create Raw, Canonical, and Target XML Files
A Possible Raw Extension XML
A Possible Canonical Extension XML
A Possible Target Extension XML
Item Statuses
Item Statuses During Load
Item Statuses During Composition
Item Statuses During Publication
Logging
Logging Data Hub Properties
Logging Item Behavior
Setting the Akka Logging Level
Tracking Access to Personal or Private Data
Generating a datahub.log File via the logback.xml File
Summary: Managing Data Summary
Default Data Hub Adapters
Introduction to Default Data Hub Adapters
The CSV Web Service Extension
Tutorial: Using the CSV Web Service
The Data Hub File Adapter
The SAP Commerce Test Adapter Extension
Tutorial: Using the SAP Commerce Test Adapter
Summary: Default Data Hub Adapters
Transforming Data
Using Extension XML to Transform Data
Using Handlers to Transform Data
Summary: Transforming Data
Using the Backoffice Data Hub Cockpit
Creating New Data Hub Instances for Backoffice Data Hub Cockpit
Backoffice Data Hub Cockpit Dashboard
The Backoffice Data Hub Cockpit Quick Upload Process
The Backoffice Data Hub Cockpit Errors and Failures Menu Option
Managing Feeds and Pools Using the Backoffice Data Hub Cockpit
Tutorials: Backoffice Data Hub Cockpit
Tutorial: Installing and Initializing the Backoffice Data Hub Cockpit
Tutorial: Create a New Data Hub Instance
Tutorial: Perform a Quick Load
Tutorial: Perform a Quick Compose
Tutorial: Review Errors Found in Any Quick Step
Tutorial: Create a Feed and a Pool
Tutorial: Create a New Data Hub User
Tutorial: Perform a Quick Publish
Summary: Using the Backoffice Data Hub Cockpit
Master Your Data Hub Project
Preparing Data Hub for a Production Environment
Required Skills
Tuning Tomcat
Choosing a Database
Using MySQL
Using Oracle
Using SAP HANA
Using MSSQL
Data Hub Installation Using Recipes
Data Hub CLASSPATH Configuration Files and Recipes
Recipe Tasks
Configuring Data Hub Binaries with a Recipe
Customizing Data Hub Deployment
Deploying to a Docker Image
Sample Gradle Recipes
datahub-sample.gradle
cluster.gradle
tomcat-context-deployment-sample.gradle
Summary: Installation
Auto Init Mode
Using the Create-Drop Property
Add Create-Drop to the Data Hub Environment
Remove Create-Drop from the Data Hub Environment
Securing Your Data Hub Application
Customizing Data Hub
Development Tools Used for Customization
Tutorial: Setting Up Your Environment for Custom Extension Development
Anatomy of an Extension
Simple Extension
Extension with Java and Spring - Sample One
Extension with Java and Spring - Sample Two
Making Extensions Accessible
Illustrating a Dependent Extension
Dynamically Loading an Extension
Tutorial: Implementing a Dynamic Extension
Data Hub Configuration
Configuration Using HOCON
HOCON Configuration Example
Summary: Customizing Data Hub
Security
HTTPS and SSL
Addressing an HTTP/HTTPS Mismatch in Data Hub
Creating and Importing a Self-Signed Certificate for Data Hub
Preparing Source System Security for Data Hub
Infrastructure Security
Application Security
Tutorial: Creating a Custom Spring Security Profile
Data Security
Attribute Encryption
Tutorial: Using Attribute Encryption
Advanced Attribute Encryption
Adapter Security
Summary: Security
Managing Data (Advanced)
Advanced Metadata Structure
Raw Metadata
Canonical Metadata
Structuring Your Canonical Metadata
Using Canonical Attributes
Target Metadata
Mapping Between Target and Canonical Models
Validation and Rules for the Creation of Metadata and Feeds
Domain Modeling
Managing Data States Across Actions
Activating Data Hub Database Cleanup
Exploring the Impact of the Clean Up Extension
Addressing Variant Data
Exercise: Create a Raw Item Extension XML File
Exercise: Create a Canonical Item Extension XML File
Exercise: Create a Target Item Extension XML File
Publishing Canonical Item Variants
Counting Item Statuses
Summary: Managing Data (Advanced)
Advanced Aspects of Load, Compose, and Publish
Load
Data Loading Actions
Unique Aspects of Loading IDocs
Sample: Load Using Spring
Compose
Composition Actions
Changing a Canonical Item During Composition
Deleting Canonical Items by Raw Item
Publish
Filtering Canonical Items with SpEL Before Publication
Tutorial: Filtering Items Using SpEL
Publication Actions
Publication Technical Review
Monitoring Long Running Publications
Dynamic Publication
Tutorial: Dynamic Publication
Manual Retry Publication
Tutorial: Manual Retry Publication for Failed Items
Action Statuses
Data Loading Action Statuses
Composition Action Statuses
Publication Action Statuses
Summary: Load, Compose, and Publish
Transforming Data (Advanced)
SpEL (Advanced)
Example: SpEL Expression Usage
Using the Custom SpEL resolve() Function
Customizing the resolve() Function
Integrating a Custom SpEL Function into Data Hub
Handlers (Advanced)
Grouping Handlers
Composition Handlers
Sample Composition Handler
Publication Grouping Handlers
Implementing a Publication Grouping Handler
Sample Publication Grouping Handler
Summary: Transforming Data (Advanced)
Orchestrating Data Hub Processes
Events
Enabling Item Attributes in Item Level Events and Logging
Sequence Attribute Support
Pausing or Suspending Currently Running Processes
Summary: Orchestrating Data Hub Processes
Input and Output Adapters
Extending Data Hub Test Adapter
Custom Input Adapters
Key Elements of an Input Adapter
Custom Output Adapters
Custom Output Adapter Basics
Connecting to the Target System
Using the Publish Method
Retrieving and Processing Target Items
Error Handling
Publication Completion
Sample Custom Target Adapter
Summary: Adapters
Aspects of Data Hub Server Resiliency
The Load Restart Process Recovery
The Compose Restart Process Recovery
The Publish Restart Process Recovery
Using Log Files to Determine What Happens During Process Recovery
Checking Target System Availability
Summary: Recovery Options
Operations
Using JMX for Operations or in Extension Development
Using JMX to Monitor Data Hub
Exposed Interface for Each Action MBean
Configuring the JVM to Support JMX
Defining Your Own MBeans in an Extension
Controlled Shutdown
Troubleshooting Guide
Scalability and High Availability
Summary: Operations
Clustering
Clustering Overview
Setting Up a Cluster
Customizing the Hazelcast Configuration
Starting and Stopping the Cluster
Adding and Removing Nodes
Cluster Security
Item Deletion in a Cluster
Using a Load Balancer with HAProxy, Data Hub Cluster, and SSL
Scenario 1: Passthrough Termination
Scenario 2: Double Termination
Scenario 3: Proxy Termination
Troubleshooting Cluster Issues
Summary: Clustering
Monitoring
Monitoring Overview
Monitoring Events
Event Publisher
Tracing Raw Items
Tracing Canonical Items
The documentId Element in Canonical Item Type Definition
Summary: Monitoring
Data Hub Performance
Performance Configuration Parameters
Tutorial: Composition with Modified Configuration Parameters
Tutorial: Publication with Modified Configuration Parameters
The SpEL Resolve Method Results Cache
Extending the Resolve Method Cache Configuration
Extending Caching to Other Custom SpEL Methods
Default Caching
General Correlations Between Hardware Configuration and Job Size
Tuning SAP HANA for Performance
Tuning Oracle 11g for Performance
Summary: Performance
Data Hub Advanced Topics
Error Recognition, Handling, and Solving
Publication Error Messages
Error Analysis Using SQL
Using the REST API to Gather Transactional Information
Reviewing PublicationAction Data Attribute Values
Transactional Scopes
Summary: Data Hub Advanced Topics
Reference
Configuration Properties
REST API
Solution Book
FAQ
SAP Integration with Data Hub
Summary: Reference