!--a11y-->
Web Crawler Search in B2C CRM Web
Channel 
This function is available only in the B2C CRM Web Channel Web shop. You use the function to create static HTML pages for your products on the Web server. The pages contain links to your B2C Web shop, where you sell these products. When an Internet user carries out a search for a certain product on a search engine and their search term contains a key word in your static page, the search engine will display your static page to the user. The user can then follow the link on this static page to your actual Web shop.
You have installed the Web Crawler Enablement tool.
You enable Web crawler searching in your Web Crawler Enablement tool. You generate a hierarchy of static Web pages that corresponds to the content of your product catalog. The hierarchy contains the following:
● A static Web page for each catalog product
● A static Web page for each catalog area
The catalog area Web pages contain links to all static Web pages for their assigned products.
● A single static Web page that serves as the root for the hierarchy.
The root web page contains links to all catalog area Web pages.
It is sufficient to just publish the root page to a Web search engine to make sure the whole content of the hierarchy can be found via search engine. Once this has been done and a Web search engine is used to search for a product, a link to the static Web page generated for the product should appear in the search engines results list. The user then follows the link from the static Web page and enters the Web shop. When following a link to a static Web page for a product an Add to basket button on this Web page should enable the user to add a product to a shopping basket at the same time as entering the B2C Web shop.
...
1. The generation of static Web pages is based on html-templates. With the Web Crawler Enablement tool deployment you receive three standard html-templates. They can be found in the directory. \apps\sap.com\crm~catalogtool\servlet_jsp\catalogtool \root\catadm\webcrawler\templates). They are:
○ root-templ.html
Root web page
○ indx-templ.html
Catalog areas web pages
○ prod-templ.html
Product web pages
We recommend that you copy these templates to a folder on the SAP Web AS Java 7.00 server. From there you can adjust them to your own requirements.
2. Before generating the hierarchy of static Web pages you need to adjust a component in the Extended Configuration Management (XCM) application for Web Crawler Enablement.
a. Log on XCM for Web Catalog Management at: http://<web server>:<port>/catalogtool /admin/xcm/init.do
b. Navigate to Start ® Components ® Customer ® Crawler
Adjust an existing component configuration for the Crawler component or create a new one.
c. Adjust the following parameters belonging to the Crawler component:
Parameter |
Description |
indexTemplate |
Catalog areas Web page template |
prodTemplate |
Catalog product Web page template |
rootTemplate |
Root Web page template |
shopURL |
URL to the B2C Web shop. The scenario.XCM parameter should be specified within this URL otherwise the button for adding a product to a shopping basket will not work. |
imageServer |
URL to product mimes |
shopID |
ID of Web shop that should be accessible from the static page |
language |
Language of Web shop |
dumpFolder |
To maintain the full path to the directory where the Web pages should be generated |
templateFolder |
To maintain the full path to the directory where template Web pages are located |
genIndexPages |
Select True if static Web pages should be generated for catalog areas |
genProdPages |
Select True if static Web pages should be generated for products |

Further details about the above, is provided in the XCM tool.
d. Save the component configuration with all parameters maintained according to your requirements and restart the application webcatadmin.
3. You can now generate the static Web pages hierarchy:
a. Re-start the Web Crawler Enablement tool.
b. Enter the product catalog and catalog variant IDs, and the catalog view if you are using them.
c. Select the Crawler component configuration and choose Go.

Ensure that the Web shop used in the Crawler component has the same catalog, variant, and view assigned to it, as entered in step b above.
d. The system generates the static Web pages in the background and stores them in the directory you specified with parameter dumpFolder in your Crawler component configuration
e. Copy the generated Web pages to a directory that is published via a Web server, for example via the SAP Web AS Java 7.00 server.

You can display the generated Web pages using the URL: http://<webserver>:<port>/<web server directory>/rootCategories.html.
You should be able to navigate to all of the generated pages via this root page. The Add to basket button should allow customers to add a product to a shopping basket at the same time as entering the B2C Web shop.
f. Publish the URL: http://<web server>:<port>/<web server directory>/rootCategories.html to the Web search engines of your choice.
Once the search engines have processed the URL, you should find links to the generated Web pages within the search results of these search engines when searching for products stored in your product catalog.