Bootstrap Stops Due to Database Problems (SAP Library

Bootstrap Stops Due to Database Problems

Symptom

AS Java stops with one of the following exit codes: 503, 504, 505, 506, 507, 508, 509, 511, 512, 513, 515, 516, 517, 518, 519, 520, 521, 524, 525, 526, 527, 528, 529, 530, 532, 542, 546, 548, 549, 550, 551.

Scenario Type: Error analysis

SAPNetWeaver Component: Application Server Java (AS Java)

Analysis

The bootstrap module fails to synchronize the files due to problems with the connection to the database or database inconsistency.

Solution

If you get one of the exit codes listed above, take the following steps:

1. Find a detailed description of the problem in the bootstrap log files, which are located in the /usr/sap/<SID>/JC<XX>/work/ folder. The log files are:

○ dev_bootstrap* - logs from the Java Startup and Control Framework that shows the parameters with which the bootstrap was started.

○ log_bootstrap* - logs from the execution of the bootstrap that show the execution flow from the last session and the possible errors.

○ jvm_bootstrap* - logs from the JVM output for the bootstrap process that show possible JVM problems during the bootstrap execution.

2. Perform a database consistency check following the procedure below. If any of the steps is not completed successfully, stop the check and report the result in a CSS message.

a. Start the Config Tool to check if it connects to the database.

b. Check if you can connect to the database using an external tool. This external tool can be DBManager for MaxDB or Enterprise Manager for MSSQL Server.

c. Run the integrity check tool provided with the database (for example, DBManager for MaxDB).

3. Proceed depending on the particular exit code.

Exit code 503: Error while initializing the database connection. Check if the database is running. For more information, check the bootstrap logs and see SAP Note 915825.

The connection to the database cannot be initialized. Try the following steps in the order they are described:

...

1. If the database is not started, start the database.

2. Check if database drivers are correctly set in the instance profiles.

In the profile /usr/sap/<SID>/SYS/profile/<SID>_J<XX>_<HOSTNAME>, check for the j2ee/dbdriver entry and make sure that it is correct for the database you are using. Check if the files in the entry really exist and have the correct permissions for access from <SID>adm user.

3. Make sure the user name and the password for accessing the database are correct.

4. Perform a database consistency check.

Exit code 504: Custom parameters mappings not found in the database. Possible reason: incorrect or inconsistent database content. For more information, check the bootstrap logs and see SAP Note 915825.

Exit code 505: Problem accessing the database. Check if the database is running and the database connection details. For more information, check the bootstrap logs and see SAP Note 915825.

These exit codes indicate problems with access to the custom parameters mappings. The parameter mappings are used when Software Deployment Archives (SDA) are deployed that contain parameterized settings. Parameterized settings contain system parameters provided by the Configuration Manager that are transparently substituted during runtime. The custom parameters are defined by the user of the system. Some parameters may be vital for the work of other system components and if they cannot be substituted, their incorrect value may cause inconsistencies in the system.

If you deployed a SDA that uses a custom parameter, which it is not found in the database, this causes the bootstrap to exit.

Proceed depending on when the problem occurred. If the problem appeared after:

● installation: Create a CSS message under component BC-INS.

● upgrade: Create a CSS message under component BC-INS or BC-UPG-TLS-TLJ depending on the tool used (SAPInst or JINUP)

● deploy: Create a CSS message under component BC-JAS-DPL

In the CSS message for this problem include:

● the bootstrap logs

● description of the installations/deployments/upgrades you performed lately

● the logs of the server(s) from /usr/sap/<SID>/JC<XX>/j2ee/cluster/server<n>/log.

● a report about any of the steps that failed during the database consistency check.

Exit codes 506 and 507: Cannot access the synchronization root. Possible reason: incorrect or inconsistent database content. For more information, check the bootstrap logs and see SAP Note 915825.

The content that needs to be synchronized is located under specific location (root) in the database. The bootstrap module cannot find this root so the synchronization fails to start. These exit codes indicate problems with the:

...

● Database consistency - the state can be caused by errors during installation, upgrade or deploy.

Check the database consistency and include the report for the steps that failed.

Create a CSS message depending on whether the problem occurred after installation, upgrade, or deploy under the components listed above.

● Wrong or missing profile entry j2ee/instance_id, which determines the specific instance root.

Find the profile in /usr/sap/<SID>/SYS/profile/<SID>_J<XX>_<HOSTNAME>. Check if the entry is missing and if so, create a CSS message under BC-INScomponent.

Exit codes 508 and 509: Cannot access the version information in the database. Possible reason: incorrect or inconsistent database content. For more information, check the bootstrap logs and see SAP Note 915825.

The bootstrap uses special versioning to optimize the synchronization process. Without this optimization, everything from the database has to be downloaded to the file system. This information is always present in the database. If it is not there, the bootstrap stops with an exit code.

The problem can be caused by erroneous installation, upgrade or deploy. The reason for the error may be:

● Missing or improperly linked template

● Missing instance ID entry from the profile

Create a CSS message depending on whether the problem occurred after installation, upgrade, or deploy under the components listed above. In the CSS message for this problem include:

● the bootstrap logs

● description of the installations/deployments/upgrades you performed lately

● the logs of the server(s) from /usr/sap/<SID>/JC<XX>/j2ee/cluster/server<n>/log.

● a report about any of the steps that failed during the database consistency check.

Exit codes 511, 512 and 513: Problem accessing the instance metadata. Check the database settings. For more information, check the bootstrap logs and see SAP Note 915825.

The instance metadata contains information about the JVM location, JVM settings (heap and perm sizes, GC options, and so on), the infrastructure (SCS host and ports). If the instance data cannot be read, the instance does not run as desired so the bootstrap exits.

Create a CSS message for this problem and attach the bootstrap logs.

Exit codes 515 and 516: Cannot find information about the native files. Possible reason: incorrect or inconsistent database content. For more information, check the bootstrap logs and see SAP Note 915825.

The database contains metadata about the native files that are synchronized in /usr/sap/<SID>/JC<XX>/j2ee/os_libs. If this metadata cannot be obtained, the bootstrap has to exit, otherwise the AS Java does not function properly.

Check the database consistency and create a CSSmessage with the consistency report and the bootstrap logs.

Exit codes 517, 518, 519, 520 and 521: Error while reading index information from the database. Possible reason: incorrect or inconsistent database content. For more information, check the bootstrap logs and see SAP Note 915825.

Bootstrap uses indexes to optimize the synchronization process. If these indexes cannot be read from the database, all the binaries have to be downloaded, which takes a lot of time. The indexes are always present in the database. If the bootstrap exits because of access problem while reading the indexes, this may be an indication of database inconsistency.

Check the database consistency and create a CSSmessage with the consistency report and the bootstrap logs.

Exit codes 524, 525 and 526: Problem accessing the cluster file system global version. Possible reason: incorrect or inconsistent database content. Check the Deploy Controller version. For more information, check the bootstrap logs and see SAP Note 915825.

The Cluster File System (CFS) is used for deploying single file system archive in multiple file systems in the whole cluster. The CFS serves as a repository for the deployed files, while the bootstrap is responsible for the synchronization of the CFS components in the FS of the cluster elements. The global version is used for optimization purposes. If it is missing this may be an indication of:

● Database corruption.

Check the database consistency.

● Version mismatch between the bootstrap and deploy controller versions.

Check the versions of the components as described above.

Create a CSS message that includes the database consistency report, the versions of the components and the bootstrap logs.

Exit codes 527 and 528: Problem accessing the versions repository of the cluster file system. Possible reason: incorrect or inconsistent database content. Check the Deploy Controller version. For more information, check the bootstrap logs and see SAP Note 915825.

The version’s repository of the CFS is used to optimize the synchronization time. If it is missing this may be an indication of:

● Version mismatch between the bootstrap and deploy controller versions.

Check the versions of the components using:

○ SystemInfo application if the engine is running

○ Version script located in the folder /usr/sap/<SID>/JC<XX>/j2ee/cluster/bootstrap/scripts if the engine cannot start

Create a CSS message, including the version information displayed by the tool you are using. The minimum information required is the bootstrap and the deploy controller components versions. You also have to include the name of the tool (“SystemInfo application” or “version script”) used to obtain the versions.

● Database corruption

Check the database consistency. Create a CSSmessage that includes the database consistency report, the versions of the components and the bootstrap logs.

Exit codes 529 and 530: Problem accessing the metadata of the cluster file system. Check the database state and the Deploy Controller component version. For more information, check the bootstrap logs and see SAP Note 915825.

The CFS is used for deploying single file system archive in multiple file systems in the whole cluster. The CFS serves as a repository for the deployed files, while the bootstrap is responsible for the synchronization of the CFS components in the file system of the cluster elements.

If any data required for the synchronization of the CFSarchives is missing or not accessible, the bootstrap exits. This may be an indication of:

● Version mismatch between the bootstrap and deploy controller versions: Check the versions of the components as described above.

● DB corruption: Check the database consistency.

Create a CSS message that includes the database consistency report, the versions of the components and the bootstrap logs.

Exit codes 532 and 542: Index not found in the database. Check the database consistency and the version of the OfflineDeploy component. For more information, check the bootstrap logs and see SAP Note 915825.

The bootstrap uses database indexes along with the file system indexes to optimize the synchronization process. If a database index cannot be found, one or more components are unknown to the bootstrap and cannot be downloaded to the file system. This can result in the AS Java not working as expected.

The error may indicate inconsistent database. Check the database consistency and create a CSS message with the consistency report and the bootstrap logs attached.

Exit code 546: Problem reading kernel properties from the DB. For more information, check the bootstrap logs and see SAP Note 915825.

Exit codes 548, 549: Problem reading the managers' properties. Check the database consistency. For more information, check the bootstrap logs and see SAP Note 915825.

Exit codes 550, 551: Problem reading the services' properties. Check the database consistency. For more information, check the bootstrap logs and see SAP Note 915825.

The bootstrap reads the kernel properties; the properties of the managers that compose the kernel of the AS Java; and the services’ properties from the database. All these properties are used to configure the kernel so they are vital for the work of the managers. If they cannot be obtained, the bootstrap exits.

These errors may indicate an inconsistent database. Check the database consistency and create a CSS message with the consistency report and the bootstrap logs attached.