Show TOC

streamingconvertLocate this document in the navigation structure

Converts XML and delimited records into 32-bit binary records compatible with Event Stream Processor. The metadata describing the streams is obtained either from a connection to a running instance of Event Stream Processor (via the Command and Control interface) or via a configuration file compatible for Event Stream Processor.

Syntax
streamingconvert -f <configFile> -p <[host:]port> -c <user[:password]> [<OPTION...>]
Required Arguments
  • -c < user[:password]> (required) authenticates with a <user> ID and, optionally, a <password>. If you do not provide either the <password> or the -k or -G option, you are prompted for the password. If Event Stream Processor successfully authenticates with these credentials, the connection is maintained, otherwise Event Stream Processor immediately closes the connection.

  • -f < configFile> (dependent required) specifies the XML style configuration file that describes the data to be converted to Event Stream Processor format.

  • -p <[<host>:]<port>/workspace-name/project-name> (required) together, the <host:<port>/<workspace name>/ <project name> arguments specify the URI to connect to the ESP Server (cluster manager). For example, if you have started your ESP cluster server in the port 19011, the host name is set as localhost, and you are running a project called prj1 in the default workspace, specify -p as: -p localhost:19011/default/prj1
Options
  • -b (optional) indicates that the machine architecture on which the server (that is consuming data) is running has the reverse byte order of the machine architecture on which streamingconvert is running.
  • -d < separator> (optional) reads and converts delimited records from standard input instead of the default XML format.
  • -e (optional) encrypts traffic with Event Stream Processor via openSSL sockets.
    Note Ensure that Event Stream Processor is started in encrypted mode to use this option.
  • -f <configfile> (dependent required) specifies the CCX configuration file that describes the location of data that is read via standard input.
  • -F < path>

    (optional) specifies the full pathname of the XML Schema file (default is $STREAMING_HOME/etc/Platform.xsd).
  • -G (optional) authenticates access to Event Stream Processor with credentials held within a Kerberos authentication ticket. Environment variables determine where the system will look to find authentication tickets. If the user name differs from the default principal name in the ticket cache, specify an alternate user name with the –c option to use the corresponding authentication ticket.
  • -h (optional) prints a list of possible options on the screen along with a brief explanation for each option.
  • -k < privateRsaKeyFile> (optional) performs authentication using the RSA private key file mechanism instead of password authentication. The <privateRsaKeyFile> must specify the pathname of the private RSA key file.
    Note Ensure that the ESP Server has been started with the -k option specifying the directory in which to store the RSA keys.
  • -m <datetimemask> (optional) specifies the format string for date values (in strftime format). Default value is "%Y-%m-%dT%H:%M:%S".
  • -v (optional) prints the streamingconvert utility version.
Examples
  • Converting Records to Binary Format Convert records from XML or a comma separated value (CSV) file.
    To convert all XML records in file foo.xml to native binary format, and post them to a running instance of SAP Event Stream Processor, use: 
    cat foo.xml | streamingconvert -p localhost:19011/default/prj1 | streamingupload -p localhost:19011/default/prj1
    To convert all comma-separated records in file foo.csv to native binary format, and post them to a running instance of Event Stream Processor, use: 
    cat foo.csv | streamingconvert -d "," -p localhost:19011/default/prj1 | streamingupload -p localhost:19011/default/prj1
    To convert all XML records in file foo.xml to native binary format, and post them to a running instance of Event Stream Processor on a target machine HOST that has a differing byte order than the machine on which streamingupload is running, use: 
    cat foo.xml | streamingconvert -b -p localhost:19011/default/prj1 | streamingupload -b -p localhost:19011/default/prj1
    To convert all XML records in file foo.xml to native binary format and post them to standard output without a running instance of ESP, use the -f option and provide the CCX configuration file used to start the server.
    cat foo.xml | $STREAMING_HOME/bin/streamingconvert -f test.ccx
In this section: