Ingest SQL Server Table
Microsoft SQL Server Consumer is based on datahub-flowagent and uses Data Services as an execution engine.
Data Services provides two methods of reading data from Microsoft SQL Server sources. You can either use Microsoft SQL Server Table Consumer to read the table, or use Microsoft SQL Server SQL Consumer to read the result set of the native SQL.
Table Consumer takes in schema.tablename as input, and it will read the table from the source piece-wise (N rows per call) and load to the next operator in line.
Components
- Triggering the graph:
constantgenerator1: Provides constant input to consumer, which triggers the ingestion.
- Defining Oracle connection:
microsoftsqlservertableconsumer1: Provides consumer connection information.
MSSQL default port is 1443.
If no port is provided in connection definition, the default value will be assigned.
- Loader definition:
flowagentfileproducer1: Data Services requires a loader, such as CSV Loader, to load to Vflow operators.