跳到主要内容
版本:2.3.0-beta

Http

Http source connector

Description

Get data from http or https interface

提示

Engine Supported and plugin name

  • Spark: Http
  • Flink: Http

Options

nametyperequireddefault vale
urlstringyes-
methodstringnoGET
headerstringno
request_paramsstringno
sync_pathstringno

url [string]

HTTP request path, starting with http:// or https://.

method[string]

HTTP request method, GET or POST, default GET.

header[string]

HTTP request header, json format.

request_params[string]

HTTP request parameters, json format. Use string with escapes to save json

sync_path[string]

HTTP multiple requests, the storage path of parameters used for synchronization (hdfs).

common options [string]

Source plugin common parameters, please refer to Source Plugin for details.

Example

 Http {
url = "http://date.jsontest.com/"
result_table_name= "response_body"
}

Notes

According to the processing result of the http call, to determine whether the synchronization parameters need to be updated, it needs to be written to hdfs through the hdfs sink plugin after the judgment is made outside the http source plugin.