Skip to main content
Version: 2.1.1

Http

Description​

Get data from http or https interface

tip

Engine Supported and plugin name

  • Spark: Http
  • Flink

Options​

nametyperequireddefault vale
urlstringyes-
methodstringnoGET
headerstringno
request_paramsstringno
sync_pathstringno

url [string]​

HTTP request path, starting with http:// or https://.

method[string]​

HTTP request method, GET or POST, default GET.

header[string]​

HTTP request header, json format.

request_params[string]​

HTTP request parameters, json format.

sync_path[string]​

HTTP multiple requests, the storage path of parameters used for synchronization (hdfs).

common options [string]​

Source plugin common parameters, please refer to Source Plugin for details.

Example​

 Http {
url = "http://date.jsontest.com/"
result_table_name= "response_body"
}

Notes​

According to the processing result of the http call, to determine whether the synchronization parameters need to be updated, it needs to be written to hdfs through the hdfs sink plugin after the judgment is made outside the http source plugin.