Tidb
Description
Read data from Tidb.
提示
Engine Supported and plugin name
- Spark: Tidb
- Flink
Env Options
name | type | required | default value |
---|---|---|---|
spark.tispark.pd.addresses | string | yes | - |
spark.sql.extensions | string | yes | org.apache.spark.sql.TiExtensions |
spark.tispark.pd.addresses [string]
your pd servers
spark.sql.extensions [string]
default value : org.apache.spark.sql.TiExtensions
Options
name | type | required | default value |
---|---|---|---|
database | string | yes | - |
pre_sql | string | yes | - |
database [string]
Tidb database
pre_sql [string]
sql script
common options [string]
Source Plugin common parameters, refer to Source Plugin for details
Example
env {
spark.tispark.pd.addresses = "192.168.0.1:2379"
spark.sql.extensions = "org.apache.spark.sql.TiExtensions"
}
source {
tidb {
database = "test"
pre_sql = "select * from table1"
}
}