Typesense

Typesense 源连接器

描述

从 Typesense 读取数据。

主要功能

• 批处理
• 流处理
• 精确一次
• Schema
• 并行度
• 支持用户定义的拆分

选项

名称	类型	必填	默认值
hosts	array	是	-
collection	string	是	-
schema	config	是	-
api_key	string	否	-
query	string	否	-
batch_size	int	否	100

hosts [array]

Typesense的访问地址，格式为 host:port，例如：["typesense-01:8108"]

collection [string]

要写入的集合名，例如：“seatunnel”

schema [config]

typesense 需要读取的列。有关更多信息，请参阅：guide。

api_key [config]

typesense 安全认证的 api_key。

batch_size

读取数据时，每批次查询数量

常用选项

Source 插件常用参数，具体请参考 Source 常用选项

示例

source {
   Typesense {
      hosts = ["localhost:8108"]
      collection = "companies"
      api_key = "xyz"
      query = "q=*&filter_by=num_employees:>9000"
      schema = {
            fields {
              company_name_list = array<string>
              company_name = string
              num_employees = long
              country = string
              id = string
              c_row = {
                c_int = int
                c_string = string
                c_array_int = array<int>
              }
            }
          }
    }
}

变更日志

Change Log

Change	Commit	Version
[Fix] Fix error log name for SourceSplitEnumerator implements class (#8817)	https://github.com/apache/seatunnel/commit/55ed90eca	2.3.10
[Improve] restruct connector common options (#8634)	https://github.com/apache/seatunnel/commit/f3499a6ee	2.3.10
[Feature]Check Chinese comments in the code (#8319)	https://github.com/apache/seatunnel/commit/d58fce1ca	2.3.9
[Improve][dist]add shade check rule (#8136)	https://github.com/apache/seatunnel/commit/51ef80001	2.3.9
[Feature][Restapi] Allow metrics information to be associated to logical plan nodes (#7786)	https://github.com/apache/seatunnel/commit/6b7c53d03	2.3.9
[Fix][Connector-V2] Fix known directory create and delete ignore issues (#7700)	https://github.com/apache/seatunnel/commit/e2fb67957	2.3.8
[Feature][Connector-V2] Support typesense connector (#7450)	https://github.com/apache/seatunnel/commit/138d2a4eb	2.3.8