跳到主要内容
版本：Next

AmazonSqs

AmazonSqs 源连接器

支持一下引擎​

Spark
Flink
SeaTunnel Zeta

关键特性​

描述​

从 Amazon SQS 读取数据.

源选项​

名称类型必需默认值描述
urlString是-从 Amazon SQ S读取的队列 URL.
regionString否-SQS 服务的 AWS 分区
schemaConfig否-数据的结构，包括字段名和字段类型.
formatString否json数据格式。默认格式为json。可选文本格式，canal-json和debezium-json。如果你使用json或text格式。默认字段分隔符为 ", ". 如果自定义分隔符，请添加"field_delimiter"选项。如果使用 canal 格式,详见canal-json.如果使用 debezium 格式,详见debezium-json..
format_error_handle_wayString否fail数据格式错误的处理方法. 默认值为fail，可选值为（fail，skip）. 当选择失败时，数据格式错误将被阻止，并引发异常. 当选择跳过时，数据格式错误将跳过此行数据.
field_delimiterString否,自定义数据格式的字段分隔符.
common-options否-源插件常用参数, 详见 源通用选项

任务示例​

source {
  AmazonSqs {
    url = "http://127.0.0.1:4566"
    region = "us-east-1"
    format = text
    field_delimiter = "#"
    schema = {
      fields {
        artist = string
        c_map = "map<string, array<int>>"
        c_array = "array<int>"
        c_string = string
        c_boolean = boolean
        c_tinyint = tinyint
        c_smallint = smallint
        c_int = int
        c_bigint = bigint
        c_float = float
        c_double = double
        c_decimal = "decimal(30, 8)"
        c_null = "null"
        c_bytes = bytes
        c_date = date
        c_timestamp = timestamp
      }
    }
  }
}

transform {
    # 如果你想了解更多关于如何配置seatunnel的信息，并查看转换插件的完整列表,
    # 请前往 https://seatunnel.apache.org/docs/transform-v2/sql
}

sink {
    Console {}
}

变更日志​

Change Log
ChangeCommitVersion
[Improve] restruct connector common options (#8634)https://github.com/apache/seatunnel/commit/f3499a6eebdev
[improve] amazon sqs connector update (#8602)https://github.com/apache/seatunnel/commit/c747e02a98dev
[Feature][Restapi] Allow metrics information to be associated to logical plan nodes (#7786)https://github.com/apache/seatunnel/commit/6b7c53d03c2.3.9
[Feature][Kafka] Support multi-table source read (#5992)https://github.com/apache/seatunnel/commit/60104602d12.3.6
[Improve][Common] Introduce new error define rule (#5793)https://github.com/apache/seatunnel/commit/9d1b2582b22.3.4
[Improve] Remove use SeaTunnelSink::getConsumedType method and mark it as deprecated (#5755)https://github.com/apache/seatunnel/commit/8de74081002.3.4
[Improve] Remove all useless prepare, getProducedType method (#5741)https://github.com/apache/seatunnel/commit/ed94fffbb92.3.4
[Improve][Connector-V2] Change amazonsqs to AmazonSqs as connector identifier (#5742)https://github.com/apache/seatunnel/commit/245705d0f72.3.4
[Feature][Connector-V2] Add connector amazonsqs (#5367)https://github.com/apache/seatunnel/commit/7f75a8eafd2.3.4