doris从kafka导入数据

数据分析

2020-07-14

5

0

技术:doris

运行环境:doris

demo功能:提供一个从kafka导入数据的命令

命令

CREATE ROUTINE LOAD 数据库名.任务名,每次导入需要不一样 ON doris数据表名
COLUMNS TERMINATED BY "单字符分隔符",
COLUMNS(staff_id)
PROPERTIES
(
    "desired_concurrent_number"="3",
    "max_batch_interval" = "20",
    "max_batch_rows" = "300000",
    "max_batch_size" = "209715200",
    "strict_mode" = "false"
)
FROM KAFKA
(
    "kafka_broker_list" = "broker列表,ip和port",
    "kafka_topic" = "topic名男子",
    "property.group.id" = "消费组id",
    "property.client.id" = "客户端id",
    "property.kafka_default_offsets" = "OFFSET_BEGINNING"##消费起始位置
);

如何停止任务

stop routine load for 数据库名.任务名;

欢迎添加微信,互相学习↑↑↑ -_-

发表评论

全部评论:0条

白老虎

programming is not only to solve problems, ways to think