Doris BrokerLoad报错No source file in this table

原创

大数据开发者前线 2023-05-10 21:26:27 博主文章分类：Hive ©著作权

©著作权归作者所有：来自51CTO博客作者大数据开发者前线的原创作品，请联系作者获取转载授权，否则将追究法律责任

broker Load语句

LOAD
LABEL gaofeng_broker_load_HDD
(
    DATA INFILE("hdfs://eoop/user/coue_data/hive_db/couta_test/ader_lal_offline_0813_1")
    INTO TABLE ads_user
)
    WITH BROKER "hdfs_broker"
(
    "dfs.nameservices"="eadhadoop",
    "dfs.ha.namenodes.eadhadoop" = "nn1,nn2",
    "dfs.namenode.rpc-address.eadhadoop.nn1" = "h4:8000",
    "dfs.namenode.rpc-address.eadhadoop.nn2" = "z7:8000",
    "dfs.client.failover.proxy.provider.eadhadoop" = "org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider",
    "hadoop.security.authentication" = "kerberos","kerberos_principal" = "ou3.CN",
    "kerberos_keytab_content" = "BQ8uMTYzLkNPTQALY291cnNlXgAAAAFfVyLbAQABAAgCtp0qmxxP8QAAAAE="
);

报错任务Cancelled

type:ETL_RUN_FAIL; msg:errCode = 2, detailMessage = No source file in this table(ads_user).

解决 broker load语句中的DATA FILE路径写错了，需要写的是文件，而不是目录这个目录是我把表直接export出去的目录，brokerLoad时不能使用这个，而是要使用底下的众多文件将 hdfs://eoop/user/coue_data/hive_db/couta_test/ader_lal_offline_0813_1

修改为 hdfs://eoop/user/coue_data/hive_db/couta_test/ader_lal_offline_0813_1/*