doris 问题

Last updated on November 22, 2024 pm

🧙 Questions

☄️ Ideas

too many arguments to function ‘int butil::tcp_listen(butil::EndPoint)’

FAILED: src/http/CMakeFiles/Webserver.dir/ev_http_server.cpp.o 
/opt/rh/devtoolset-10/root/usr/bin/../bin/g++ -DHAVE_INTTYPES_H -DHAVE_NETINET_IN_H -I/var/local/thirdparty/installed/include -I../src -I../test -I../../gensrc/build -I/var/local/thirdparty/installed/gperftools/include -I/var/local/thirdparty/installed/include/thrift -I/var/local/thirdparty/installed/include/event -Wall -Wno-sign-compare -Wno-unknown-pragmas -pthread -fno-strict-aliasing -fno-omit-frame-pointer -std=gnu++11 -D__STDC_FORMAT_MACROS -Wno-deprecated -Wno-vla -DBOOST_DATE_TIME_POSIX_TIME_STD_CONFIG -DBOOST_SYSTEM_NO_DEPRECATED -msse4.2  -Wno-attributes -DS2_USE_GFLAGS -DS2_USE_GLOG -faligned-new  -g -Wno-unused-local-typedefs -O3 -gdwarf-2 -DNDEBUG -fdiagnostics-color=always -O3 -DNDEBUG -MD -MT src/http/CMakeFiles/Webserver.dir/ev_http_server.cpp.o -MF src/http/CMakeFiles/Webserver.dir/ev_http_server.cpp.o.d -o src/http/CMakeFiles/Webserver.dir/ev_http_server.cpp.o -c ../src/http/ev_http_server.cpp
../src/http/ev_http_server.cpp: In member function 'doris::Status doris::EvHttpServer::_bind()':
../src/http/ev_http_server.cpp:150:47: error: too many arguments to function 'int butil::tcp_listen(butil::EndPoint)'
  150 |     _server_fd = butil::tcp_listen(point, true);      |                                               ^
  Building CXX object src/http/CMakeFiles/Webserver.dir/action/tablet_migration_action.cpp.o
解决方案
# 由于分隔符的问题，导致doris获取的字段和doris中的定义字段不对成，造成
# 查看日志，找出那个字段存在问题

wait catalog to be ready. FE type: UNKNOWN. is ready: false

2021-09-23 15:57:14,532 INFO (UNKNOWN 10.42.0.0_9010_1632378512490(-1)|1) [Catalog.waitForReady():785] wait catalog to be ready. FE type: UNKNOWN. is ready: false
2021-09-23 15:57:16,532 INFO (UNKNOWN 10.42.0.0_9010_1632378512490(-1)|1) [Catalog.waitForReady():785] wait catalog to be ready. FE type: UNKNOWN. is ready: false
2021-09-23 15:57:18,533 INFO (UNKNOWN 10.42.0.0_9010_1632378512490(-1)|1) [Catalog.waitForReady():785] wait catalog to be ready. FE type: UNKNOWN. is ready: false
2021-09-23 15:57:20,533 INFO (UNKNOWN 10.42.0.0_9010_1632378512490(-1)|1) [Catalog.waitForReady():785] wait catalog to be ready. FE type: UNKNOWN. is ready: false
2021-09-23 15:57:22,533 INFO (UNKNOWN 10.42.0.0_9010_1632378512490(-1)|1) [Catalog.waitForReady():785] wait catalog to be ready. FE type: UNKNOWN. is ready: false
2021-09-23 15:57:24,534 INFO (UNKNOWN 10.42.0.0_9010_1632378512490(-1)|1) [Catalog.waitForReady():785] wait catalog to be ready. FE type: UNKNOWN. is ready: false
2021-09-23 15:57:26,534 INFO (UNKNOWN 10.42.0.0_9010_1632378512490(-1)|1) [Catalog.waitForReady():785] wait catalog to be ready. FE type: UNKNOWN. is ready: false
2021-09-23 15:57:28,534 INFO (UNKNOWN 10.42.0.0_9010_1632378512490(-1)|1) [Catalog.waitForReady():785] wait catalog to be ready. FE type: UNKNOWN. is ready: false
2021-09-23 15:57:30,535 INFO (UNKNOWN 10.42.0.0_9010_1632378512490(-1)|1) [Catalog.waitForReady():785] wait catalog to be ready. FE type: UNKNOWN. is ready: false
2021-09-23 15:57:32,535 INFO (UNKNOWN 10.42.0.0_9010_1632378512490(-1)|1) [Catalog.waitForReady():785] wait catalog to be ready. FE type: UNKNOWN. is ready: false
2021-09-23 15:57:34,536 INFO (UNKNOWN 10.42.0.0_9010_1632378512490(-1)|1) [Catalog.waitForReady():785] wait catalog to be ready. FE type: UNKNOWN. is ready: false
2021-09-23 15:57:36,536 INFO (UNKNOWN 10.42.0.0_9010_1632378512490(-1)|1) [Catalog.waitForReady():785] wait catalog to be ready. FE type: UNKNOWN. is ready: false
2021-09-23 15:57:38,536 INFO (UNKNOWN 10.42.0.0_9010_1632378512490(-1)|1) [Catalog.waitForReady():785] wait catalog to be ready. FE type: UNKNOWN. is ready: false
解决方案
# 先改成true 等成功启动后再删除
cd /opt/doris/fe
sudo vim conf/fe.conf
# === sudo vim conf/fe.conf ===
metadata_failure_recovery=true
# === sudo vim conf/fe.conf ===

current node is not added to the cluster, will exit

2022-07-01 10:20:04,272 ERROR (stateListener|54) [Catalog.checkCurrentNodeExist():1358] current node is not added to the cluster, will exit
resolve
# 先改成true 等成功启动后再删除
cd /opt/doris/fe
sudo vim conf/fe.conf
# === sudo vim conf/fe.conf ===
metadata_failure_recovery=true
# === sudo vim conf/fe.conf ===

######

User class threw exception: org.apache.spark.SparkException: Job aborted due to stage failure: Task 2 in stage 0.0 failed 4 times, most recent failure: Lost task 2.3 in stage 0.0 (TID 7) (isxcode executor 1): java.sql.BatchUpdateException: errCode = 2, detailMessage = close wait failed coz rpc error. node=172.23.39.226:8060, errmsg=tablet writer write failed, tablet_id=11920, txn_id=31066, err=-215
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at com.mysql.cj.util.Util.handleNewInstance(Util.java:192)
at com.mysql.cj.util.Util.getInstance(Util.java:167)
at com.mysql.cj.util.Util.getInstance(Util.java:174)
at com.mysql.cj.jdbc.exceptions.SQLError.createBatchUpdateException(SQLError.java:224)
at com.mysql.cj.jdbc.ClientPreparedStatement.executeBatchSerially(ClientPreparedStatement.java:853)
at com.mysql.cj.jdbc.ClientPreparedStatement.executeBatchInternal(ClientPreparedStatement.java:435)
at com.mysql.cj.jdbc.StatementImpl.executeBatch(StatementImpl.java:796)
at org.apache.spark.sql.execution.datasources.jdbc.JdbcUtils$.savePartition(JdbcUtils.scala:687)
at org.apache.spark.sql.execution.datasources.jdbc.JdbcUtils$.$anonfun$saveTable$1(JdbcUtils.scala:856)
at org.apache.spark.sql.execution.datasources.jdbc.JdbcUtils$.$anonfun$saveTable$1$adapted(JdbcUtils.scala:854)
at org.apache.spark.rdd.RDD.$anonfun$foreachPartition$2(RDD.scala:1020)
at org.apache.spark.rdd.RDD.$anonfun$foreachPartition$2$adapted(RDD.scala:1020)
at org.apache.spark.SparkContext.$anonfun$runJob$5(SparkContext.scala:2242)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
at org.apache.spark.scheduler.Task.run(Task.scala:131)
at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:497)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1439)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:500)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Caused by: java.sql.SQLException: errCode = 2, detailMessage = close wait failed coz rpc error. node=172.23.39.226:8060, errmsg=tablet writer write failed, tablet_id=11920, txn_id=31066, err=-215
at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:129)
at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:97)
at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:122)
at com.mysql.cj.jdbc.ClientPreparedStatement.executeInternal(ClientPreparedStatement.java:953)
at com.mysql.cj.jdbc.ClientPreparedStatement.executeUpdateInternal(ClientPreparedStatement.java:1092)
at com.mysql.cj.jdbc.ClientPreparedStatement.executeBatchSerially(ClientPreparedStatement.java:832)
... 16 more
Driver stacktrace:
原因
同步到速率太快，需要降低同步速率
doris
doris 问题
https://ispong.isxcode.com/db/doris/doris 问题/
Author
ispong
Posted on
September 23, 2021
Licensed under