zhangyouxun opened a new issue #11061:
URL: https://github.com/apache/druid/issues/11061
peon config :
-Xms10g -Xmx10g -XX:+UseG1GC -XX:MaxDirectMemorySize=10g -Duser.timezone=UTC
-Dfile.encoding=UTF-8 -XX:+ExitOnOutOfMemoryError
-Djava.util.logging.manager=org.apache.logging.log4j.jul.LogManager
druid.peon.defaultSegmentWriteOutMediumFactory.type=offHeapMemory
druid.indexer.fork.property.druid.processing.numThreads=2
spec:
"tuningConfig": {
"maxRowsInMemory": 1000000,
"maxBytesInMemory": 0,
"maxRowsPerSegment": 5000000
}
row size: 300bytes
peon ingest speed： 50k/s
taskCount：30
is there any wrong param leading low ingestion？
How to improve the speed of ingestion？
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
