One of my historical nodes crashes on startup, yielding this error (below).
Can someone suggest how to start debugging this?
The 2 lines in the config that refer to segmentCache:
historical/runtime.properties:druid.segmentCache.locations=[{"path":
"var/druid/segment-cache", "maxSize": 32000000000, "freeSpacePercent": 1.0}]
historical/runtime.properties:druid.segmentCache.numLoadingThreads=10
The other historical (the one that is not crashing) shows files in the
var/druid/segment-cache as expected. and they are configured the same.
The log message
"Unable to provision, see the following errors:
1) Problem parsing object at prefix[druid.segmentCache]: Can not
deserialize instance of java.util.ArrayList out of VALUE_STRING token
at [Source: N/A; line: -1, column: -1] (through reference chain:
org.apache.druid.segment.loading.SegmentLoaderConfig[\"locations\"]).
at
org.apache.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:151)
(via modules: com.google.inject.util.Modules$OverrideModule ->
com.google.inject.util.Modules$OverrideModule ->
org.apache.druid.guice.StorageNodeModule)
at
org.apache.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:151)
(via modules: com.google.inject.util.Modules$OverrideModule ->
com.google.inject.util.Modules$OverrideModule ->
org.apache.druid.guice.StorageNodeModule)
while locating
com.google.common.base.Supplier<org.apache.druid.segment.loading.SegmentLoaderConfig>
at
org.apache.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:152)
(via modules: com.google.inject.util.Modules$OverrideModule ->
com.google.inject.util.Modules$OverrideModule ->
org.apache.druid.guice.StorageNodeModule)
while locating org.apache.druid.segment.loading.SegmentLoaderConfig
for the 2nd parameter of
org.apache.druid.segment.loading.SegmentLoaderLocalCacheManager.<init>(SegmentLoaderLocalCacheManager.java:89)
while locating
org.apache.druid.segment.loading.SegmentLoaderLocalCacheManager
at
org.apache.druid.guice.LocalDataStorageDruidModule.configure(LocalDataStorageDruidModule.java:51)
(via modules: com.google.inject.util.Modules$OverrideModule ->
com.google.inject.util.Modules$OverrideModule ->
org.apache.druid.guice.LocalDataStorageDruidModule)
while locating org.apache.druid.segment.loading.SegmentLoader
for the 1st parameter of
org.apache.druid.server.SegmentManager.<init>(SegmentManager.java:100)
at
org.apache.druid.cli.CliHistorical.lambda$getModules$0(CliHistorical.java:88)
(via modules: com.google.inject.util.Modules$OverrideModule ->
com.google.inject.util.Modules$OverrideModule ->
org.apache.druid.cli.CliHistorical$$Lambda$8/1213871206)
while locating org.apache.druid.server.SegmentManager
for the 8th parameter of
org.apache.druid.server.coordination.ServerManager.<init>(ServerManager.java:101)
at
org.apache.druid.cli.CliHistorical.lambda$getModules$0(CliHistorical.java:87)
(via modules: com.google.inject.util.Modules$OverrideModule ->
com.google.inject.util.Modules$OverrideModule ->
org.apache.druid.cli.CliHistorical$$Lambda$8/1213871206)
while locating org.apache.druid.server.coordination.ServerManager
at
org.apache.druid.cli.CliHistorical.lambda$getModules$0(CliHistorical.java:90)
(via modules: com.google.inject.util.Modules$OverrideModule ->
com.google.inject.util.Modules$OverrideModule ->
org.apache.druid.cli.CliHistorical$$Lambda$8/1213871206)
while locating org.apache.druid.query.QuerySegmentWalker
for the 2nd parameter of
org.apache.druid.server.QueryLifecycleFactory.<init>(QueryLifecycleFactory.java:52)
at
org.apache.druid.server.QueryLifecycleFactory.class(QueryLifecycleFactory.java:52)
while locating org.apache.druid.server.QueryLifecycleFactory
for the 1st parameter of
org.apache.druid.server.QueryResource.<init>(QueryResource.java:113)
at org.apache.druid.server.QueryResource.class(QueryResource.java:78)
while locating org.apache.druid.server.QueryResource
1 error"
