[ https://issues.apache.org/jira/browse/DRILL-5617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Paul Rogers updated DRILL-5617: ------------------------------- Summary: Spill file name collisions when spill file is on a shared file system (was: spill filename conflict) > Spill file name collisions when spill file is on a shared file system > --------------------------------------------------------------------- > > Key: DRILL-5617 > URL: https://issues.apache.org/jira/browse/DRILL-5617 > Project: Apache Drill > Issue Type: Bug > Components: Functions - Drill > Affects Versions: 1.11.0 > Reporter: Chun Chang > Assignee: Paul Rogers > > Spill location can be configured to be written on hdfs such as: > hashagg: { > # The partitions divide the work inside the hashagg, to ease > # handling spilling. This initial figure is tuned down when > # memory is limited. > # Setting this option to 1 disables spilling ! > num_partitions: 32, > spill: { > # The 2 options below override the common ones > # they should be deprecated in the future > directories : [ "/tmp/drill/spill" ], > fs : "maprfs:///" > } > } > However, this could cause spill filename conflict since name convention does > not contain node name. -- This message was sent by Atlassian JIRA (v6.4.14#64029)