[
https://issues.apache.org/jira/browse/HIVE-26815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17647852#comment-17647852
]
Sruthi M commented on HIVE-26815:
---------------------------------
Hi [~yigress], this patch doesn't seem to work as expected.
i.e, The staging files seem to be getting created in the table location itself
(abfs in the below case), and not using scratch dir (which is
hdfs://mycluster/tmp/hive) even after enabling the parameter
'hive.use.scratchdir.for.staging'.
!image-2022-12-15-10-52-18-267.png|width=509,height=121!
!image-2022-12-15-10-58-59-628.png|width=570,height=280!
Creating the staging directory on hdfs is not working as shown above. Can you
please check this and let me know what more needs to be configured for
achieving the same?
> Backport HIVE-26758 (Allow use scratchdir for staging final job)
> ----------------------------------------------------------------
>
> Key: HIVE-26815
> URL: https://issues.apache.org/jira/browse/HIVE-26815
> Project: Hive
> Issue Type: Improvement
> Components: Hive
> Affects Versions: 3.1.3
> Reporter: Yi Zhang
> Assignee: Yi Zhang
> Priority: Minor
> Labels: pull-request-available
> Fix For: 3.2.0
>
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> HIVE-26758 add an option to allow choose set final job staging with
> hive.exec.scratchdir. This is to backport this into 3.2.0
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
