[ https://issues.apache.org/jira/browse/HIVE-17959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Janaki Lahorani reassigned HIVE-17959: -------------------------------------- Assignee: Janaki Lahorani > SparkPartitionPruningSinkOperator buffers all writes in memory > -------------------------------------------------------------- > > Key: HIVE-17959 > URL: https://issues.apache.org/jira/browse/HIVE-17959 > Project: Hive > Issue Type: Sub-task > Components: Spark > Reporter: Sahil Takiar > Assignee: Janaki Lahorani > > {{SparkPartitionPruningSinkOperator}} buffers everything in memory and only > flushes to the output file with the operator is closed. This can cause memory > issues. -- This message was sent by Atlassian JIRA (v6.4.14#64029)