[jira] [Created] (HIVE-17959) SparkPartitionPruningSinkOperator buffers all writes in memory

[Sahil Takiar (JIRA)]

Sahil Takiar created HIVE-17959:
-----------------------------------

             Summary: SparkPartitionPruningSinkOperator buffers all writes in 
memory
                 Key: HIVE-17959
                 URL: https://issues.apache.org/jira/browse/HIVE-17959
             Project: Hive
          Issue Type: Sub-task
          Components: Spark
            Reporter: Sahil Takiar
            Priority: Major


{{SparkPartitionPruningSinkOperator}} buffers everything in memory and only 
flushes to the output file with the operator is closed. This can cause memory 
issues.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)