[ 
https://issues.apache.org/jira/browse/DRILL-4911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kunal Khatua updated DRILL-4911:
--------------------------------
    Reviewer: Krystal

[~knguyen] This is a simple patch. Please verify that in a non-debug mode, the 
serialization doesn't write anything.

> SimpleParallelizer should avoid plan serialization for logging purpose when 
> debug logging is not enabled.
> ---------------------------------------------------------------------------------------------------------
>
>                 Key: DRILL-4911
>                 URL: https://issues.apache.org/jira/browse/DRILL-4911
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Query Planning & Optimization
>            Reporter: Jinfeng Ni
>            Assignee: Jinfeng Ni
>            Priority: Minor
>             Fix For: 1.9.0
>
>
> SimpleParallelizer and subclass have code to put serialized plan in debug 
> log. However, in case when the physical plan fragment is very large (table is 
> huge with large # of partitions, files, etc), the overhead of serialization 
> is not negligible. The code seems to always do serialization, regardless 
> whether the debug flag is turned on. 
> To reduce the overhead, SimpleParallelizer and subclass should only do plan 
> serialization for logging purpose when debug logging is turned on.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to