Re: Discuss about Drill's schedule policy

Hi Paul: I have read the codes of Sparrow and Spark-Sparrow last few days. It seems Sparrow can match Drill's architecture very well. According to sparrow's spark implementation, every MinorFragment can be treat as a spark task ,a MajorFragment can be treat as a spark taskset. We will start a

Re: Discuss about Drill's schedule policy

Maybe we need to adjust the MajorFragments execution phase as the intermediate MajorFragments are lazy executed now(if the intermediate fragments tasks are lazy allocated or not allocated due to resource restrict, the down stream running works will couldn't send their data out). We should let Majo

[GitHub] drill issue #921: DRILL-4286 Graceful shutdown of drillbit

Github user weijietong commented on the issue: https://github.com/apache/drill/pull/921 @dvjyothsna thanks for your contribution. Some objections please consider, the shutdown process should be quick and allow fault occurred. Google calls it lame duck model. If your cluster is large a

Re: Discuss about Drill's schedule policy

Hi Weijie, Thanks much for the suggestions! It will take a while to digest all of this as Drill’s existing scheduler (for fragments) is quite complex, but it works. I’ll need to map those concepts to Sparrow. We still don’t have query-level scheduling, but perhaps there is something that can be

[jira] [Created] (DRILL-5743) Using order by clause in a select * query on hbase table returns only the row_key and order by field(s)

Prasad Nagaraj Subramanya created DRILL-5743: Summary: Using order by clause in a select * query on hbase table returns only the row_key and order by field(s) Key: DRILL-5743 URL: https://issues.apache

[GitHub] drill pull request #906: DRILL-5546: Handle schema change exception failure ...

Github user jinfengni commented on a diff in the pull request: https://github.com/apache/drill/pull/906#discussion_r135423794 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/ScanBatch.java --- @@ -152,97 +157,75 @@ public void kill(boolean sendUpstream)

[GitHub] drill pull request #906: DRILL-5546: Handle schema change exception failure ...

Github user jinfengni commented on a diff in the pull request: https://github.com/apache/drill/pull/906#discussion_r135424090 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/ScanBatch.java --- @@ -152,97 +157,75 @@ public void kill(boolean sendUpstream)

[GitHub] drill pull request #906: DRILL-5546: Handle schema change exception failure ...

Github user jinfengni commented on a diff in the pull request: https://github.com/apache/drill/pull/906#discussion_r135424127 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/ScanBatch.java --- @@ -152,97 +157,75 @@ public void kill(boolean sendUpstream)

[GitHub] drill pull request #910: DRILL-5726: Support Impersonation without authentic...

Github user sohami commented on a diff in the pull request: https://github.com/apache/drill/pull/910#discussion_r135438164 --- Diff: exec/java-exec/src/main/resources/rest/query/query.ftl --- @@ -47,8 +58,32 @@ Query -Submit + +"b

Re: Drill developer guide or code organization

Thank you Paul and Muhammad. This is very valuable information. Thanks Aditya On Sun, Aug 27, 2017 at 1:50 AM, Paul Rogers wrote: > Hi Aditya, > > Drill does not have a good overview at present. The Wiki pages that > Muhammad pointed out are about all that we can offer. > > Some general guideli