[jira] [Reopened] (SPARK-22600) Fix 64kb limit for deeply nested expressions under wholestage codegen

[ https://issues.apache.org/jira/browse/SPARK-22600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reopened SPARK-22600: - > Fix 64kb limit for deeply nested expressions under wholestage codegen > ---

[jira] [Comment Edited] (SPARK-22600) Fix 64kb limit for deeply nested expressions under wholestage codegen

[ https://issues.apache.org/jira/browse/SPARK-22600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16290423#comment-16290423 ] Liang-Chi Hsieh edited comment on SPARK-22600 at 12/14/17 6:59 AM:

[jira] [Commented] (SPARK-22600) Fix 64kb limit for deeply nested expressions under wholestage codegen

[ https://issues.apache.org/jira/browse/SPARK-22600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16290423#comment-16290423 ] Liang-Chi Hsieh commented on SPARK-22600: - The current approach proposes a new co

[jira] [Updated] (SPARK-22779) ConfigEntry's default value should actually be a value

[ https://issues.apache.org/jira/browse/SPARK-22779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-22779: Fix Version/s: 2.3.0 Component/s: (was: Spark Core) SQL > ConfigEntry's defaul

[jira] [Resolved] (SPARK-22779) ConfigEntry's default value should actually be a value

[ https://issues.apache.org/jira/browse/SPARK-22779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22779. - Resolution: Fixed Assignee: Marcelo Vanzin (was: Reynold Xin) > ConfigEntry's default value should

[jira] [Resolved] (SPARK-22732) Add DataSourceV2 streaming APIs

[ https://issues.apache.org/jira/browse/SPARK-22732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-22732. -- Resolution: Fixed Assignee: Jose Torres Fix Version/s: 2.3.0 > Add DataSourceV2

[jira] [Resolved] (SPARK-3181) Add Robust Regression Algorithm with Huber Estimator

[ https://issues.apache.org/jira/browse/SPARK-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang resolved SPARK-3181. Resolution: Fixed Fix Version/s: 2.3.0 > Add Robust Regression Algorithm with Huber Estimator

[jira] [Commented] (SPARK-22776) Increase default value of spark.sql.codegen.maxFields

[ https://issues.apache.org/jira/browse/SPARK-22776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16290351#comment-16290351 ] Kazuaki Ishizaki commented on SPARK-22776: -- Wait for re-merging SPARK-22600 > I

[jira] [Updated] (SPARK-22781) Support creating streaming dataset with ORC files

[ https://issues.apache.org/jira/browse/SPARK-22781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-22781: -- Summary: Support creating streaming dataset with ORC files (was: Support creating streaming da

[jira] [Assigned] (SPARK-22781) Support creating streaming dataset with ORC file format

[ https://issues.apache.org/jira/browse/SPARK-22781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22781: Assignee: Apache Spark > Support creating streaming dataset with ORC file format > ---

[jira] [Commented] (SPARK-22781) Support creating streaming dataset with ORC file format

[ https://issues.apache.org/jira/browse/SPARK-22781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16290323#comment-16290323 ] Apache Spark commented on SPARK-22781: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Assigned] (SPARK-22781) Support creating streaming dataset with ORC file format

[ https://issues.apache.org/jira/browse/SPARK-22781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22781: Assignee: (was: Apache Spark) > Support creating streaming dataset with ORC file forma

[jira] [Created] (SPARK-22781) Support creating streaming dataset with ORC file format

Dongjoon Hyun created SPARK-22781: - Summary: Support creating streaming dataset with ORC file format Key: SPARK-22781 URL: https://issues.apache.org/jira/browse/SPARK-22781 Project: Spark Iss

[jira] [Commented] (SPARK-22779) ConfigEntry's default value should actually be a value

[ https://issues.apache.org/jira/browse/SPARK-22779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16290259#comment-16290259 ] Apache Spark commented on SPARK-22779: -- User 'vanzin' has created a pull request for

[jira] [Updated] (SPARK-21417) Detect transitive join conditions via expressions

[ https://issues.apache.org/jira/browse/SPARK-21417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-21417: -- Fix Version/s: (was: 2.3.0) > Detect transitive join conditions via expressions > -

[jira] [Commented] (SPARK-22771) SQL concat for binary

[ https://issues.apache.org/jira/browse/SPARK-22771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16290174#comment-16290174 ] Takeshi Yamamuro commented on SPARK-22771: -- ok, I'll take > SQL concat for bina

[jira] [Commented] (SPARK-7721) Generate test coverage report from Python

[ https://issues.apache.org/jira/browse/SPARK-7721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16290175#comment-16290175 ] Hyukjin Kwon commented on SPARK-7721: - Sure, I didn't mean to rush and start to procee

[jira] [Created] (SPARK-22780) make insert commands have real children to fix UI issues

Wenchen Fan created SPARK-22780: --- Summary: make insert commands have real children to fix UI issues Key: SPARK-22780 URL: https://issues.apache.org/jira/browse/SPARK-22780 Project: Spark Issue

[jira] [Updated] (SPARK-22716) Avoid the creation of mutable states in addReferenceObj

[ https://issues.apache.org/jira/browse/SPARK-22716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-22716: Parent Issue: SPARK-22692 (was: SPARK-22510) > Avoid the creation of mutable states in addReferenceObj > -

[jira] [Updated] (SPARK-22776) Increase default value of spark.sql.codegen.maxFields

[ https://issues.apache.org/jira/browse/SPARK-22776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-22776: Issue Type: Sub-task (was: Improvement) Parent: SPARK-22510 > Increase default value of spark.sql.

[jira] [Commented] (SPARK-22771) SQL concat for binary

[ https://issues.apache.org/jira/browse/SPARK-22771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16290160#comment-16290160 ] Xiao Li commented on SPARK-22771: - This looks reasonable. We should fix it. > SQL concat

[jira] [Commented] (SPARK-22359) Improve the test coverage of window functions

[ https://issues.apache.org/jira/browse/SPARK-22359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16290159#comment-16290159 ] Xiao Li commented on SPARK-22359: - https://github.com/postgrespro/postgrespro/blob/ac92c4

[jira] [Updated] (SPARK-22747) Shorten lifetime of global variables used in HashAggregateExec

[ https://issues.apache.org/jira/browse/SPARK-22747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-22747: Issue Type: Sub-task (was: Improvement) Parent: SPARK-22510 > Shorten lifetime of global variables

[jira] [Updated] (SPARK-22716) Avoid the creation of mutable states in addReferenceObj

[ https://issues.apache.org/jira/browse/SPARK-22716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-22716: Issue Type: Sub-task (was: Improvement) Parent: SPARK-22510 > Avoid the creation of mutable states

[jira] [Updated] (SPARK-22669) Avoid unnecessary function calls in code generation

[ https://issues.apache.org/jira/browse/SPARK-22669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-22669: Issue Type: Sub-task (was: Bug) Parent: SPARK-22510 > Avoid unnecessary function calls in code gen

[jira] [Commented] (SPARK-22752) FileNotFoundException while reading from Kafka

[ https://issues.apache.org/jira/browse/SPARK-22752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16290150#comment-16290150 ] Shixiong Zhu commented on SPARK-22752: -- What's your code? You probably hit SPARK-219

[jira] [Updated] (SPARK-22772) elt should use splitExpressionsWithCurrentInputs to split expression codes

[ https://issues.apache.org/jira/browse/SPARK-22772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-22772: Issue Type: Sub-task (was: Bug) Parent: SPARK-22510 > elt should use splitExpressionsWithCurrentIn

[jira] [Commented] (SPARK-7721) Generate test coverage report from Python

[ https://issues.apache.org/jira/browse/SPARK-7721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16290134#comment-16290134 ] Reynold Xin commented on SPARK-7721: We definitely don't need to do it in one-go, but

[jira] [Commented] (SPARK-22771) SQL concat for binary

[ https://issues.apache.org/jira/browse/SPARK-22771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16290101#comment-16290101 ] Takeshi Yamamuro commented on SPARK-22771: -- [~smilegator] It's worth fixing this

[jira] [Updated] (SPARK-22600) Fix 64kb limit for deeply nested expressions under wholestage codegen

[ https://issues.apache.org/jira/browse/SPARK-22600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-22600: Issue Type: Sub-task (was: Bug) Parent: SPARK-22510 > Fix 64kb limit for deeply nested expressions

[jira] [Resolved] (SPARK-21870) Split codegen'd aggregation code into small functions for the HotSpot

[ https://issues.apache.org/jira/browse/SPARK-21870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-21870. - Resolution: Duplicate > Split codegen'd aggregation code into small functions for the HotSpot > -

[jira] [Resolved] (SPARK-22756) Run SparkR tests if hive_thriftserver module has code changes

[ https://issues.apache.org/jira/browse/SPARK-22756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-22756. -- Resolution: Not A Problem Hey [~smilegator], let me leave this resolved based on what we talked

[jira] [Assigned] (SPARK-22779) ConfigEntry's default value should actually be a value

[ https://issues.apache.org/jira/browse/SPARK-22779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22779: Assignee: Reynold Xin (was: Apache Spark) > ConfigEntry's default value should actually b

[jira] [Commented] (SPARK-22779) ConfigEntry's default value should actually be a value

[ https://issues.apache.org/jira/browse/SPARK-22779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16290054#comment-16290054 ] Apache Spark commented on SPARK-22779: -- User 'rxin' has created a pull request for t

[jira] [Assigned] (SPARK-22779) ConfigEntry's default value should actually be a value

[ https://issues.apache.org/jira/browse/SPARK-22779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22779: Assignee: Apache Spark (was: Reynold Xin) > ConfigEntry's default value should actually b

[jira] [Updated] (SPARK-22496) beeline display operation log

[ https://issues.apache.org/jira/browse/SPARK-22496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-22496: - Fix Version/s: (was: 2.3.0) > beeline display operation log > - >

[jira] [Reopened] (SPARK-22496) beeline display operation log

[ https://issues.apache.org/jira/browse/SPARK-22496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-22496: -- > beeline display operation log > - > > Key: SPARK-2249

[jira] [Created] (SPARK-22779) ConfigEntry's default value should actually be a value

Reynold Xin created SPARK-22779: --- Summary: ConfigEntry's default value should actually be a value Key: SPARK-22779 URL: https://issues.apache.org/jira/browse/SPARK-22779 Project: Spark Issue Ty

[jira] [Assigned] (SPARK-22764) Flaky test: SparkContextSuite "Cancelling stages/jobs with custom reasons"

[ https://issues.apache.org/jira/browse/SPARK-22764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-22764: Assignee: Marcelo Vanzin > Flaky test: SparkContextSuite "Cancelling stages/jobs with cust

[jira] [Resolved] (SPARK-22764) Flaky test: SparkContextSuite "Cancelling stages/jobs with custom reasons"

[ https://issues.apache.org/jira/browse/SPARK-22764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-22764. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19956 [https://git

[jira] [Resolved] (SPARK-22772) elt should use splitExpressionsWithCurrentInputs to split expression codes

[ https://issues.apache.org/jira/browse/SPARK-22772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22772. - Resolution: Fixed Assignee: Liang-Chi Hsieh Fix Version/s: 2.3.0 > elt should use splitEx

[jira] [Commented] (SPARK-22647) Docker files for image creation

[ https://issues.apache.org/jira/browse/SPARK-22647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289988#comment-16289988 ] Erik Erlandson commented on SPARK-22647: I'd like to propose migrating our images

[jira] [Comment Edited] (SPARK-22359) Improve the test coverage of window functions

[ https://issues.apache.org/jira/browse/SPARK-22359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289965#comment-16289965 ] Gabor Somogyi edited comment on SPARK-22359 at 12/13/17 9:42 PM: --

[jira] [Commented] (SPARK-22359) Improve the test coverage of window functions

[ https://issues.apache.org/jira/browse/SPARK-22359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289965#comment-16289965 ] Gabor Somogyi commented on SPARK-22359: --- OK, then I'll jump on Frames. > Improve t

[jira] [Assigned] (SPARK-22574) Wrong request causing Spark Dispatcher going inactive

[ https://issues.apache.org/jira/browse/SPARK-22574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-22574: -- Assignee: German Schiavon Matteo > Wrong request causing Spark Dispatcher going inacti

[jira] [Resolved] (SPARK-22574) Wrong request causing Spark Dispatcher going inactive

[ https://issues.apache.org/jira/browse/SPARK-22574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-22574. Resolution: Fixed Fix Version/s: 2.3.0 2.2.2 Issue resolved by pu

[jira] [Commented] (SPARK-22778) Kubernetes scheduler at master failing to run applications successfully

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289923#comment-16289923 ] Apache Spark commented on SPARK-22778: -- User 'liyinan926' has created a pull request

[jira] [Assigned] (SPARK-22778) Kubernetes scheduler at master failing to run applications successfully

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22778: Assignee: Apache Spark > Kubernetes scheduler at master failing to run applications succes

[jira] [Assigned] (SPARK-22778) Kubernetes scheduler at master failing to run applications successfully

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22778: Assignee: (was: Apache Spark) > Kubernetes scheduler at master failing to run applicat

[jira] [Assigned] (SPARK-21417) Detect transitive join conditions via expressions

[ https://issues.apache.org/jira/browse/SPARK-21417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21417: Assignee: Anton Okolnychyi (was: Apache Spark) > Detect transitive join conditions via ex

[jira] [Assigned] (SPARK-21417) Detect transitive join conditions via expressions

[ https://issues.apache.org/jira/browse/SPARK-21417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21417: Assignee: Apache Spark (was: Anton Okolnychyi) > Detect transitive join conditions via ex

[jira] [Commented] (SPARK-22778) Kubernetes scheduler at master failing to run applications successfully

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289907#comment-16289907 ] Yinan Li commented on SPARK-22778: -- Just verified that the fix worked. I'm gonna send a

[jira] [Reopened] (SPARK-21417) Detect transitive join conditions via expressions

[ https://issues.apache.org/jira/browse/SPARK-21417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reopened SPARK-21417: - > Detect transitive join conditions via expressions > - > >

[jira] [Resolved] (SPARK-21417) Detect transitive join conditions via expressions

[ https://issues.apache.org/jira/browse/SPARK-21417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-21417. - Resolution: Not A Problem > Detect transitive join conditions via expressions > -

[jira] [Reopened] (SPARK-21417) Detect transitive join conditions via expressions

[ https://issues.apache.org/jira/browse/SPARK-21417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reopened SPARK-21417: - > Detect transitive join conditions via expressions > - > >

[jira] [Commented] (SPARK-22778) Kubernetes scheduler at master failing to run applications successfully

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289881#comment-16289881 ] Anirudh Ramanathan commented on SPARK-22778: Excellent - thanks for the quick

[jira] [Commented] (SPARK-22778) Kubernetes scheduler at master failing to run applications successfully

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289876#comment-16289876 ] Yinan Li commented on SPARK-22778: -- Ah, yes, the PR missed that. OK, I'm gonna give that

[jira] [Commented] (SPARK-22778) Kubernetes scheduler at master failing to run applications successfully

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289875#comment-16289875 ] Matt Cheah commented on SPARK-22778: And then notice we don't even have a {{resources

[jira] [Commented] (SPARK-22778) Kubernetes scheduler at master failing to run applications successfully

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289871#comment-16289871 ] Matt Cheah commented on SPARK-22778: I see the problem. We're missing the {{META-INF.

[jira] [Comment Edited] (SPARK-22778) Kubernetes scheduler at master failing to run applications successfully

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289868#comment-16289868 ] Anirudh Ramanathan edited comment on SPARK-22778 at 12/13/17 8:41 PM: -

[jira] [Commented] (SPARK-22778) Kubernetes scheduler at master failing to run applications successfully

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289868#comment-16289868 ] Anirudh Ramanathan commented on SPARK-22778: I've verified that the image con

[jira] [Updated] (SPARK-22778) Kubernetes scheduler at master failing to run applications successfully

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Cheah updated SPARK-22778: --- Priority: Critical (was: Major) > Kubernetes scheduler at master failing to run applications success

[jira] [Comment Edited] (SPARK-22778) Kubernetes scheduler at master failing to run applications successfully

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289836#comment-16289836 ] Matt Cheah edited comment on SPARK-22778 at 12/13/17 8:28 PM: -

[jira] [Commented] (SPARK-22778) Kubernetes scheduler at master failing to run applications successfully

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289836#comment-16289836 ] Matt Cheah commented on SPARK-22778: The `canCreate` method for `KubernetesClusterMan

[jira] [Comment Edited] (SPARK-22778) Kubernetes scheduler at master failing to run applications successfully

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289822#comment-16289822 ] Yinan Li edited comment on SPARK-22778 at 12/13/17 8:24 PM: J

[jira] [Commented] (SPARK-22778) Kubernetes scheduler at master failing to run applications successfully

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289822#comment-16289822 ] Yinan Li commented on SPARK-22778: -- Just some background on this. The validation and par

[jira] [Comment Edited] (SPARK-22778) Kubernetes scheduler at master failing to run applications successfully

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289818#comment-16289818 ] Anirudh Ramanathan edited comment on SPARK-22778 at 12/13/17 8:23 PM: -

[jira] [Commented] (SPARK-22778) Kubernetes scheduler at master failing to run applications successfully

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289818#comment-16289818 ] Anirudh Ramanathan commented on SPARK-22778: I submitted it as `k8s://https:/

[jira] [Commented] (SPARK-22778) Kubernetes scheduler at master failing to run applications successfully

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289815#comment-16289815 ] Matt Cheah commented on SPARK-22778: Think that URI should be 'k8s://https://xx.yy.zz

[jira] [Updated] (SPARK-22778) Kubernetes scheduler at master failing to run applications successfully

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anirudh Ramanathan updated SPARK-22778: --- Description: Building images based on master and deploying Spark PI results in the fo

[jira] [Commented] (SPARK-22778) Kubernetes scheduler at master failing tests

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289808#comment-16289808 ] Anirudh Ramanathan commented on SPARK-22778: [~mcheah] [~kimoonkim] [~ifilone

[jira] [Updated] (SPARK-22778) Kubernetes scheduler at master failing to run applications successfully.

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anirudh Ramanathan updated SPARK-22778: --- Summary: Kubernetes scheduler at master failing to run applications successfully. (w

[jira] [Updated] (SPARK-22778) Kubernetes scheduler at master failing to run applications successfully

[ https://issues.apache.org/jira/browse/SPARK-22778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anirudh Ramanathan updated SPARK-22778: --- Summary: Kubernetes scheduler at master failing to run applications successfully (wa

[jira] [Created] (SPARK-22778) Kubernetes scheduler at master failing tests

Anirudh Ramanathan created SPARK-22778: -- Summary: Kubernetes scheduler at master failing tests Key: SPARK-22778 URL: https://issues.apache.org/jira/browse/SPARK-22778 Project: Spark Issu

[jira] [Comment Edited] (SPARK-22360) Add unit test for Window Specifications

[ https://issues.apache.org/jira/browse/SPARK-22360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289803#comment-16289803 ] Sandor Murakozi edited comment on SPARK-22360 at 12/13/17 8:09 PM:

[jira] [Commented] (SPARK-22647) Docker files for image creation

[ https://issues.apache.org/jira/browse/SPARK-22647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289805#comment-16289805 ] Anirudh Ramanathan commented on SPARK-22647: [~mcheah] [~erikerlandson] PTAL

[jira] [Commented] (SPARK-22360) Add unit test for Window Specifications

[ https://issues.apache.org/jira/browse/SPARK-22360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289803#comment-16289803 ] Sandor Murakozi commented on SPARK-22360: - I just did a quick check of the existi

[jira] [Comment Edited] (SPARK-22360) Add unit test for Window Specifications

[ https://issues.apache.org/jira/browse/SPARK-22360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289803#comment-16289803 ] Sandor Murakozi edited comment on SPARK-22360 at 12/13/17 8:08 PM:

[jira] [Updated] (SPARK-22777) Docker container built for Kubernetes doesn't allow running entrypoint.sh

[ https://issues.apache.org/jira/browse/SPARK-22777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anirudh Ramanathan updated SPARK-22777: --- Description: Default docker images built thrown an error when trying to run on a clus

[jira] [Updated] (SPARK-22777) Docker container built for Kubernetes doesn't allow running entrypoint.sh

[ https://issues.apache.org/jira/browse/SPARK-22777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anirudh Ramanathan updated SPARK-22777: --- Description: Default docker images built thrown an error when trying to run on a clus

[jira] [Updated] (SPARK-22777) Docker container built for Kubernetes doesn't allow running entrypoint.sh

[ https://issues.apache.org/jira/browse/SPARK-22777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anirudh Ramanathan updated SPARK-22777: --- Description: Default docker images built thrown an error when trying to run on a clus

[jira] [Updated] (SPARK-22777) Docker container built for Kubernetes doesn't allow running entrypoint.sh

[ https://issues.apache.org/jira/browse/SPARK-22777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anirudh Ramanathan updated SPARK-22777: --- Description: Default docker images built thrown an error when trying to run on a clus

[jira] [Comment Edited] (SPARK-22777) Docker container built for Kubernetes doesn't allow running entrypoint.sh

[ https://issues.apache.org/jira/browse/SPARK-22777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289795#comment-16289795 ] Anirudh Ramanathan edited comment on SPARK-22777 at 12/13/17 8:02 PM: -

[jira] [Updated] (SPARK-22777) Docker container built for Kubernetes doesn't allow running entrypoint.sh

[ https://issues.apache.org/jira/browse/SPARK-22777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anirudh Ramanathan updated SPARK-22777: --- [~liyinan926] [~ssuchter] > Docker container built for Kubernetes doesn't allow running

[jira] [Created] (SPARK-22777) Docker container built for Kubernetes doesn't allow running entrypoint.sh

Anirudh Ramanathan created SPARK-22777: -- Summary: Docker container built for Kubernetes doesn't allow running entrypoint.sh Key: SPARK-22777 URL: https://issues.apache.org/jira/browse/SPARK-22777

[jira] [Commented] (SPARK-22765) Create a new executor allocation scheme based on that of MR

[ https://issues.apache.org/jira/browse/SPARK-22765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289793#comment-16289793 ] Thomas Graves commented on SPARK-22765: --- ok so before you do anything else I would

[jira] [Commented] (SPARK-22359) Improve the test coverage of window functions

[ https://issues.apache.org/jira/browse/SPARK-22359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289792#comment-16289792 ] Sandor Murakozi commented on SPARK-22359: - I'm glad that you join [~gsomogyi]. D

[jira] [Assigned] (SPARK-22754) Check spark.executor.heartbeatInterval setting in case of ExecutorLost

[ https://issues.apache.org/jira/browse/SPARK-22754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-22754: -- Assignee: zhoukang > Check spark.executor.heartbeatInterval setting in case of Executo

[jira] [Resolved] (SPARK-22754) Check spark.executor.heartbeatInterval setting in case of ExecutorLost

[ https://issues.apache.org/jira/browse/SPARK-22754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-22754. Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19942 [https:/

[jira] [Created] (SPARK-22776) Increase default value of spark.sql.codegen.maxFields

Kazuaki Ishizaki created SPARK-22776: Summary: Increase default value of spark.sql.codegen.maxFields Key: SPARK-22776 URL: https://issues.apache.org/jira/browse/SPARK-22776 Project: Spark

[jira] [Commented] (SPARK-22765) Create a new executor allocation scheme based on that of MR

[ https://issues.apache.org/jira/browse/SPARK-22765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289726#comment-16289726 ] Xuefu Zhang commented on SPARK-22765: - Yes, we are using Hive on Spark. Our Spark ver

[jira] [Commented] (SPARK-22765) Create a new executor allocation scheme based on that of MR

[ https://issues.apache.org/jira/browse/SPARK-22765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289700#comment-16289700 ] Thomas Graves commented on SPARK-22765: --- ok so its basically they idle timeout duri

[jira] [Commented] (SPARK-22683) DynamicAllocation wastes resources by allocating containers that will barely be used

[ https://issues.apache.org/jira/browse/SPARK-22683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289689#comment-16289689 ] Xuefu Zhang commented on SPARK-22683: - [~tgraves], I can speak on our use case, where

[jira] [Comment Edited] (SPARK-22765) Create a new executor allocation scheme based on that of MR

[ https://issues.apache.org/jira/browse/SPARK-22765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289676#comment-16289676 ] Xuefu Zhang edited comment on SPARK-22765 at 12/13/17 6:30 PM:

[jira] [Updated] (SPARK-18278) SPIP: Support native submission of spark jobs to a kubernetes cluster

[ https://issues.apache.org/jira/browse/SPARK-18278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yinan Li updated SPARK-18278: - Component/s: Kubernetes > SPIP: Support native submission of spark jobs to a kubernetes cluster > ---

[jira] [Commented] (SPARK-22765) Create a new executor allocation scheme based on that of MR

[ https://issues.apache.org/jira/browse/SPARK-22765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289676#comment-16289676 ] Xuefu Zhang commented on SPARK-22765: - Hi [~tgraves], Thanks for your input. In our

[jira] [Commented] (SPARK-22683) DynamicAllocation wastes resources by allocating containers that will barely be used

[ https://issues.apache.org/jira/browse/SPARK-22683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289656#comment-16289656 ] Thomas Graves commented on SPARK-22683: --- I am also curious, when you are comparing

[jira] [Commented] (SPARK-22683) DynamicAllocation wastes resources by allocating containers that will barely be used

[ https://issues.apache.org/jira/browse/SPARK-22683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289614#comment-16289614 ] Thomas Graves commented on SPARK-22683: --- So the issue brought up here seems to be r

[jira] [Commented] (SPARK-22765) Create a new executor allocation scheme based on that of MR

[ https://issues.apache.org/jira/browse/SPARK-22765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289613#comment-16289613 ] Thomas Graves commented on SPARK-22765: --- why doesn't idle timeout very small < 5 se

[jira] [Assigned] (SPARK-22774) Add compilation check for generated code in TPCDSQuerySuite

[ https://issues.apache.org/jira/browse/SPARK-22774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22774: Assignee: Apache Spark > Add compilation check for generated code in TPCDSQuerySuite > ---

  1   2   >