[jira] [Comment Edited] (SPARK-20006) Separate threshold for broadcast and shuffled hash join

[ https://issues.apache.org/jira/browse/SPARK-20006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931054#comment-15931054 ] Zhan Zhang edited comment on SPARK-20006 at 3/18/17 4:42 AM: - The default

[jira] [Commented] (SPARK-20006) Separate threshold for broadcast and shuffled hash join

[ https://issues.apache.org/jira/browse/SPARK-20006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931054#comment-15931054 ] Zhan Zhang commented on SPARK-20006: The default ShuffledHashJoin threshold can fallback to the

[jira] [Commented] (SPARK-20006) Separate threshold for broadcast and shuffled hash join

[ https://issues.apache.org/jira/browse/SPARK-20006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931050#comment-15931050 ] Takeshi Yamamuro commented on SPARK-20006: -- I feel more options we have for controlling plan

[jira] [Commented] (SPARK-20009) Use user-friendly DDL formats for defining a schema in user-facing APIs

[ https://issues.apache.org/jira/browse/SPARK-20009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931044#comment-15931044 ] Takeshi Yamamuro commented on SPARK-20009: -- Does this make sense? cc: [~smilegator] My prototype

[jira] [Created] (SPARK-20009) Use user-friendly DDL formats for defining a schema in user-facing APIs

Takeshi Yamamuro created SPARK-20009: Summary: Use user-friendly DDL formats for defining a schema in user-facing APIs Key: SPARK-20009 URL: https://issues.apache.org/jira/browse/SPARK-20009

[jira] [Commented] (SPARK-18886) Delay scheduling should not delay some executors indefinitely if one task is scheduled before delay timeout

[ https://issues.apache.org/jira/browse/SPARK-18886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931009#comment-15931009 ] Kay Ousterhout commented on SPARK-18886: Sorry for the slow response here! I realized this is

[jira] [Resolved] (SPARK-11460) Locality waits should be based on task set creation time, not last launch time

[ https://issues.apache.org/jira/browse/SPARK-11460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Ousterhout resolved SPARK-11460. Resolution: Duplicate > Locality waits should be based on task set creation time, not last

[jira] [Comment Edited] (SPARK-20000) Spark Hive tests aborted due to lz4-java on ppc64le

[ https://issues.apache.org/jira/browse/SPARK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931011#comment-15931011 ] Takeshi Yamamuro edited comment on SPARK-2 at 3/18/17 2:22 AM: --- oh!

[jira] [Commented] (SPARK-20000) Spark Hive tests aborted due to lz4-java on ppc64le

[ https://issues.apache.org/jira/browse/SPARK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931011#comment-15931011 ] Takeshi Yamamuro commented on SPARK-2: -- oh! congrat! > Spark Hive tests aborted due to

[jira] [Created] (SPARK-20008) hiveContext.emptyDataFrame.except(hiveContext.emptyDataFrame).count() returns 1

Ravindra Bajpai created SPARK-20008: --- Summary: hiveContext.emptyDataFrame.except(hiveContext.emptyDataFrame).count() returns 1 Key: SPARK-20008 URL: https://issues.apache.org/jira/browse/SPARK-20008

[jira] [Comment Edited] (SPARK-20001) Support PythonRunner executing inside a Conda env

[ https://issues.apache.org/jira/browse/SPARK-20001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15930922#comment-15930922 ] Jeff Zhang edited comment on SPARK-20001 at 3/18/17 12:17 AM: -- Thanks

[jira] [Comment Edited] (SPARK-20001) Support PythonRunner executing inside a Conda env

[ https://issues.apache.org/jira/browse/SPARK-20001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15930922#comment-15930922 ] Jeff Zhang edited comment on SPARK-20001 at 3/18/17 12:14 AM: -- Thanks

[jira] [Issue Comment Deleted] (SPARK-20001) Support PythonRunner executing inside a Conda env

[ https://issues.apache.org/jira/browse/SPARK-20001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-20001: --- Comment: was deleted (was: Thanks [~dansanduleac] It looks like we are do similar things, recently I

[jira] [Commented] (SPARK-20001) Support PythonRunner executing inside a Conda env

[ https://issues.apache.org/jira/browse/SPARK-20001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15930924#comment-15930924 ] Jeff Zhang commented on SPARK-20001: Thanks [~dansanduleac] It looks like we are do similar things,

[jira] [Commented] (SPARK-20001) Support PythonRunner executing inside a Conda env

[ https://issues.apache.org/jira/browse/SPARK-20001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15930922#comment-15930922 ] Jeff Zhang commented on SPARK-20001: Thanks [~dansanduleac] It looks like we are do similar things,

[jira] [Resolved] (SPARK-18890) Do all task serialization in CoarseGrainedExecutorBackend thread (rather than TaskSchedulerImpl)

[ https://issues.apache.org/jira/browse/SPARK-18890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Ousterhout resolved SPARK-18890. Resolution: Invalid I closed this because, as [~imranr] pointed out on the PR, these

[jira] [Commented] (SPARK-19565) After fetching failed, success of old attempt of stage should be taken as valid.

[ https://issues.apache.org/jira/browse/SPARK-19565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15930910#comment-15930910 ] Kay Ousterhout commented on SPARK-19565: [~jinxing6...@126.com] I closed this because it looks

[jira] [Resolved] (SPARK-19565) After fetching failed, success of old attempt of stage should be taken as valid.

[ https://issues.apache.org/jira/browse/SPARK-19565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Ousterhout resolved SPARK-19565. Resolution: Duplicate > After fetching failed, success of old attempt of stage should be

[jira] [Commented] (SPARK-19755) Blacklist is always active for MesosCoarseGrainedSchedulerBackend. As result - scheduler cannot create an executor after some time.

[ https://issues.apache.org/jira/browse/SPARK-19755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15930909#comment-15930909 ] Kay Ousterhout commented on SPARK-19755: I'm closing this because the configs you're proposing

[jira] [Resolved] (SPARK-19755) Blacklist is always active for MesosCoarseGrainedSchedulerBackend. As result - scheduler cannot create an executor after some time.

[ https://issues.apache.org/jira/browse/SPARK-19755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Ousterhout resolved SPARK-19755. Resolution: Not A Problem > Blacklist is always active for

[jira] [Resolved] (SPARK-19873) If the user changes the number of shuffle partitions between batches, Streaming aggregation will fail.

[ https://issues.apache.org/jira/browse/SPARK-19873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-19873. --- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17216

[jira] [Resolved] (SPARK-19967) Add from_json APIs to SQL

[ https://issues.apache.org/jira/browse/SPARK-19967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-19967. - Resolution: Fixed Fix Version/s: 2.2.0 > Add from_json APIs to SQL > - >

[jira] [Assigned] (SPARK-19967) Add from_json APIs to SQL

[ https://issues.apache.org/jira/browse/SPARK-19967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-19967: --- Assignee: Takeshi Yamamuro > Add from_json APIs to SQL > - > >

[jira] [Commented] (SPARK-19967) Add from_json APIs to SQL

[ https://issues.apache.org/jira/browse/SPARK-19967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15930796#comment-15930796 ] Xiao Li commented on SPARK-19967: - Resolved in the PR

[jira] [Created] (SPARK-20007) Make SparkR apply() functions robust to workers that return empty data.frame

Hossein Falaki created SPARK-20007: -- Summary: Make SparkR apply() functions robust to workers that return empty data.frame Key: SPARK-20007 URL: https://issues.apache.org/jira/browse/SPARK-20007

[jira] [Resolved] (SPARK-18847) PageRank gives incorrect results for graphs with sinks

[ https://issues.apache.org/jira/browse/SPARK-18847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-18847. - Resolution: Fixed Assignee: Andrew Ray Fix Version/s: 2.2.0 > PageRank gives

[jira] [Closed] (SPARK-16878) YARN - topology information

[ https://issues.apache.org/jira/browse/SPARK-16878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shubham Chopra closed SPARK-16878. -- Resolution: Unresolved Withdrawing issue. As a stop-gap, a file based topology mapper can be

[jira] [Updated] (SPARK-20006) Separate threshold for broadcast and shuffled hash join

[ https://issues.apache.org/jira/browse/SPARK-20006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated SPARK-20006: --- Description: Currently both canBroadcast and canBuildLocalHashMap use the same configuration:

[jira] [Created] (SPARK-20006) Separate threshold for broadcast and shuffled hash join

Zhan Zhang created SPARK-20006: -- Summary: Separate threshold for broadcast and shuffled hash join Key: SPARK-20006 URL: https://issues.apache.org/jira/browse/SPARK-20006 Project: Spark Issue

[jira] [Updated] (SPARK-20005) There is no "Newline" in UI in describtion

[ https://issues.apache.org/jira/browse/SPARK-20005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Egor Pahomov updated SPARK-20005: - Description: There is no "newline" in UI in describtion: https://ibb.co/bLp2yv (was: Just see

[jira] [Created] (SPARK-20005) There is no "Newline" in UI in describtion

Egor Pahomov created SPARK-20005: Summary: There is no "Newline" in UI in describtion Key: SPARK-20005 URL: https://issues.apache.org/jira/browse/SPARK-20005 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-20004) Spark thrift server ovewrites spark.app.name

[ https://issues.apache.org/jira/browse/SPARK-20004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Egor Pahomov updated SPARK-20004: - Summary: Spark thrift server ovewrites spark.app.name (was: Spark thrift server ovverides

[jira] [Created] (SPARK-20004) Spark thrift server ovverides spark.app.name

Egor Pahomov created SPARK-20004: Summary: Spark thrift server ovverides spark.app.name Key: SPARK-20004 URL: https://issues.apache.org/jira/browse/SPARK-20004 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-20003) FPGrowthModel setMinConfidence should affect rules generation and transform

[ https://issues.apache.org/jira/browse/SPARK-20003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuhao yang updated SPARK-20003: --- Description: I was doing some test and find the issue. FPGrowthModel setMinConfidence should affect

[jira] [Created] (SPARK-20003) FPGrowthModel setMinConfidence should affect rules generation and transform

yuhao yang created SPARK-20003: -- Summary: FPGrowthModel setMinConfidence should affect rules generation and transform Key: SPARK-20003 URL: https://issues.apache.org/jira/browse/SPARK-20003 Project:

[jira] [Commented] (SPARK-19941) Spark should not schedule tasks on executors on decommissioning YARN nodes

[ https://issues.apache.org/jira/browse/SPARK-19941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15930433#comment-15930433 ] Karthik Palaniappan commented on SPARK-19941: - Yeah, I could have been more clear. The

[jira] [Comment Edited] (SPARK-19941) Spark should not schedule tasks on executors on decommissioning YARN nodes

[ https://issues.apache.org/jira/browse/SPARK-19941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15930433#comment-15930433 ] Karthik Palaniappan edited comment on SPARK-19941 at 3/17/17 6:28 PM:

[jira] [Updated] (SPARK-20001) Support PythonRunner executing inside a Conda env

[ https://issues.apache.org/jira/browse/SPARK-20001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Ash updated SPARK-20001: --- Description: Similar to SPARK-13587, I'm trying to allow the user to configure a Conda environment

[jira] [Updated] (SPARK-20001) Support PythonRunner executing inside a Conda env

[ https://issues.apache.org/jira/browse/SPARK-20001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Ash updated SPARK-20001: --- Description: Similar to SPARK-13587, I'm trying to allow the user to configure a Conda environment

[jira] [Updated] (SPARK-18971) Netty issue may cause the shuffle client hang

[ https://issues.apache.org/jira/browse/SPARK-18971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-18971: - Description: Check https://github.com/netty/netty/issues/6153 for details You should be able to

[jira] [Resolved] (SPARK-19986) Make pyspark.streaming.tests.CheckpointTests more stable

[ https://issues.apache.org/jira/browse/SPARK-19986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-19986. --- Resolution: Fixed Fix Version/s: 2.2.0 2.0.3

[jira] [Created] (SPARK-20002) Add support for unions between streaming and batch datasets

Leon Pham created SPARK-20002: - Summary: Add support for unions between streaming and batch datasets Key: SPARK-20002 URL: https://issues.apache.org/jira/browse/SPARK-20002 Project: Spark Issue

[jira] [Resolved] (SPARK-19721) Good error message for version mismatch in log files

[ https://issues.apache.org/jira/browse/SPARK-19721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-19721. -- Resolution: Fixed Fix Version/s: 2.1.1 > Good error message for version mismatch in log

[jira] [Updated] (SPARK-20001) Support PythonRunner executing inside a Conda env

[ https://issues.apache.org/jira/browse/SPARK-20001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Sanduleac updated SPARK-20001: -- Description: Similar to SPARK-13587, I'm trying to allow the user to configure a Conda

[jira] [Created] (SPARK-20001) Support PythonRunner executing inside a Conda env

Dan Sanduleac created SPARK-20001: - Summary: Support PythonRunner executing inside a Conda env Key: SPARK-20001 URL: https://issues.apache.org/jira/browse/SPARK-20001 Project: Spark Issue

[jira] [Resolved] (SPARK-19997) proxy-user failed connecting to a kerberos configured metastore

[ https://issues.apache.org/jira/browse/SPARK-19997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-19997. Resolution: Duplicate > proxy-user failed connecting to a kerberos configured metastore >

[jira] [Commented] (SPARK-19982) JavaDatasetSuite.testJavaBeanEncoder sometimes fails with "Unable to generate an encoder for inner class"

[ https://issues.apache.org/jira/browse/SPARK-19982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15930094#comment-15930094 ] Jose Soltren commented on SPARK-19982: -- Pasting in the exception from the link in case the link

[jira] [Commented] (SPARK-13369) Number of consecutive fetch failures for a stage before the job is aborted should be configurable

[ https://issues.apache.org/jira/browse/SPARK-13369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15930063#comment-15930063 ] Imran Rashid commented on SPARK-13369: -- Thanks for fixing this [~sitalke...@gmail.com]. I just

[jira] [Updated] (SPARK-13369) Number of consecutive fetch failures for a stage before the job is aborted should be configurable

[ https://issues.apache.org/jira/browse/SPARK-13369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-13369: - Description: The previously hardcoded max 4 retries per stage is not suitable for all cluster

[jira] [Assigned] (SPARK-13369) Number of consecutive fetch failures for a stage before the job is aborted should be configurable

[ https://issues.apache.org/jira/browse/SPARK-13369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-13369: Assignee: Imran Rashid > Number of consecutive fetch failures for a stage before the job

[jira] [Assigned] (SPARK-13369) Number of consecutive fetch failures for a stage before the job is aborted should be configurable

[ https://issues.apache.org/jira/browse/SPARK-13369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-13369: Assignee: Sital Kedia (was: Imran Rashid) > Number of consecutive fetch failures for a

[jira] [Resolved] (SPARK-13369) Number of consecutive fetch failures for a stage before the job is aborted should be configurable

[ https://issues.apache.org/jira/browse/SPARK-13369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-13369. -- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17307

[jira] [Resolved] (SPARK-19996) transfer spark-defaults.conf to spark-defaults.xml

[ https://issues.apache.org/jira/browse/SPARK-19996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-19996. --- Resolution: Invalid > transfer spark-defaults.conf to spark-defaults.xml >

[jira] [Commented] (SPARK-19644) Memory leak in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-19644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15929979#comment-15929979 ] Deenbandhu Agarwal commented on SPARK-19644: Any updates ?? > Memory leak in Spark Streaming

[jira] [Commented] (SPARK-20000) Spark Hive tests aborted due to lz4-java on ppc64le

[ https://issues.apache.org/jira/browse/SPARK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15929965#comment-15929965 ] Sean Owen commented on SPARK-2: --- 2! > Spark Hive tests aborted due to lz4-java on ppc64le >

[jira] [Commented] (SPARK-19992) spark-submit on deployment-mode cluster

[ https://issues.apache.org/jira/browse/SPARK-19992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15929762#comment-15929762 ] narendra maru commented on SPARK-19992: --- yes I am having same yarn jars and spark_home directory on

[jira] [Updated] (SPARK-19996) transfer spark-defaults.conf to spark-defaults.xml

[ https://issues.apache.org/jira/browse/SPARK-19996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hanzhi updated SPARK-19996: --- Docs Text: support xml include，more convenient。 (was: support xml include function，more convenient。) >

[jira] [Updated] (SPARK-20000) Spark Hive tests aborted due to lz4-java on ppc64le

[ https://issues.apache.org/jira/browse/SPARK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sonia Garudi updated SPARK-2: - Attachment: hs_err_pid.log > Spark Hive tests aborted due to lz4-java on ppc64le >

[jira] [Created] (SPARK-20000) Spark Hive tests aborted due to lz4-java on ppc64le

Sonia Garudi created SPARK-2: Summary: Spark Hive tests aborted due to lz4-java on ppc64le Key: SPARK-2 URL: https://issues.apache.org/jira/browse/SPARK-2 Project: Spark Issue

[jira] [Updated] (SPARK-19997) proxy-user failed connecting to a kerberos configured metastore

[ https://issues.apache.org/jira/browse/SPARK-19997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-19997: - Description: Start runing spark-sql via proxy-user on a kerberos configured hadoop cluster and

[jira] [Created] (SPARK-19999) Test failures in Spark Core due to java.nio.Bits.unaligned()

Sonia Garudi created SPARK-1: Summary: Test failures in Spark Core due to java.nio.Bits.unaligned() Key: SPARK-1 URL: https://issues.apache.org/jira/browse/SPARK-1 Project: Spark

[jira] [Updated] (SPARK-19997) proxy-user failed connecting to a kerberos configured metastore

[ https://issues.apache.org/jira/browse/SPARK-19997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-19997: - Description: Start runing spark-sql via proxy-user on a kerberos configured hadoop cluster and

[jira] [Created] (SPARK-19998) BlockRDD block not found Exception add RDD id info

jianran.tfh created SPARK-19998: --- Summary: BlockRDD block not found Exception add RDD id info Key: SPARK-19998 URL: https://issues.apache.org/jira/browse/SPARK-19998 Project: Spark Issue Type:

[jira] [Created] (SPARK-19997) proxy-user failed connecting to a kerberos configured metastore

Kent Yao created SPARK-19997: Summary: proxy-user failed connecting to a kerberos configured metastore Key: SPARK-19997 URL: https://issues.apache.org/jira/browse/SPARK-19997 Project: Spark

[jira] [Commented] (SPARK-18278) Support native submission of spark jobs to a kubernetes cluster

[ https://issues.apache.org/jira/browse/SPARK-18278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15929591#comment-15929591 ] Andrew Ash commented on SPARK-18278: As an update on this ticket: For those not already aware, work

[jira] [Assigned] (SPARK-19882) Pivot with null as the pivot value throws NPE

[ https://issues.apache.org/jira/browse/SPARK-19882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-19882: --- Assignee: Andrew Ray > Pivot with null as the pivot value throws NPE >

[jira] [Resolved] (SPARK-19882) Pivot with null as the pivot value throws NPE

[ https://issues.apache.org/jira/browse/SPARK-19882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-19882. - Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17226

[jira] [Updated] (SPARK-19927) SparkThriftServer2 can not get ''--hivevar" variables in spark 2.1

[ https://issues.apache.org/jira/browse/SPARK-19927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bruce xu updated SPARK-19927: - Description: suppose the content of file test1.sql: -

[jira] [Commented] (SPARK-19996) transfer spark-defaults.conf to spark-defaults.xml

[ https://issues.apache.org/jira/browse/SPARK-19996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15929580#comment-15929580 ] Sean Owen commented on SPARK-19996: --- What is this about? The conf file isn't going to be switched to

[jira] [Updated] (SPARK-19927) SparkThriftServer2 can not get ''--hivevar" variables in spark 2.1

[ https://issues.apache.org/jira/browse/SPARK-19927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bruce xu updated SPARK-19927: - Affects Version/s: 2.0.1 > SparkThriftServer2 can not get ''--hivevar" variables in spark 2.1 >

[jira] [Created] (SPARK-19996) transfer spark-defaults.conf to spark-defaults.xml

hanzhi created SPARK-19996: -- Summary: transfer spark-defaults.conf to spark-defaults.xml Key: SPARK-19996 URL: https://issues.apache.org/jira/browse/SPARK-19996 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-19995) Using real user to connect HiveMetastore in HiveClientImpl

Saisai Shao created SPARK-19995: --- Summary: Using real user to connect HiveMetastore in HiveClientImpl Key: SPARK-19995 URL: https://issues.apache.org/jira/browse/SPARK-19995 Project: Spark

[jira] [Comment Edited] (SPARK-19992) spark-submit on deployment-mode cluster

[ https://issues.apache.org/jira/browse/SPARK-19992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15929547#comment-15929547 ] Saisai Shao edited comment on SPARK-19992 at 3/17/17 7:48 AM: -- Looks like I

[jira] [Commented] (SPARK-19992) spark-submit on deployment-mode cluster

[ https://issues.apache.org/jira/browse/SPARK-19992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15929547#comment-15929547 ] Saisai Shao commented on SPARK-19992: - Looks like I guess wrong from the url you provided. If you're

[jira] [Commented] (SPARK-19992) spark-submit on deployment-mode cluster

[ https://issues.apache.org/jira/browse/SPARK-19992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15929546#comment-15929546 ] narendra maru commented on SPARK-19992: --- hi saisai i am working on plain Hadoop 2.6.0 so is

[jira] [Commented] (SPARK-19992) spark-submit on deployment-mode cluster

[ https://issues.apache.org/jira/browse/SPARK-19992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15929545#comment-15929545 ] narendra maru commented on SPARK-19992: --- thanks sean for a quick reply I am suffering from last

[jira] [Commented] (SPARK-19992) spark-submit on deployment-mode cluster

[ https://issues.apache.org/jira/browse/SPARK-19992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15929544#comment-15929544 ] Saisai Shao commented on SPARK-19992: - Are you using HDP environment, if so I guess need to

[jira] [Commented] (SPARK-19992) spark-submit on deployment-mode cluster

[ https://issues.apache.org/jira/browse/SPARK-19992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15929529#comment-15929529 ] Sean Owen commented on SPARK-19992: --- You have some build or environment problem. In particular I don't

[jira] [Created] (SPARK-19994) Wrong outputOrdering for right/full outer smj

Zhenhua Wang created SPARK-19994: Summary: Wrong outputOrdering for right/full outer smj Key: SPARK-19994 URL: https://issues.apache.org/jira/browse/SPARK-19994 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-19984) ERROR codegen.CodeGenerator: failed to compile: org.codehaus.commons.compiler.CompileException: File 'generated.java'

[ https://issues.apache.org/jira/browse/SPARK-19984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15929496#comment-15929496 ] Takeshi Yamamuro edited comment on SPARK-19984 at 3/17/17 6:41 AM: --- If

[jira] [Commented] (SPARK-19984) ERROR codegen.CodeGenerator: failed to compile: org.codehaus.commons.compiler.CompileException: File 'generated.java'

[ https://issues.apache.org/jira/browse/SPARK-19984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15929496#comment-15929496 ] Takeshi Yamamuro commented on SPARK-19984: -- If we could find reason about this issue, it'd be

[jira] [Created] (SPARK-19993) Caching logical plans containing subquery expressions does not work.

Dilip Biswal created SPARK-19993: Summary: Caching logical plans containing subquery expressions does not work. Key: SPARK-19993 URL: https://issues.apache.org/jira/browse/SPARK-19993 Project: Spark

[jira] [Created] (SPARK-19992) spark-submit on deployment-mode cluster

narendra maru created SPARK-19992: - Summary: spark-submit on deployment-mode cluster Key: SPARK-19992 URL: https://issues.apache.org/jira/browse/SPARK-19992 Project: Spark Issue Type: Bug