[jira] [Assigned] (SPARK-24454) ml.image doesn't have default imports

2018-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24454: Assignee: Apache Spark > ml.image doesn't have default imports >

[jira] [Commented] (SPARK-24454) ml.image doesn't have default imports

2018-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498855#comment-16498855 ] Apache Spark commented on SPARK-24454: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-24454) ml.image doesn't have default imports

2018-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24454: Assignee: (was: Apache Spark) > ml.image doesn't have default imports >

[jira] [Commented] (SPARK-24454) ml.image doesn't have default imports

2018-06-01 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498852#comment-16498852 ] Hyukjin Kwon commented on SPARK-24454: -- Missing \_\_all\_\_ is orthogonal though since you are

[jira] [Commented] (SPARK-24359) SPIP: ML Pipelines in R

2018-06-01 Thread Hossein Falaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498842#comment-16498842 ] Hossein Falaki commented on SPARK-24359: Yes. My bad, I meant releasing an update to CRAN for

[jira] [Commented] (SPARK-24374) SPIP: Support Barrier Scheduling in Apache Spark

2018-06-01 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498797#comment-16498797 ] Wangda Tan commented on SPARK-24374: Thanks [~mengxr] for filing the JIRA and ping from [~ywskycn].

[jira] [Commented] (SPARK-24374) SPIP: Support Barrier Scheduling in Apache Spark

2018-06-01 Thread Jose Torres (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498772#comment-16498772 ] Jose Torres commented on SPARK-24374: - Yeah, continuous processing (SPARK-20928) is another good use

[jira] [Updated] (SPARK-24454) ml.image doesn't have default imports

2018-06-01 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-24454: -- Description: {code:java} from pyspark import ml ml.image{code} The ml.image line will fail

[jira] [Created] (SPARK-24454) ml.image doesn't have default imports

2018-06-01 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-24454: - Summary: ml.image doesn't have default imports Key: SPARK-24454 URL: https://issues.apache.org/jira/browse/SPARK-24454 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-8614) Row order preservation for operations on MLlib IndexedRowMatrix

2018-06-01 Thread Mark Tygert (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498686#comment-16498686 ] Mark Tygert commented on SPARK-8614: [~sneha29shukla], [https://github.com/hl475/svd] fixes all those

[jira] [Created] (SPARK-24453) Fix error recovering from the failure in a no-data batch

2018-06-01 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-24453: - Summary: Fix error recovering from the failure in a no-data batch Key: SPARK-24453 URL: https://issues.apache.org/jira/browse/SPARK-24453 Project: Spark

[jira] [Updated] (SPARK-24369) A bug when having multiple distinct aggregations

2018-06-01 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-24369: Fix Version/s: (was: 2.4.0) > A bug when having multiple distinct aggregations >

[jira] [Assigned] (SPARK-24393) SQL builtin: isinf

2018-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24393: Assignee: Apache Spark > SQL builtin: isinf > -- > >

[jira] [Commented] (SPARK-24393) SQL builtin: isinf

2018-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498599#comment-16498599 ] Apache Spark commented on SPARK-24393: -- User 'NihalHarish' has created a pull request for this

[jira] [Assigned] (SPARK-24393) SQL builtin: isinf

2018-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24393: Assignee: (was: Apache Spark) > SQL builtin: isinf > -- > >

[jira] [Assigned] (SPARK-24369) A bug when having multiple distinct aggregations

2018-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24369: Assignee: Takeshi Yamamuro (was: Apache Spark) > A bug when having multiple distinct

[jira] [Assigned] (SPARK-24369) A bug when having multiple distinct aggregations

2018-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24369: Assignee: Apache Spark (was: Takeshi Yamamuro) > A bug when having multiple distinct

[jira] [Reopened] (SPARK-24369) A bug when having multiple distinct aggregations

2018-06-01 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro reopened SPARK-24369: -- > A bug when having multiple distinct aggregations >

[jira] [Assigned] (SPARK-24452) long = int*int or long = int+int may cause overflow.

2018-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24452: Assignee: (was: Apache Spark) > long = int*int or long = int+int may cause overflow.

[jira] [Commented] (SPARK-24452) long = int*int or long = int+int may cause overflow.

2018-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498531#comment-16498531 ] Apache Spark commented on SPARK-24452: -- User 'kiszk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-24452) long = int*int or long = int+int may cause overflow.

2018-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24452: Assignee: Apache Spark > long = int*int or long = int+int may cause overflow. >

[jira] [Updated] (SPARK-24369) A bug when having multiple distinct aggregations

2018-06-01 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-24369: --- Fix Version/s: (was: 2.3.1) > A bug when having multiple distinct aggregations >

[jira] [Comment Edited] (SPARK-24374) SPIP: Support Barrier Scheduling in Apache Spark

2018-06-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498493#comment-16498493 ] Reynold Xin edited comment on SPARK-24374 at 6/1/18 8:05 PM: - Just thought

[jira] [Reopened] (SPARK-24451) Spark-Streaming-Kafka-1.6.3- KafkaUtils.createStream function uses the old Logging class

2018-06-01 Thread Ankit Prakash Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankit Prakash Gupta reopened SPARK-24451: - There are no examples available. Kindly help me with the references how to connect

[jira] [Commented] (SPARK-24374) SPIP: Support Barrier Scheduling in Apache Spark

2018-06-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498493#comment-16498493 ] Reynold Xin commented on SPARK-24374: - Just thought of this — Continuous Processing really requires

[jira] [Comment Edited] (SPARK-24374) SPIP: Support Barrier Scheduling in Apache Spark

2018-06-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498493#comment-16498493 ] Reynold Xin edited comment on SPARK-24374 at 6/1/18 8:02 PM: - Just thought

[jira] [Comment Edited] (SPARK-24374) SPIP: Support Barrier Scheduling in Apache Spark

2018-06-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498488#comment-16498488 ] Reynold Xin edited comment on SPARK-24374 at 6/1/18 7:58 PM: - That breaks

[jira] [Comment Edited] (SPARK-24374) SPIP: Support Barrier Scheduling in Apache Spark

2018-06-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498488#comment-16498488 ] Reynold Xin edited comment on SPARK-24374 at 6/1/18 7:57 PM: - That breaks

[jira] [Comment Edited] (SPARK-24374) SPIP: Support Barrier Scheduling in Apache Spark

2018-06-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498488#comment-16498488 ] Reynold Xin edited comment on SPARK-24374 at 6/1/18 7:57 PM: - That breaks

[jira] [Commented] (SPARK-24374) SPIP: Support Barrier Scheduling in Apache Spark

2018-06-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498488#comment-16498488 ] Reynold Xin commented on SPARK-24374: - That breaks end to end FT right?   > SPIP: Support Barrier

[jira] [Created] (SPARK-24452) long = int*int or long = int+int may cause overflow.

2018-06-01 Thread Kazuaki Ishizaki (JIRA)
Kazuaki Ishizaki created SPARK-24452: Summary: long = int*int or long = int+int may cause overflow. Key: SPARK-24452 URL: https://issues.apache.org/jira/browse/SPARK-24452 Project: Spark

[jira] [Commented] (SPARK-24374) SPIP: Support Barrier Scheduling in Apache Spark

2018-06-01 Thread Henry Robinson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498465#comment-16498465 ] Henry Robinson commented on SPARK-24374: The use case in the SPIP isn't 100% convincing. I'm

[jira] [Commented] (SPARK-24442) Add configuration parameter to adjust the numbers of records and the charters per row before truncation when a user runs.show()

2018-06-01 Thread Andrew K Long (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498434#comment-16498434 ] Andrew K Long commented on SPARK-24442: --- "I'd name it `spark.sql.show.defaultNumRows` though."  

[jira] [Commented] (SPARK-24451) Spark-Streaming-Kafka-1.6.3- KafkaUtils.createStream function uses the old Logging class

2018-06-01 Thread Ankit Prakash Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498403#comment-16498403 ] Ankit Prakash Gupta commented on SPARK-24451: - Hi Marcelo  Thanks for your quick reply.

[jira] [Resolved] (SPARK-24451) Spark-Streaming-Kafka-1.6.3- KafkaUtils.createStream function uses the old Logging class

2018-06-01 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-24451. Resolution: Invalid You're trying to use a library built for Spark 1.6.3 on top of Spark

[jira] [Updated] (SPARK-24451) Spark-Streaming-Kafka-1.6.3- KafkaUtils.createStream function uses the old Logging class

2018-06-01 Thread Ankit Prakash Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankit Prakash Gupta updated SPARK-24451: Attachment: Screenshot from 2018-06-01 23-58-48.png >

[jira] [Created] (SPARK-24451) Spark-Streaming-Kafka-1.6.3- KafkaUtils.createStream function uses the old Logging class

2018-06-01 Thread Ankit Prakash Gupta (JIRA)
Ankit Prakash Gupta created SPARK-24451: --- Summary: Spark-Streaming-Kafka-1.6.3- KafkaUtils.createStream function uses the old Logging class Key: SPARK-24451 URL:

[jira] [Commented] (SPARK-23668) Support for imagePullSecrets k8s option

2018-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498348#comment-16498348 ] Apache Spark commented on SPARK-23668: -- User 'liyinan926' has created a pull request for this

[jira] [Resolved] (SPARK-24444) Improve pandas_udf GROUPED_MAP docs to explain column assignment

2018-06-01 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-2. Resolution: Fixed I'm resolving this since the change is there, and as far as I can see

[jira] [Comment Edited] (SPARK-24434) Support user-specified driver and executor pod templates

2018-06-01 Thread Erik Erlandson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498337#comment-16498337 ] Erik Erlandson edited comment on SPARK-24434 at 6/1/18 5:53 PM: My

[jira] [Commented] (SPARK-24434) Support user-specified driver and executor pod templates

2018-06-01 Thread Erik Erlandson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498337#comment-16498337 ] Erik Erlandson commented on SPARK-24434: My current take on UX around this feature is that

[jira] [Assigned] (SPARK-24351) offsetLog/commitLog purge thresholdBatchId should be computed with current committed epoch but not currentBatchId in CP mode

2018-06-01 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu reassigned SPARK-24351: Assignee: huangtengfei > offsetLog/commitLog purge thresholdBatchId should be computed

[jira] [Resolved] (SPARK-24351) offsetLog/commitLog purge thresholdBatchId should be computed with current committed epoch but not currentBatchId in CP mode

2018-06-01 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-24351. -- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21400

[jira] [Comment Edited] (SPARK-24434) Support user-specified driver and executor pod templates

2018-06-01 Thread Yinan Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498307#comment-16498307 ] Yinan Li edited comment on SPARK-24434 at 6/1/18 5:39 PM: -- The pod template is

[jira] [Updated] (SPARK-24450) Error: Exception in thread "main" java.lang.NoSuchMethodError: org.apache.curator.utils.PathUtils.validatePath(Ljava/lang/String;)Ljava/lang/String;

2018-06-01 Thread Maxim Dahenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Dahenko updated SPARK-24450: -- Description: Hello, artifact org.apache.curator, version 2.7.1 and higher doesn't work in a

[jira] [Created] (SPARK-24450) Error: Exception in thread "main" java.lang.NoSuchMethodError: org.apache.curator.utils.PathUtils.validatePath(Ljava/lang/String;)Ljava/lang/String;

2018-06-01 Thread Maxim Dahenko (JIRA)
Maxim Dahenko created SPARK-24450: - Summary: Error: Exception in thread "main" java.lang.NoSuchMethodError: org.apache.curator.utils.PathUtils.validatePath(Ljava/lang/String;)Ljava/lang/String; Key: SPARK-24450

[jira] [Comment Edited] (SPARK-24434) Support user-specified driver and executor pod templates

2018-06-01 Thread Yinan Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498307#comment-16498307 ] Yinan Li edited comment on SPARK-24434 at 6/1/18 5:38 PM: -- The pod template is

[jira] [Commented] (SPARK-24434) Support user-specified driver and executor pod templates

2018-06-01 Thread Yinan Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498307#comment-16498307 ] Yinan Li commented on SPARK-24434: -- The pod template is basically a pod specification and can contain

[jira] [Commented] (SPARK-24355) Improve Spark shuffle server responsiveness to non-ChunkFetch requests

2018-06-01 Thread Min Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498228#comment-16498228 ] Min Shen commented on SPARK-24355: -- [~jerryshao], We built a stress testing tool for Spark shuffle

[jira] [Commented] (SPARK-24434) Support user-specified driver and executor pod templates

2018-06-01 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498225#comment-16498225 ] Felix Cheung commented on SPARK-24434: -- java properties is basically the "standard" in spark, I'm

[jira] [Updated] (SPARK-24211) Flaky test: StreamingOuterJoinSuite

2018-06-01 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-24211: -- Description: *windowed left outer join* -

[jira] [Commented] (SPARK-24444) Improve pandas_udf GROUPED_MAP docs to explain column assignment

2018-06-01 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498216#comment-16498216 ] Hyukjin Kwon commented on SPARK-2: -- rc2 is failed and rc3 is not tagged yet. Shall we leave

[jira] [Commented] (SPARK-20202) Remove references to org.spark-project.hive

2018-06-01 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498213#comment-16498213 ] Felix Cheung commented on SPARK-20202: -- Prefer newer Hive also > Remove references to

[jira] [Assigned] (SPARK-24444) Improve pandas_udf GROUPED_MAP docs to explain column assignment

2018-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-2: Assignee: Apache Spark (was: Bryan Cutler) > Improve pandas_udf GROUPED_MAP docs to

[jira] [Assigned] (SPARK-24444) Improve pandas_udf GROUPED_MAP docs to explain column assignment

2018-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-2: Assignee: Bryan Cutler (was: Apache Spark) > Improve pandas_udf GROUPED_MAP docs to

[jira] [Commented] (SPARK-24444) Improve pandas_udf GROUPED_MAP docs to explain column assignment

2018-06-01 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498211#comment-16498211 ] Hyukjin Kwon commented on SPARK-2: -- It's merged

[jira] [Reopened] (SPARK-24444) Improve pandas_udf GROUPED_MAP docs to explain column assignment

2018-06-01 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk reopened SPARK-2: - Code for 2.3.1 isn't merged, re-opening. > Improve pandas_udf GROUPED_MAP docs to explain column

[jira] [Commented] (SPARK-24437) Memory leak in UnsafeHashedRelation

2018-06-01 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498201#comment-16498201 ] Marco Gaido commented on SPARK-24437: - I checked and it seems that the leakage you are reporting

[jira] [Commented] (SPARK-23903) Add support for date extract

2018-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498180#comment-16498180 ] Apache Spark commented on SPARK-23903: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23903) Add support for date extract

2018-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23903: Assignee: (was: Apache Spark) > Add support for date extract >

[jira] [Assigned] (SPARK-23903) Add support for date extract

2018-06-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23903: Assignee: Apache Spark > Add support for date extract > > >

[jira] [Updated] (SPARK-24412) Adding docs about automagical type casting in `isin` and `isInCollection` APIs

2018-06-01 Thread Holden Karau (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-24412: - Labels: starter (was: ) > Adding docs about automagical type casting in `isin` and

[jira] [Updated] (SPARK-24411) Adding native Java tests for `isInCollection`

2018-06-01 Thread Holden Karau (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-24411: - Labels: starter (was: ) > Adding native Java tests for `isInCollection` >

[jira] [Commented] (SPARK-24437) Memory leak in UnsafeHashedRelation

2018-06-01 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498072#comment-16498072 ] Marco Gaido commented on SPARK-24437: - [~tanejagagan] the map you are referring seems to be the

[jira] [Commented] (SPARK-18673) Dataframes doesn't work on Hadoop 3.x; Hive rejects Hadoop version

2018-06-01 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16497931#comment-16497931 ] Saisai Shao commented on SPARK-18673: - Thanks Steve, looking forward to your inputs. > Dataframes

[jira] [Commented] (SPARK-18673) Dataframes doesn't work on Hadoop 3.x; Hive rejects Hadoop version

2018-06-01 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16497928#comment-16497928 ] Steve Loughran commented on SPARK-18673: Jerry, I list up the other commits I'd like to put in;

[jira] [Commented] (SPARK-8614) Row order preservation for operations on MLlib IndexedRowMatrix

2018-06-01 Thread Sneha Shukla (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16497869#comment-16497869 ] Sneha Shukla commented on SPARK-8614: - Is this resolved in the any of the later versions of Spark? We

[jira] [Created] (SPARK-24449) ApplicationMaster reporter thread failure counter is not effective

2018-06-01 Thread Miklos Szurap (JIRA)
Miklos Szurap created SPARK-24449: - Summary: ApplicationMaster reporter thread failure counter is not effective Key: SPARK-24449 URL: https://issues.apache.org/jira/browse/SPARK-24449 Project: Spark

[jira] [Updated] (SPARK-24444) Improve pandas_udf GROUPED_MAP docs to explain column assignment

2018-06-01 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-2: - Fix Version/s: 2.3.1 > Improve pandas_udf GROUPED_MAP docs to explain column assignment >

[jira] [Commented] (SPARK-24355) Improve Spark shuffle server responsiveness to non-ChunkFetch requests

2018-06-01 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16497626#comment-16497626 ] Saisai Shao commented on SPARK-24355: - Do we have a test result before and after? > Improve Spark