[jira] [Commented] (SPARK-9340) ParquetTypeConverter incorrectly handling of repeated types results in schema mismatch

[ https://issues.apache.org/jira/browse/SPARK-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14679684#comment-14679684 ] Cheng Lian commented on SPARK-9340: --- [~damianguy] This is actually a Parquet complex typ

[jira] [Commented] (SPARK-9396) Spark yarn allocator does not call "removeContainerRequest" for allocated Container requests, resulting in bloated ask[] toYarn RM.

[ https://issues.apache.org/jira/browse/SPARK-9396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14679715#comment-14679715 ] Apache Spark commented on SPARK-9396: - User 'prakhar-jauhari' has created a pull reque

[jira] [Resolved] (SPARK-9742) NullPointerException when using --packages

[ https://issues.apache.org/jira/browse/SPARK-9742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9742. -- Resolution: Duplicate Assignee: (was: Burak Yavuz) Target Version/s: (was: 1.

[jira] [Assigned] (SPARK-9396) Spark yarn allocator does not call "removeContainerRequest" for allocated Container requests, resulting in bloated ask[] toYarn RM.

[ https://issues.apache.org/jira/browse/SPARK-9396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9396: --- Assignee: Apache Spark > Spark yarn allocator does not call "removeContainerRequest" for allo

[jira] [Assigned] (SPARK-9396) Spark yarn allocator does not call "removeContainerRequest" for allocated Container requests, resulting in bloated ask[] toYarn RM.

[ https://issues.apache.org/jira/browse/SPARK-9396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9396: --- Assignee: (was: Apache Spark) > Spark yarn allocator does not call "removeContainerReques

[jira] [Updated] (SPARK-9396) Spark yarn allocator does not call "removeContainerRequest" for allocated Container requests, resulting in bloated ask[] toYarn RM.

[ https://issues.apache.org/jira/browse/SPARK-9396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9396: - Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) > Spark yarn allocator does not ca

[jira] [Commented] (SPARK-9340) ParquetTypeConverter incorrectly handling of repeated types results in schema mismatch

[ https://issues.apache.org/jira/browse/SPARK-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14679719#comment-14679719 ] Cheng Lian commented on SPARK-9340: --- Would like to add that, parquet-avro can be from t

[jira] [Resolved] (SPARK-9476) Kafka stream loses leader after 2h of operation

[ https://issues.apache.org/jira/browse/SPARK-9476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9476. -- Resolution: Not A Problem > Kafka stream loses leader after 2h of operation > -

[jira] [Comment Edited] (SPARK-9340) ParquetTypeConverter incorrectly handling of repeated types results in schema mismatch

[ https://issues.apache.org/jira/browse/SPARK-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14679719#comment-14679719 ] Cheng Lian edited comment on SPARK-9340 at 8/10/15 7:40 AM: Wo

[jira] [Commented] (SPARK-9396) Spark yarn allocator does not call "removeContainerRequest" for allocated Container requests, resulting in bloated ask[] toYarn RM.

[ https://issues.apache.org/jira/browse/SPARK-9396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14679725#comment-14679725 ] prakhar jauhari commented on SPARK-9396: Hey, Can some one please review the PR.

[jira] [Comment Edited] (SPARK-9340) ParquetTypeConverter incorrectly handling of repeated types results in schema mismatch

[ https://issues.apache.org/jira/browse/SPARK-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14679719#comment-14679719 ] Cheng Lian edited comment on SPARK-9340 at 8/10/15 7:43 AM: Wo

[jira] [Comment Edited] (SPARK-9340) ParquetTypeConverter incorrectly handling of repeated types results in schema mismatch

[ https://issues.apache.org/jira/browse/SPARK-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14679719#comment-14679719 ] Cheng Lian edited comment on SPARK-9340 at 8/10/15 7:45 AM: Wo

[jira] [Commented] (SPARK-5837) HTTP 500 if try to access Spark UI in yarn-cluster or yarn-client mode

[ https://issues.apache.org/jira/browse/SPARK-5837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14679730#comment-14679730 ] hujiayin commented on SPARK-5837: - Hi Sean, I meet this problem on spark 1.2 1.2.1 1.2.2

[jira] [Commented] (SPARK-9636) Treat $SPARK_HOME as write-only

[ https://issues.apache.org/jira/browse/SPARK-9636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14679733#comment-14679733 ] Sean Owen commented on SPARK-9636: -- I think writing to the local directory is the least s

[jira] [Resolved] (SPARK-9638) .save() Procedure fails

[ https://issues.apache.org/jira/browse/SPARK-9638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9638. -- Resolution: Duplicate > .save() Procedure fails > --- > > Key: SPARK

[jira] [Updated] (SPARK-9396) Spark yarn allocator does not call "removeContainerRequest" for allocated Container requests, resulting in bloated ask[] toYarn RM.

[ https://issues.apache.org/jira/browse/SPARK-9396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] prakhar jauhari updated SPARK-9396: --- Affects Version/s: 1.2.2 > Spark yarn allocator does not call "removeContainerRequest" for all

[jira] [Commented] (SPARK-9776) Another instance of Derby may have already booted the database

[ https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14679745#comment-14679745 ] Sean Owen commented on SPARK-9776: -- I can't reproduce this. Creating a new HiveContext st

[jira] [Created] (SPARK-9778) remove unnecessary evaluation from SortOrder

Wenchen Fan created SPARK-9778: -- Summary: remove unnecessary evaluation from SortOrder Key: SPARK-9778 URL: https://issues.apache.org/jira/browse/SPARK-9778 Project: Spark Issue Type: Improvemen

[jira] [Assigned] (SPARK-9778) remove unnecessary evaluation from SortOrder

[ https://issues.apache.org/jira/browse/SPARK-9778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9778: --- Assignee: (was: Apache Spark) > remove unnecessary evaluation from SortOrder > --

[jira] [Assigned] (SPARK-9778) remove unnecessary evaluation from SortOrder

[ https://issues.apache.org/jira/browse/SPARK-9778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9778: --- Assignee: Apache Spark > remove unnecessary evaluation from SortOrder > -

[jira] [Commented] (SPARK-9778) remove unnecessary evaluation from SortOrder

[ https://issues.apache.org/jira/browse/SPARK-9778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14679750#comment-14679750 ] Apache Spark commented on SPARK-9778: - User 'cloud-fan' has created a pull request for

[jira] [Created] (SPARK-9779) HTTP500 revisit when open web-UI in yarn-cluster yarn-client mode (1.2-1.3)

hujiayin created SPARK-9779: --- Summary: HTTP500 revisit when open web-UI in yarn-cluster yarn-client mode (1.2-1.3) Key: SPARK-9779 URL: https://issues.apache.org/jira/browse/SPARK-9779 Project: Spark

[jira] [Updated] (SPARK-9779) HTTP500 revisit when open web-UI in yarn-cluster yarn-client mode (1.2-1.3)

[ https://issues.apache.org/jira/browse/SPARK-9779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hujiayin updated SPARK-9779: Description: When I try to open the web-UI from AM in yarn-cluster mode, I meet the HTTP500 error as descri

[jira] [Updated] (SPARK-9779) HTTP500 revisit when open web-UI in yarn-cluster yarn-client mode (1.2-1.3)

[ https://issues.apache.org/jira/browse/SPARK-9779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hujiayin updated SPARK-9779: Description: When I try to open the web-UI from AM in yarn-cluster mode, I meet the HTTP500 error as descri

[jira] [Resolved] (SPARK-9779) HTTP500 revisit when open web-UI in yarn-cluster yarn-client mode (1.2-1.3)

[ https://issues.apache.org/jira/browse/SPARK-9779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9779. -- Resolution: Duplicate Fix Version/s: (was: 1.4.2) [~hujiayin] Don't open duplicate issues. Yo

[jira] [Commented] (SPARK-5837) HTTP 500 if try to access Spark UI in yarn-cluster or yarn-client mode

[ https://issues.apache.org/jira/browse/SPARK-5837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14679772#comment-14679772 ] Sean Owen commented on SPARK-5837: -- [~hujiayin] this isn't enough information to advance

[jira] [Commented] (SPARK-5837) HTTP 500 if try to access Spark UI in yarn-cluster or yarn-client mode

[ https://issues.apache.org/jira/browse/SPARK-5837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14679782#comment-14679782 ] hujiayin commented on SPARK-5837: - yes, I've tried all the setting above. The issue just h

[jira] [Commented] (SPARK-9340) ParquetTypeConverter incorrectly handling of repeated types results in schema mismatch

[ https://issues.apache.org/jira/browse/SPARK-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14679792#comment-14679792 ] Damian Guy commented on SPARK-9340: --- Hi, I did try it against the 1.5 and the problem st

[jira] [Updated] (SPARK-9744) Add RDD method to map with lag and lead

[ https://issues.apache.org/jira/browse/SPARK-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9744: - Component/s: Spark Core > Add RDD method to map with lag and lead > --

[jira] [Commented] (SPARK-5837) HTTP 500 if try to access Spark UI in yarn-cluster or yarn-client mode

[ https://issues.apache.org/jira/browse/SPARK-5837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14679798#comment-14679798 ] Sean Owen commented on SPARK-5837: -- What about master? it sounds like you're suggesting i

[jira] [Commented] (SPARK-9590) support metaq to streaming

[ https://issues.apache.org/jira/browse/SPARK-9590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14679814#comment-14679814 ] zhouxiaoke commented on SPARK-9590: --- This function is needed? > support metaq to stream

[jira] [Resolved] (SPARK-9590) support metaq to streaming

[ https://issues.apache.org/jira/browse/SPARK-9590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9590. -- Resolution: Invalid Fix Version/s: (was: 1.4.2) Target Version/s: (was: 1.4.1) It

[jira] [Commented] (SPARK-5837) HTTP 500 if try to access Spark UI in yarn-cluster or yarn-client mode

[ https://issues.apache.org/jira/browse/SPARK-5837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14679817#comment-14679817 ] hujiayin commented on SPARK-5837: - The master doesn't have this problem. The other parts w

[jira] [Issue Comment Deleted] (SPARK-5837) HTTP 500 if try to access Spark UI in yarn-cluster or yarn-client mode

[ https://issues.apache.org/jira/browse/SPARK-5837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hujiayin updated SPARK-5837: Comment: was deleted (was: The master doesn't have this problem. The other parts works well except the webU

[jira] [Commented] (SPARK-5837) HTTP 500 if try to access Spark UI in yarn-cluster or yarn-client mode

[ https://issues.apache.org/jira/browse/SPARK-5837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14679818#comment-14679818 ] hujiayin commented on SPARK-5837: - The master doesn't have this problem. The other parts w

[jira] [Commented] (SPARK-9590) support metaq to streaming

[ https://issues.apache.org/jira/browse/SPARK-9590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14679844#comment-14679844 ] zhouxiaoke commented on SPARK-9590: --- metaq like kafka is a message queue . We are using

[jira] [Commented] (SPARK-9590) support metaq to streaming

[ https://issues.apache.org/jira/browse/SPARK-9590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14679847#comment-14679847 ] zhouxiaoke commented on SPARK-9590: --- metaq like kafka is a message queue . We are using

[jira] [Commented] (SPARK-9590) support metaq to streaming

[ https://issues.apache.org/jira/browse/SPARK-9590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14679846#comment-14679846 ] zhouxiaoke commented on SPARK-9590: --- metaq like kafka is a message queue . We are using

[jira] [Commented] (SPARK-9744) Add RDD method to map with lag and lead

[ https://issues.apache.org/jira/browse/SPARK-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14679849#comment-14679849 ] Jerry Z commented on SPARK-9744: With regards to cogroup, I phrased that badly, but meant

[jira] [Comment Edited] (SPARK-9744) Add RDD method to map with lag and lead

[ https://issues.apache.org/jira/browse/SPARK-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14679849#comment-14679849 ] Jerry Z edited comment on SPARK-9744 at 8/10/15 9:34 AM: - With reg

[jira] [Commented] (SPARK-9744) Add RDD method to map with lag and lead

[ https://issues.apache.org/jira/browse/SPARK-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14679857#comment-14679857 ] Sean Owen commented on SPARK-9744: -- join returns something different than cogroup. It ret

[jira] [Commented] (SPARK-9744) Add RDD method to map with lag and lead

[ https://issues.apache.org/jira/browse/SPARK-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14679879#comment-14679879 ] Jerry Z commented on SPARK-9744: What's PR short for??? I may have misunderstood things. A

[jira] [Commented] (SPARK-9744) Add RDD method to map with lag and lead

[ https://issues.apache.org/jira/browse/SPARK-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14679904#comment-14679904 ] Sean Owen commented on SPARK-9744: -- Github Pull Request. I think it's easiest if you chec

[jira] [Commented] (SPARK-8518) Log-linear models for survival analysis

[ https://issues.apache.org/jira/browse/SPARK-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14679918#comment-14679918 ] Yanbo Liang commented on SPARK-8518: [~mengxr] [~meihuawu] I have update the design do

[jira] [Commented] (SPARK-9746) PairRDDFunctions.countByKey: values/counts always 1

[ https://issues.apache.org/jira/browse/SPARK-9746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14679943#comment-14679943 ] Andreas commented on SPARK-9746: Now I see my mistake: I did "RDD[T].groupBy(some:K).coun

[jira] [Commented] (SPARK-9773) Add Python API for MultilayerPerceptronClassifier

[ https://issues.apache.org/jira/browse/SPARK-9773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14679964#comment-14679964 ] Apache Spark commented on SPARK-9773: - User 'yanboliang' has created a pull request fo

[jira] [Assigned] (SPARK-9773) Add Python API for MultilayerPerceptronClassifier

[ https://issues.apache.org/jira/browse/SPARK-9773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9773: --- Assignee: Apache Spark > Add Python API for MultilayerPerceptronClassifier >

[jira] [Assigned] (SPARK-9773) Add Python API for MultilayerPerceptronClassifier

[ https://issues.apache.org/jira/browse/SPARK-9773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9773: --- Assignee: (was: Apache Spark) > Add Python API for MultilayerPerceptronClassifier > -

[jira] [Commented] (SPARK-9636) Treat $SPARK_HOME as write-only

[ https://issues.apache.org/jira/browse/SPARK-9636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680002#comment-14680002 ] Philipp Angerer commented on SPARK-9636: > quietly Huh? Again: The script *does*

[jira] [Commented] (SPARK-9590) support metaq to streaming

[ https://issues.apache.org/jira/browse/SPARK-9590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680017#comment-14680017 ] zhouxiaoke commented on SPARK-9590: --- can i put it contribute out of it? > support metaq

[jira] [Commented] (SPARK-9636) Treat $SPARK_HOME as write-only

[ https://issues.apache.org/jira/browse/SPARK-9636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680038#comment-14680038 ] Sean Owen commented on SPARK-9636: -- Easy there, I just meant "without failing". Your sugg

[jira] [Commented] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

[ https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680109#comment-14680109 ] Thomas Graves commented on SPARK-9019: -- We forgot to close out the jira. This was fix

[jira] [Closed] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

[ https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves closed SPARK-9019. Resolution: Won't Fix > spark-submit fails on yarn with kerberos enabled > -

[jira] [Created] (SPARK-9780) In case of invalid initialization of KafkaDirectStream, NPE is thrown

Grigory Turunov created SPARK-9780: -- Summary: In case of invalid initialization of KafkaDirectStream, NPE is thrown Key: SPARK-9780 URL: https://issues.apache.org/jira/browse/SPARK-9780 Project: Spar

[jira] [Assigned] (SPARK-7542) Support off-heap sort buffer in UnsafeExternalSorter

[ https://issues.apache.org/jira/browse/SPARK-7542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7542: --- Assignee: Apache Spark > Support off-heap sort buffer in UnsafeExternalSorter > -

[jira] [Commented] (SPARK-7542) Support off-heap sort buffer in UnsafeExternalSorter

[ https://issues.apache.org/jira/browse/SPARK-7542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680140#comment-14680140 ] Apache Spark commented on SPARK-7542: - User 'viirya' has created a pull request for th

[jira] [Assigned] (SPARK-7542) Support off-heap sort buffer in UnsafeExternalSorter

[ https://issues.apache.org/jira/browse/SPARK-7542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7542: --- Assignee: (was: Apache Spark) > Support off-heap sort buffer in UnsafeExternalSorter > --

[jira] [Commented] (SPARK-4300) Race condition during SparkWorker shutdown

[ https://issues.apache.org/jira/browse/SPARK-4300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680154#comment-14680154 ] Lior Chaga commented on SPARK-4300: --- Also exists in spark 1.4: {panel} 12:31:10.821 [Fi

[jira] [Created] (SPARK-9781) KCL Workers should be configurable from Spark configuration

Anton Nekhaev created SPARK-9781: Summary: KCL Workers should be configurable from Spark configuration Key: SPARK-9781 URL: https://issues.apache.org/jira/browse/SPARK-9781 Project: Spark Is

[jira] [Commented] (SPARK-9340) ParquetTypeConverter incorrectly handling of repeated types results in schema mismatch

[ https://issues.apache.org/jira/browse/SPARK-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680277#comment-14680277 ] Cheng Lian commented on SPARK-9340: --- Ah, thanks a lot! I see the problem now. {{parque

[jira] [Updated] (SPARK-9781) KCL Workers should be configurable from Spark configuration

[ https://issues.apache.org/jira/browse/SPARK-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Nekhaev updated SPARK-9781: - Description: Currently the KinesisClientLibConfiguration for KCL Workers is created within the Ki

[jira] [Commented] (SPARK-9340) ParquetTypeConverter incorrectly handling of repeated types results in schema mismatch

[ https://issues.apache.org/jira/browse/SPARK-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680281#comment-14680281 ] Damian Guy commented on SPARK-9340: --- Thanks. I'm sure there is a simpler solution to som

[jira] [Resolved] (SPARK-9743) Scanning a HadoopFsRelation shouldn't requrire refreshing

[ https://issues.apache.org/jira/browse/SPARK-9743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-9743. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8035 [https://github.com/apac

[jira] [Updated] (SPARK-9600) DataFrameWriter.saveAsTable always writes data to "/user/hive/warehouse"

[ https://issues.apache.org/jira/browse/SPARK-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-9600: Priority: Blocker (was: Critical) > DataFrameWriter.saveAsTable always writes data to "/user/hive/warehouse

[jira] [Updated] (SPARK-9714) Cannot insert into a table using pySpark

[ https://issues.apache.org/jira/browse/SPARK-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-9714: Sprint: Spark 1.5 doc/QA sprint > Cannot insert into a table using pySpark > ---

[jira] [Commented] (SPARK-9340) ParquetTypeConverter incorrectly handling of repeated types results in schema mismatch

[ https://issues.apache.org/jira/browse/SPARK-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680355#comment-14680355 ] Ryan Blue commented on SPARK-9340: -- Sorry to jump in late on this issue... I think you're

[jira] [Assigned] (SPARK-9574) Review the contents of uber JARs spark-streaming-XXX-assembly

[ https://issues.apache.org/jira/browse/SPARK-9574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9574: --- Assignee: Apache Spark (was: Shixiong Zhu) > Review the contents of uber JARs spark-streamin

[jira] [Commented] (SPARK-9574) Review the contents of uber JARs spark-streaming-XXX-assembly

[ https://issues.apache.org/jira/browse/SPARK-9574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680362#comment-14680362 ] Apache Spark commented on SPARK-9574: - User 'zsxwing' has created a pull request for t

[jira] [Assigned] (SPARK-9574) Review the contents of uber JARs spark-streaming-XXX-assembly

[ https://issues.apache.org/jira/browse/SPARK-9574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9574: --- Assignee: Shixiong Zhu (was: Apache Spark) > Review the contents of uber JARs spark-streamin

[jira] [Updated] (SPARK-9710) RPackageUtilsSuite fails if R is not installed

[ https://issues.apache.org/jira/browse/SPARK-9710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9710: - Assignee: Marcelo Vanzin > RPackageUtilsSuite fails if R is not installed > --

[jira] [Resolved] (SPARK-9710) RPackageUtilsSuite fails if R is not installed

[ https://issues.apache.org/jira/browse/SPARK-9710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9710. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 800

[jira] [Commented] (SPARK-9570) Consistent recommendation for submitting spark apps to YARN, -master yarn --deploy-mode x vs -master yarn-x'.

[ https://issues.apache.org/jira/browse/SPARK-9570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680379#comment-14680379 ] Guru Medasani commented on SPARK-9570: -- I won't have time to look at this. Neelesh ca

[jira] [Commented] (SPARK-9340) ParquetTypeConverter incorrectly handling of repeated types results in schema mismatch

[ https://issues.apache.org/jira/browse/SPARK-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680385#comment-14680385 ] Apache Spark commented on SPARK-9340: - User 'liancheng' has created a pull request for

[jira] [Commented] (SPARK-9340) ParquetTypeConverter incorrectly handling of repeated types results in schema mismatch

[ https://issues.apache.org/jira/browse/SPARK-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680389#comment-14680389 ] Cheng Lian commented on SPARK-9340: --- [~damianguy] Would you mind to help reviewing [PR

[jira] [Assigned] (SPARK-9570) Consistent recommendation for submitting spark apps to YARN, -master yarn --deploy-mode x vs -master yarn-x'.

[ https://issues.apache.org/jira/browse/SPARK-9570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9570: --- Assignee: (was: Apache Spark) > Consistent recommendation for submitting spark apps to YA

[jira] [Commented] (SPARK-9570) Consistent recommendation for submitting spark apps to YARN, -master yarn --deploy-mode x vs -master yarn-x'.

[ https://issues.apache.org/jira/browse/SPARK-9570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680392#comment-14680392 ] Apache Spark commented on SPARK-9570: - User 'nssalian' has created a pull request for

[jira] [Assigned] (SPARK-9570) Consistent recommendation for submitting spark apps to YARN, -master yarn --deploy-mode x vs -master yarn-x'.

[ https://issues.apache.org/jira/browse/SPARK-9570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9570: --- Assignee: Apache Spark > Consistent recommendation for submitting spark apps to YARN, -master

[jira] [Created] (SPARK-9782) Add support for YARN application tags running Spark on YARN

Dennis Huo created SPARK-9782: - Summary: Add support for YARN application tags running Spark on YARN Key: SPARK-9782 URL: https://issues.apache.org/jira/browse/SPARK-9782 Project: Spark Issue Ty

[jira] [Assigned] (SPARK-9782) Add support for YARN application tags running Spark on YARN

[ https://issues.apache.org/jira/browse/SPARK-9782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9782: --- Assignee: (was: Apache Spark) > Add support for YARN application tags running Spark on YA

[jira] [Assigned] (SPARK-9782) Add support for YARN application tags running Spark on YARN

[ https://issues.apache.org/jira/browse/SPARK-9782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9782: --- Assignee: Apache Spark > Add support for YARN application tags running Spark on YARN > --

[jira] [Commented] (SPARK-9782) Add support for YARN application tags running Spark on YARN

[ https://issues.apache.org/jira/browse/SPARK-9782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680415#comment-14680415 ] Sean Owen commented on SPARK-9782: -- This is different from https://issues.apache.org/jira

[jira] [Commented] (SPARK-9782) Add support for YARN application tags running Spark on YARN

[ https://issues.apache.org/jira/browse/SPARK-9782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680413#comment-14680413 ] Apache Spark commented on SPARK-9782: - User 'dennishuo' has created a pull request for

[jira] [Commented] (SPARK-9340) ParquetTypeConverter incorrectly handling of repeated types results in schema mismatch

[ https://issues.apache.org/jira/browse/SPARK-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680418#comment-14680418 ] Cheng Lian commented on SPARK-9340: --- Thanks for the clarification. In [PR #8070|https:

[jira] [Updated] (SPARK-9340) CatalystSchemaConverter and CatalystRowConverter don't handle unannotated repeated fields correctly

[ https://issues.apache.org/jira/browse/SPARK-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-9340: -- Summary: CatalystSchemaConverter and CatalystRowConverter don't handle unannotated repeated fields corre

[jira] [Commented] (SPARK-7751) Add @since to stable and experimental methods in MLlib

[ https://issues.apache.org/jira/browse/SPARK-7751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680423#comment-14680423 ] Joseph K. Bradley commented on SPARK-7751: -- [~mengxr] I haven't reviewed these PR

[jira] [Assigned] (SPARK-9340) CatalystSchemaConverter and CatalystRowConverter don't handle unannotated repeated fields correctly

[ https://issues.apache.org/jira/browse/SPARK-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian reassigned SPARK-9340: - Assignee: Cheng Lian > CatalystSchemaConverter and CatalystRowConverter don't handle unannotated

[jira] [Commented] (SPARK-9782) Add support for YARN application tags running Spark on YARN

[ https://issues.apache.org/jira/browse/SPARK-9782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680431#comment-14680431 ] Dennis Huo commented on SPARK-9782: --- Correct, from what I understand, the "node labels"

[jira] [Updated] (SPARK-9340) CatalystSchemaConverter and CatalystRowConverter don't handle unannotated repeated fields correctly

[ https://issues.apache.org/jira/browse/SPARK-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-9340: -- Description: SPARK-6776 and SPARK-6777 followed {{parquet-avro}} to implement backwards-compatibility r

[jira] [Updated] (SPARK-9450) [INVALID] HashedRelation.get() could return an Iterator[Row] instead of Seq[Row]

[ https://issues.apache.org/jira/browse/SPARK-9450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-9450: -- Summary: [INVALID] HashedRelation.get() could return an Iterator[Row] instead of Seq[Row] (was: HashedR

[jira] [Resolved] (SPARK-9450) HashedRelation.get() could return an Iterator[Row] instead of Seq[Row]

[ https://issues.apache.org/jira/browse/SPARK-9450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-9450. --- Resolution: Invalid I'm going to resolve this as "Invalid", since it turns out that we need to return

[jira] [Created] (SPARK-9783) Use SqlNewHadoopRDD in JSONRelation to eliminate extra refresh() call

Cheng Lian created SPARK-9783: - Summary: Use SqlNewHadoopRDD in JSONRelation to eliminate extra refresh() call Key: SPARK-9783 URL: https://issues.apache.org/jira/browse/SPARK-9783 Project: Spark

[jira] [Updated] (SPARK-9783) Use SqlNewHadoopRDD in JSONRelation to eliminate extra refresh() call

[ https://issues.apache.org/jira/browse/SPARK-9783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-9783: -- Sprint: Spark 1.5 doc/QA sprint Environment: (was: PR #8035 made a quick fix for SPARK-9743

[jira] [Updated] (SPARK-9755) Add method documentation to MultivariateOnlineSummarizer

[ https://issues.apache.org/jira/browse/SPARK-9755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9755: - Shepherd: Joseph K. Bradley Assignee: Feynman Liang > Add method documentation to Mult

[jira] [Commented] (SPARK-9783) Use SqlNewHadoopRDD in JSONRelation to eliminate extra refresh() call

[ https://issues.apache.org/jira/browse/SPARK-9783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680457#comment-14680457 ] Cheng Lian commented on SPARK-9783: --- cc [~yhuai] > Use SqlNewHadoopRDD in JSONRelation

[jira] [Resolved] (SPARK-9755) Add method documentation to MultivariateOnlineSummarizer

[ https://issues.apache.org/jira/browse/SPARK-9755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-9755. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8045 [https

[jira] [Created] (SPARK-9784) Exchange.isUnsafe should check whether codegen and unsafe are enabled

Josh Rosen created SPARK-9784: - Summary: Exchange.isUnsafe should check whether codegen and unsafe are enabled Key: SPARK-9784 URL: https://issues.apache.org/jira/browse/SPARK-9784 Project: Spark

[jira] [Resolved] (SPARK-7536) Audit MLlib Python API for 1.4

[ https://issues.apache.org/jira/browse/SPARK-7536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-7536. -- Resolution: Done Thanks [~yanboliang] for putting this (very successful) list together a

[jira] [Assigned] (SPARK-9784) Exchange.isUnsafe should check whether codegen and unsafe are enabled

[ https://issues.apache.org/jira/browse/SPARK-9784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9784: --- Assignee: Josh Rosen (was: Apache Spark) > Exchange.isUnsafe should check whether codegen an

[jira] [Commented] (SPARK-9784) Exchange.isUnsafe should check whether codegen and unsafe are enabled

[ https://issues.apache.org/jira/browse/SPARK-9784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680482#comment-14680482 ] Apache Spark commented on SPARK-9784: - User 'JoshRosen' has created a pull request for

[jira] [Assigned] (SPARK-9784) Exchange.isUnsafe should check whether codegen and unsafe are enabled

[ https://issues.apache.org/jira/browse/SPARK-9784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9784: --- Assignee: Apache Spark (was: Josh Rosen) > Exchange.isUnsafe should check whether codegen an

  1   2   3   >