[jira] [Commented] (SPARK-4122) Add library to write data back to Kafka

[ https://issues.apache.org/jira/browse/SPARK-4122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14188052#comment-14188052 ] Apache Spark commented on SPARK-4122: - User 'harishreedharan' has created a pull reque

[jira] [Commented] (SPARK-4129) Performance tuning in MultivariateOnlineSummarizer

[ https://issues.apache.org/jira/browse/SPARK-4129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14188037#comment-14188037 ] Apache Spark commented on SPARK-4129: - User 'dbtsai' has created a pull request for th

[jira] [Created] (SPARK-4129) Performance tuning in MultivariateOnlineSummarizer

DB Tsai created SPARK-4129: -- Summary: Performance tuning in MultivariateOnlineSummarizer Key: SPARK-4129 URL: https://issues.apache.org/jira/browse/SPARK-4129 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-3080) ArrayIndexOutOfBoundsException in ALS for Large datasets

[ https://issues.apache.org/jira/browse/SPARK-3080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14188012#comment-14188012 ] Xiangrui Meng commented on SPARK-3080: -- Thanks for confirming the issue! I guess this

[jira] [Commented] (SPARK-4113) Pyhon UDF on ArrayType

[ https://issues.apache.org/jira/browse/SPARK-4113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14188007#comment-14188007 ] Apache Spark commented on SPARK-4113: - User 'davies' has created a pull request for th

[jira] [Commented] (SPARK-4062) Improve KafkaReceiver to prevent data loss

[ https://issues.apache.org/jira/browse/SPARK-4062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14188008#comment-14188008 ] Apache Spark commented on SPARK-4062: - User 'jerryshao' has created a pull request for

[jira] [Created] (SPARK-4128) Create instructions on fully building Spark in Intellij

Patrick Wendell created SPARK-4128: -- Summary: Create instructions on fully building Spark in Intellij Key: SPARK-4128 URL: https://issues.apache.org/jira/browse/SPARK-4128 Project: Spark Iss

[jira] [Commented] (SPARK-4094) checkpoint should still be available after rdd actions

[ https://issues.apache.org/jira/browse/SPARK-4094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187982#comment-14187982 ] Zhang, Liye commented on SPARK-4094: [SPARK-3625|https://issues.apache.org/jira/browse

[jira] [Updated] (SPARK-1442) Add Window function support

[ https://issues.apache.org/jira/browse/SPARK-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guowei updated SPARK-1442: -- Attachment: Window Function.pdf > Add Window function support > --- > >

[jira] [Closed] (SPARK-3008) PySpark fails due to zipimport not able to load the assembly jar (/usr/bin/python: No module named pyspark)

[ https://issues.apache.org/jira/browse/SPARK-3008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jai Kumar Singh closed SPARK-3008. -- > PySpark fails due to zipimport not able to load the assembly jar > (/usr/bin/python: No module n

[jira] [Resolved] (SPARK-4008) Fix "kryo with fold" in KryoSerializerSuite

[ https://issues.apache.org/jira/browse/SPARK-4008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-4008. - Resolution: Fixed Fix Version/s: 1.2.0 > Fix "kryo with fold" in KryoSerializerSuite >

[jira] [Commented] (SPARK-4120) Join of multiple tables with syntax like SELECT .. FROM T1,T2,T3.. does not work in SparkSQL

[ https://issues.apache.org/jira/browse/SPARK-4120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187929#comment-14187929 ] Apache Spark commented on SPARK-4120: - User 'ravipesala' has created a pull request fo

[jira] [Comment Edited] (SPARK-3398) Have spark-ec2 intelligently wait for specific cluster states

[ https://issues.apache.org/jira/browse/SPARK-3398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187900#comment-14187900 ] Nicholas Chammas edited comment on SPARK-3398 at 10/29/14 2:48 AM: -

[jira] [Resolved] (SPARK-4113) Pyhon UDF on ArrayType

[ https://issues.apache.org/jira/browse/SPARK-4113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4113. - Resolution: Fixed Fix Version/s: 1.2.0 > Pyhon UDF on ArrayType > -

[jira] [Updated] (SPARK-4127) Streaming Linear Regression

[ https://issues.apache.org/jira/browse/SPARK-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anant Daksh Asthana updated SPARK-4127: --- Description: Create python bindings for Streaming Linear Regression (MLlib). The Mllib

[jira] [Updated] (SPARK-4127) Streaming Linear Regression

[ https://issues.apache.org/jira/browse/SPARK-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anant Daksh Asthana updated SPARK-4127: --- Description: Create python bindings for Streaming Linear Regression (MLlib). The Mllib

[jira] [Commented] (SPARK-4127) Streaming Linear Regression

[ https://issues.apache.org/jira/browse/SPARK-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187906#comment-14187906 ] Anant Daksh Asthana commented on SPARK-4127: [~mengxr] [~freeman-lab] Just add

[jira] [Created] (SPARK-4127) Streaming Linear Regression

Anant Daksh Asthana created SPARK-4127: -- Summary: Streaming Linear Regression Key: SPARK-4127 URL: https://issues.apache.org/jira/browse/SPARK-4127 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-3904) HQL doesn't support the ConstantObjectInspector to pass into UDFs

[ https://issues.apache.org/jira/browse/SPARK-3904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3904. - Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2762 [https:/

[jira] [Commented] (SPARK-3398) Have spark-ec2 intelligently wait for specific cluster states

[ https://issues.apache.org/jira/browse/SPARK-3398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187900#comment-14187900 ] Nicholas Chammas commented on SPARK-3398: - If that fixes it for you, then I think

[jira] [Commented] (SPARK-3398) Have spark-ec2 intelligently wait for specific cluster states

[ https://issues.apache.org/jira/browse/SPARK-3398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187898#comment-14187898 ] Nicholas Chammas commented on SPARK-3398: - I think I've found the issue. It doesn'

[jira] [Created] (SPARK-4126) Do not set `spark.executor.instances` if not needed (yarn-cluster)

Andrew Or created SPARK-4126: Summary: Do not set `spark.executor.instances` if not needed (yarn-cluster) Key: SPARK-4126 URL: https://issues.apache.org/jira/browse/SPARK-4126 Project: Spark Iss

[jira] [Commented] (SPARK-2468) Netty-based block server / client module

[ https://issues.apache.org/jira/browse/SPARK-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187881#comment-14187881 ] zzc commented on SPARK-2468: thanks > Netty-based block server / client module >

[jira] [Updated] (SPARK-3466) Limit size of results that a driver collects for each action

[ https://issues.apache.org/jira/browse/SPARK-3466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-3466: - Priority: Critical (was: Major) > Limit size of results that a driver collects for each action >

[jira] [Commented] (SPARK-3398) Have spark-ec2 intelligently wait for specific cluster states

[ https://issues.apache.org/jira/browse/SPARK-3398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187861#comment-14187861 ] Nicholas Chammas commented on SPARK-3398: - So I spun up an Ubuntu server on EC2 an

[jira] [Commented] (SPARK-2468) Netty-based block server / client module

[ https://issues.apache.org/jira/browse/SPARK-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187837#comment-14187837 ] Reynold Xin commented on SPARK-2468: Take a look here https://cwiki.apache.org/conflue

[jira] [Commented] (SPARK-2468) Netty-based block server / client module

[ https://issues.apache.org/jira/browse/SPARK-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187832#comment-14187832 ] zzc commented on SPARK-2468: Hi，Reynold Xin, When version 1.2 released, approximate time? > N

[jira] [Commented] (SPARK-2215) Multi-way join

[ https://issues.apache.org/jira/browse/SPARK-2215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187798#comment-14187798 ] Reynold Xin commented on SPARK-2215: I think a simplified version of the multi-way joi

[jira] [Commented] (SPARK-3683) PySpark Hive query generates "NULL" instead of None

[ https://issues.apache.org/jira/browse/SPARK-3683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187768#comment-14187768 ] Cheng Lian commented on SPARK-3683: --- Actually a Hive session was illustrated in SPARK-19

[jira] [Commented] (SPARK-3862) MultiWayBroadcastInnerHashJoin

[ https://issues.apache.org/jira/browse/SPARK-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187759#comment-14187759 ] Apache Spark commented on SPARK-3862: - User 'rxin' has created a pull request for this

[jira] [Commented] (SPARK-3683) PySpark Hive query generates "NULL" instead of None

[ https://issues.apache.org/jira/browse/SPARK-3683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187757#comment-14187757 ] Cheng Lian commented on SPARK-3683: --- [~davies] I removed this special case for "NULL" be

[jira] [Commented] (SPARK-4125) Serializer should work on ManagedBuffers as well

[ https://issues.apache.org/jira/browse/SPARK-4125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187696#comment-14187696 ] Aaron Davidson commented on SPARK-4125: --- cc [~rxin] > Serializer should work on Man

[jira] [Created] (SPARK-4125) Serializer should work on ManagedBuffers as well

Aaron Davidson created SPARK-4125: - Summary: Serializer should work on ManagedBuffers as well Key: SPARK-4125 URL: https://issues.apache.org/jira/browse/SPARK-4125 Project: Spark Issue Type:

[jira] [Commented] (SPARK-3933) Optimize decimal type in Spark SQL for those with small precision

[ https://issues.apache.org/jira/browse/SPARK-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187667#comment-14187667 ] Apache Spark commented on SPARK-3933: - User 'mateiz' has created a pull request for th

[jira] [Commented] (SPARK-3930) Add precision and scale to Spark SQL's Decimal type

[ https://issues.apache.org/jira/browse/SPARK-3930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187666#comment-14187666 ] Apache Spark commented on SPARK-3930: - User 'mateiz' has created a pull request for th

[jira] [Created] (SPARK-4124) Simplify serialization and call API in MLlib Python

Davies Liu created SPARK-4124: - Summary: Simplify serialization and call API in MLlib Python Key: SPARK-4124 URL: https://issues.apache.org/jira/browse/SPARK-4124 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-4123) Show new dependencies added in pull requests

[ https://issues.apache.org/jira/browse/SPARK-4123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187598#comment-14187598 ] Nicholas Chammas commented on SPARK-4123: - Sure thing, [~pwendell], though I will

[jira] [Commented] (SPARK-3398) Have spark-ec2 intelligently wait for specific cluster states

[ https://issues.apache.org/jira/browse/SPARK-3398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187593#comment-14187593 ] Nicholas Chammas commented on SPARK-3398: - OK, so you're invoking {{spark-ec2}} fr

[jira] [Commented] (SPARK-4123) Show new dependencies added in pull requests

[ https://issues.apache.org/jira/browse/SPARK-4123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187590#comment-14187590 ] Patrick Wendell commented on SPARK-4123: [~nchammas] - do you have any interest in

[jira] [Resolved] (SPARK-4084) Reuse sort key in Sorter

[ https://issues.apache.org/jira/browse/SPARK-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Davidson resolved SPARK-4084. --- Resolution: Fixed Fix Version/s: 1.2.0 > Reuse sort key in Sorter > ---

[jira] [Updated] (SPARK-4123) Show new dependencies added in pull requests

[ https://issues.apache.org/jira/browse/SPARK-4123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4123: --- Description: We should inspect the classpath of Spark's assembly jar for every pull request.

[jira] [Created] (SPARK-4123) Show new dependencies added in pull requests

Patrick Wendell created SPARK-4123: -- Summary: Show new dependencies added in pull requests Key: SPARK-4123 URL: https://issues.apache.org/jira/browse/SPARK-4123 Project: Spark Issue Type: Im

[jira] [Commented] (SPARK-3683) PySpark Hive query generates "NULL" instead of None

[ https://issues.apache.org/jira/browse/SPARK-3683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187570#comment-14187570 ] Michael Armbrust commented on SPARK-3683: - Good find! [~jamborta] if you can give

[jira] [Commented] (SPARK-3398) Have spark-ec2 intelligently wait for specific cluster states

[ https://issues.apache.org/jira/browse/SPARK-3398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187566#comment-14187566 ] Michael Griffiths commented on SPARK-3398: -- In order - # I tried a few times;

[jira] [Commented] (SPARK-3683) PySpark Hive query generates "NULL" instead of None

[ https://issues.apache.org/jira/browse/SPARK-3683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187563#comment-14187563 ] Davies Liu commented on SPARK-3683: --- This commit remove the special case for "NULL": {co

[jira] [Commented] (SPARK-3398) Have spark-ec2 intelligently wait for specific cluster states

[ https://issues.apache.org/jira/browse/SPARK-3398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187553#comment-14187553 ] Nicholas Chammas commented on SPARK-3398: - Hmm, I'm curious: # Why did you have to

[jira] [Commented] (SPARK-3398) Have spark-ec2 intelligently wait for specific cluster states

[ https://issues.apache.org/jira/browse/SPARK-3398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187543#comment-14187543 ] Michael Griffiths commented on SPARK-3398: -- I waited until all the servers (11) w

[jira] [Commented] (SPARK-3683) PySpark Hive query generates "NULL" instead of None

[ https://issues.apache.org/jira/browse/SPARK-3683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187537#comment-14187537 ] Michael Armbrust commented on SPARK-3683: - [~davies] there used to be some explici

[jira] [Commented] (SPARK-3398) Have spark-ec2 intelligently wait for specific cluster states

[ https://issues.apache.org/jira/browse/SPARK-3398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187519#comment-14187519 ] Nicholas Chammas commented on SPARK-3398: - [~michael.griffiths] - [{{wait_for_clu

[jira] [Updated] (SPARK-2335) k-Nearest Neighbor classification and regression for MLLib

[ https://issues.apache.org/jira/browse/SPARK-2335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Gawalt updated SPARK-2335: Labels: features (was: features newbie) > k-Nearest Neighbor classification and regression for MLLi

[jira] [Resolved] (SPARK-3343) Support for CREATE TABLE AS SELECT that specifies the format

[ https://issues.apache.org/jira/browse/SPARK-3343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3343. - Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2570 [https:/

[jira] [Resolved] (SPARK-3922) A global UTF8 constant for Spark

[ https://issues.apache.org/jira/browse/SPARK-3922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-3922. Resolution: Fixed Fix Version/s: 1.2.0 Assignee: Shixiong Zhu > A global UTF8 consta

[jira] [Commented] (SPARK-4121) Master build failures after shading commons-math3

[ https://issues.apache.org/jira/browse/SPARK-4121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187475#comment-14187475 ] Sean Owen commented on SPARK-4121: -- Yeah I was seeing this locally, but not on the Jenkin

[jira] [Comment Edited] (SPARK-3398) Have spark-ec2 intelligently wait for specific cluster states

[ https://issues.apache.org/jira/browse/SPARK-3398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187471#comment-14187471 ] Michael Griffiths edited comment on SPARK-3398 at 10/28/14 9:10 PM:

[jira] [Commented] (SPARK-3398) Have spark-ec2 intelligently wait for specific cluster states

[ https://issues.apache.org/jira/browse/SPARK-3398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187471#comment-14187471 ] Michael Griffiths commented on SPARK-3398: -- I'm running into an issue with {{wait

[jira] [Created] (SPARK-4122) Add library to write data back to Kafka

Hari Shreedharan created SPARK-4122: --- Summary: Add library to write data back to Kafka Key: SPARK-4122 URL: https://issues.apache.org/jira/browse/SPARK-4122 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-4121) Master build failures after shading commons-math3

[ https://issues.apache.org/jira/browse/SPARK-4121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187458#comment-14187458 ] Josh Rosen commented on SPARK-4121: --- Here's an easy command to reproduce this: {code} m

[jira] [Commented] (SPARK-4121) Master build failures after shading commons-math3

[ https://issues.apache.org/jira/browse/SPARK-4121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187453#comment-14187453 ] Patrick Wendell commented on SPARK-4121: [~srowen] - can you help with this? This

[jira] [Updated] (SPARK-4121) Master build failures after shading commons-math3

[ https://issues.apache.org/jira/browse/SPARK-4121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-4121: - Description: The Spark master Maven build kept failing after we replace colt with commons-math3 a

[jira] [Created] (SPARK-4121) Master build failures after shading commons-math3

Xiangrui Meng created SPARK-4121: Summary: Master build failures after shading commons-math3 Key: SPARK-4121 URL: https://issues.apache.org/jira/browse/SPARK-4121 Project: Spark Issue Type: B

[jira] [Updated] (SPARK-4121) Master build failures after shading commons-math3

[ https://issues.apache.org/jira/browse/SPARK-4121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-4121: - Component/s: MLlib Build > Master build failures after shading commons-math3 > --

[jira] [Resolved] (SPARK-3988) Public API for DateType support

[ https://issues.apache.org/jira/browse/SPARK-3988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3988. - Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2901 [https:/

[jira] [Resolved] (SPARK-3814) Support for Bitwise AND(&), OR(|) ,XOR(^), NOT(~) in Spark HQL and SQL

[ https://issues.apache.org/jira/browse/SPARK-3814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3814. - Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2961 [https:/

[jira] [Closed] (SPARK-4058) Log file name is hard coded even though there is a variable '$LOG_FILE '

[ https://issues.apache.org/jira/browse/SPARK-4058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4058. Resolution: Fixed Fix Version/s: 1.2.0 Assignee: Kousuke Saruta > Log file name is hard code

[jira] [Commented] (SPARK-4048) Enhance and extend hadoop-provided profile

[ https://issues.apache.org/jira/browse/SPARK-4048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187355#comment-14187355 ] Apache Spark commented on SPARK-4048: - User 'vanzin' has created a pull request for th

[jira] [Updated] (SPARK-4065) pyspark will not use ipython on Windows

[ https://issues.apache.org/jira/browse/SPARK-4065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4065: - Assignee: Michael Griffiths > pyspark will not use ipython on Windows > --

[jira] [Closed] (SPARK-4065) pyspark will not use ipython on Windows

[ https://issues.apache.org/jira/browse/SPARK-4065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4065. Resolution: Fixed Fix Version/s: 1.2.0 1.1.1 Target Version/s: 1.1.1,

[jira] [Closed] (SPARK-4089) The version number of Spark in _config.yaml is wrong.

[ https://issues.apache.org/jira/browse/SPARK-4089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4089. Resolution: Fixed Fix Version/s: 1.2.0 Assignee: Kousuke Saruta > The version number of Spar

[jira] [Closed] (SPARK-3657) yarn alpha YarnRMClientImpl throws NPE appMasterRequest.setTrackingUrl starting spark-shell

[ https://issues.apache.org/jira/browse/SPARK-3657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3657. Resolution: Fixed Fix Version/s: 1.2.0 Assignee: Kousuke Saruta > yarn alpha YarnRMClientImp

[jira] [Closed] (SPARK-4096) let ApplicationMaster accept executor memory argument in same format as JVM memory strings

[ https://issues.apache.org/jira/browse/SPARK-4096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4096. Resolution: Fixed Fix Version/s: 1.2.0 Assignee: WangTaoTheTonic Target Version/

[jira] [Updated] (SPARK-4096) let ApplicationMaster accept executor memory argument in same format as JVM memory strings

[ https://issues.apache.org/jira/browse/SPARK-4096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4096: - Affects Version/s: 1.1.0 > let ApplicationMaster accept executor memory argument in same format as JVM >

[jira] [Resolved] (SPARK-4107) Incorrect handling of Channel.read()'s return value may lead to data truncation

[ https://issues.apache.org/jira/browse/SPARK-4107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-4107. Resolution: Fixed Fix Version/s: 1.2.0 1.1.1 > Incorrect handling of Chann

[jira] [Closed] (SPARK-4110) Wrong comments about default settings in spark-daemon.sh

[ https://issues.apache.org/jira/browse/SPARK-4110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4110. Resolution: Fixed Fix Version/s: 1.2.0 1.1.1 Assignee: Kousuke

[jira] [Updated] (SPARK-3611) Show number of cores for each executor in application web UI

[ https://issues.apache.org/jira/browse/SPARK-3611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3611: - Affects Version/s: 1.0.0 > Show number of cores for each executor in application web UI >

[jira] [Created] (SPARK-4120) Join of multiple tables with syntax like SELECT .. FROM T1,T2,T3.. does not work in SparkSQL

Ravindra Pesala created SPARK-4120: -- Summary: Join of multiple tables with syntax like SELECT .. FROM T1,T2,T3.. does not work in SparkSQL Key: SPARK-4120 URL: https://issues.apache.org/jira/browse/SPARK-4120

[jira] [Commented] (SPARK-2468) Netty-based block server / client module

[ https://issues.apache.org/jira/browse/SPARK-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187183#comment-14187183 ] Reynold Xin commented on SPARK-2468: Scheduled to go in in 1.2. > Netty-based block s

[jira] [Created] (SPARK-4119) Don't rely on HIVE_DEV_HOME to find .q files

Cheng Lian created SPARK-4119: - Summary: Don't rely on HIVE_DEV_HOME to find .q files Key: SPARK-4119 URL: https://issues.apache.org/jira/browse/SPARK-4119 Project: Spark Issue Type: Test

[jira] [Created] (SPARK-4118) Create python bindings for Streaming KMeans

Anant Daksh Asthana created SPARK-4118: -- Summary: Create python bindings for Streaming KMeans Key: SPARK-4118 URL: https://issues.apache.org/jira/browse/SPARK-4118 Project: Spark Issue T

[jira] [Commented] (SPARK-4031) Read broadcast variables on use

[ https://issues.apache.org/jira/browse/SPARK-4031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187122#comment-14187122 ] Shivaram Venkataraman commented on SPARK-4031: -- Issue resolved by pull reques

[jira] [Resolved] (SPARK-4031) Read broadcast variables on use

[ https://issues.apache.org/jira/browse/SPARK-4031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-4031. -- Resolution: Fixed Fix Version/s: 1.2.0 > Read broadcast variables on use

[jira] [Commented] (SPARK-3657) yarn alpha YarnRMClientImpl throws NPE appMasterRequest.setTrackingUrl starting spark-shell

[ https://issues.apache.org/jira/browse/SPARK-3657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187070#comment-14187070 ] Apache Spark commented on SPARK-3657: - User 'sarutak' has created a pull request for t

[jira] [Commented] (SPARK-3561) Allow for pluggable execution contexts in Spark

[ https://issues.apache.org/jira/browse/SPARK-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186987#comment-14186987 ] Oleg Zhurakousky commented on SPARK-3561: - [~vanzin] I would not call it hard (we

[jira] [Commented] (SPARK-2335) k-Nearest Neighbor classification and regression for MLLib

[ https://issues.apache.org/jira/browse/SPARK-2335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186954#comment-14186954 ] Kaushik Ranjan commented on SPARK-2335: --- Hi [~bgawalt]. For evaluation of KNN-join,

[jira] [Resolved] (SPARK-4098) use appUIAddress instead of appUIHostPort in yarn-client mode

[ https://issues.apache.org/jira/browse/SPARK-4098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-4098. -- Resolution: Fixed Fix Version/s: 1.2.0 > use appUIAddress instead of appUIHostPort in yar

[jira] [Commented] (SPARK-2468) Netty-based block server / client module

[ https://issues.apache.org/jira/browse/SPARK-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186910#comment-14186910 ] zzc commented on SPARK-2468: Hi，Reynold Xin, What time does this issue can be solved? I need t

[jira] [Commented] (SPARK-3611) Show number of cores for each executor in application web UI

[ https://issues.apache.org/jira/browse/SPARK-3611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186909#comment-14186909 ] Apache Spark commented on SPARK-3611: - User 'devldevelopment' has created a pull reque

[jira] [Updated] (SPARK-4108) Fix uses of @deprecated in catalyst dataTypes

[ https://issues.apache.org/jira/browse/SPARK-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anant Daksh Asthana updated SPARK-4108: --- Component/s: SQL > Fix uses of @deprecated in catalyst dataTypes > ---

[jira] [Created] (SPARK-4117) Spark on Yarn handle AM being told command from RM

Thomas Graves created SPARK-4117: Summary: Spark on Yarn handle AM being told command from RM Key: SPARK-4117 URL: https://issues.apache.org/jira/browse/SPARK-4117 Project: Spark Issue Type:

[jira] [Commented] (SPARK-3837) Warn when YARN is killing containers for exceeding memory limits

[ https://issues.apache.org/jira/browse/SPARK-3837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186850#comment-14186850 ] Apache Spark commented on SPARK-3837: - User 'sryza' has created a pull request for thi

[jira] [Resolved] (SPARK-4095) [YARN][Minor]extract val isLaunchingDriver in ClientBase

[ https://issues.apache.org/jira/browse/SPARK-4095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-4095. -- Resolution: Fixed Fix Version/s: 1.2.0 > [YARN][Minor]extract val isLaunchingDriver in Cl

[jira] [Resolved] (SPARK-4116) Delete the abandoned log4j-spark-container.properties

[ https://issues.apache.org/jira/browse/SPARK-4116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-4116. -- Resolution: Fixed Fix Version/s: 1.2.0 > Delete the abandoned log4j-spark-container.prope

[jira] [Commented] (SPARK-4111) [MLlib] Implement regression model evaluation metrics

[ https://issues.apache.org/jira/browse/SPARK-4111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186741#comment-14186741 ] Apache Spark commented on SPARK-4111: - User 'yanbohappy' has created a pull request fo

[jira] [Commented] (SPARK-2352) [MLLIB] Add Artificial Neural Network (ANN) to Spark

[ https://issues.apache.org/jira/browse/SPARK-2352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186711#comment-14186711 ] Apache Spark commented on SPARK-2352: - User 'bgreeven' has created a pull request for

[jira] [Commented] (SPARK-4111) [MLlib] Implement regression model evaluation metrics

[ https://issues.apache.org/jira/browse/SPARK-4111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186710#comment-14186710 ] Yanbo Liang commented on SPARK-4111: https://github.com/apache/spark/pull/2978 > [MLl

[jira] [Resolved] (SPARK-3961) Python API for mllib.feature

[ https://issues.apache.org/jira/browse/SPARK-3961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-3961. -- Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2819 [https://githu

[jira] [Commented] (SPARK-2335) k-Nearest Neighbor classification and regression for MLLib

[ https://issues.apache.org/jira/browse/SPARK-2335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186659#comment-14186659 ] Ashutosh Trivedi commented on SPARK-2335: - Thanks [~bgawalt] and [~slcclimber] for

[jira] [Commented] (SPARK-4038) Outlier Detection Algorithm for MLlib

[ https://issues.apache.org/jira/browse/SPARK-4038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186656#comment-14186656 ] Ashutosh Trivedi commented on SPARK-4038: - tagging [~Kaushik619] As he is also wor

[jira] [Commented] (SPARK-4116) Delete the abandoned log4j-spark-container.properties

[ https://issues.apache.org/jira/browse/SPARK-4116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186641#comment-14186641 ] Apache Spark commented on SPARK-4116: - User 'WangTaoTheTonic' has created a pull reque

[jira] [Created] (SPARK-4116) Delete the abandoned log4j-spark-container.properties

WangTaoTheTonic created SPARK-4116: -- Summary: Delete the abandoned log4j-spark-container.properties Key: SPARK-4116 URL: https://issues.apache.org/jira/browse/SPARK-4116 Project: Spark Issue

[jira] [Commented] (SPARK-3461) Support external groupByKey using repartitionAndSortWithinPartitions

[ https://issues.apache.org/jira/browse/SPARK-3461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186562#comment-14186562 ] Sandy Ryza commented on SPARK-3461: --- SPARK-2926 could help with this as well. > Support

  1   2   >