[jira] [Commented] (SPARK-9254) sbt-launch-lib.bash should use `curl --location` to support HTTP/HTTPS redirection

[ https://issues.apache.org/jira/browse/SPARK-9254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637044#comment-14637044 ] Apache Spark commented on SPARK-9254: - User 'liancheng' has created a pull request for

[jira] [Assigned] (SPARK-9254) sbt-launch-lib.bash should use `curl --location` to support HTTP/HTTPS redirection

[ https://issues.apache.org/jira/browse/SPARK-9254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9254: --- Assignee: Cheng Lian (was: Apache Spark) sbt-launch-lib.bash should use `curl --location`

[jira] [Assigned] (SPARK-9254) sbt-launch-lib.bash should use `curl --location` to support HTTP/HTTPS redirection

[ https://issues.apache.org/jira/browse/SPARK-9254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9254: --- Assignee: Apache Spark (was: Cheng Lian) sbt-launch-lib.bash should use `curl --location`

[jira] [Resolved] (SPARK-9254) sbt-launch-lib.bash should use `curl --location` to support HTTP/HTTPS redirection

[ https://issues.apache.org/jira/browse/SPARK-9254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-9254. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7597

[jira] [Updated] (SPARK-9254) sbt-launch-lib.bash should use `curl --location` to support HTTP/HTTPS redirection

[ https://issues.apache.org/jira/browse/SPARK-9254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-9254: -- Target Version/s: 1.4.2, 1.5.0 (was: 1.5.0) sbt-launch-lib.bash should use `curl --location` to

[jira] [Commented] (SPARK-9253) Allow to create machines with different AWS credentials than will be used for accessing the S3

[ https://issues.apache.org/jira/browse/SPARK-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637043#comment-14637043 ] Apache Spark commented on SPARK-9253: - User 'ziky90' has created a pull request for

[jira] [Assigned] (SPARK-9253) Allow to create machines with different AWS credentials than will be used for accessing the S3

[ https://issues.apache.org/jira/browse/SPARK-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9253: --- Assignee: (was: Apache Spark) Allow to create machines with different AWS credentials

[jira] [Created] (SPARK-9254) sbt-launch-lib.bash should use `curl --location` to support HTTP/HTTPS redirection

Cheng Lian created SPARK-9254: - Summary: sbt-launch-lib.bash should use `curl --location` to support HTTP/HTTPS redirection Key: SPARK-9254 URL: https://issues.apache.org/jira/browse/SPARK-9254 Project:

[jira] [Updated] (SPARK-9254) sbt-launch-lib.bash should use `curl --location` to support HTTP/HTTPS redirection

[ https://issues.apache.org/jira/browse/SPARK-9254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-9254: Labels: backport-needed (was: ) sbt-launch-lib.bash should use `curl --location` to support HTTP/HTTPS

[jira] [Reopened] (SPARK-9254) sbt-launch-lib.bash should use `curl --location` to support HTTP/HTTPS redirection

[ https://issues.apache.org/jira/browse/SPARK-9254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian reopened SPARK-9254: --- Reopening this since we need to backport this fix to branch-1.4. sbt-launch-lib.bash should use `curl

[jira] [Assigned] (SPARK-9253) Allow to create machines with different AWS credentials than will be used for accessing the S3

[ https://issues.apache.org/jira/browse/SPARK-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9253: --- Assignee: Apache Spark Allow to create machines with different AWS credentials than will be

[jira] [Updated] (SPARK-9192) add initialization phase for nondeterministic expression

[ https://issues.apache.org/jira/browse/SPARK-9192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-9192: --- Summary: add initialization phase for nondeterministic expression (was: add initialization phase for

[jira] [Updated] (SPARK-8364) Add crosstab to SparkR DataFrames

[ https://issues.apache.org/jira/browse/SPARK-8364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8364: - Shepherd: Shivaram Venkataraman Add crosstab to SparkR DataFrames

[jira] [Updated] (SPARK-9230) SparkR RFormula should support StringType features

[ https://issues.apache.org/jira/browse/SPARK-9230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9230: - Target Version/s: 1.5.0 SparkR RFormula should support StringType features

[jira] [Updated] (SPARK-9230) SparkR RFormula should support StringType features

[ https://issues.apache.org/jira/browse/SPARK-9230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9230: - Assignee: Eric Liang SparkR RFormula should support StringType features

[jira] [Updated] (SPARK-9192) add initialization phase for nondeterministic expression

[ https://issues.apache.org/jira/browse/SPARK-9192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-9192: --- Description: Currently nondeterministic expression is broken without a explicit initialization

[jira] [Commented] (SPARK-9192) add initialization phase for nondeterministic expression

[ https://issues.apache.org/jira/browse/SPARK-9192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637124#comment-14637124 ] Wenchen Fan commented on SPARK-9192: hi [~lian cheng], sorry about leaving the

[jira] [Created] (SPARK-9256) Message delay causes Master crash upon registering application

Colin Scott created SPARK-9256: -- Summary: Message delay causes Master crash upon registering application Key: SPARK-9256 URL: https://issues.apache.org/jira/browse/SPARK-9256 Project: Spark

[jira] [Commented] (SPARK-1301) Add UI elements to collapse Aggregated Metrics by Executor pane on stage page

[ https://issues.apache.org/jira/browse/SPARK-1301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637299#comment-14637299 ] Ryan Williams commented on SPARK-1301: -- [~srowen] I read this as referring to the

[jira] [Commented] (SPARK-4024) Remember user preferences for metrics to show in the UI

[ https://issues.apache.org/jira/browse/SPARK-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637306#comment-14637306 ] Ryan Williams commented on SPARK-4024: -- FWIW it seemed like [~zsxwing] solved some of

[jira] [Updated] (SPARK-9255) Timestamp handling incorrect for Spark 1.4.1 on Linux

[ https://issues.apache.org/jira/browse/SPARK-9255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Wu updated SPARK-9255: --- Attachment: timestamp_bug.zip the project can run without issues. But when it is deployed to the Timestamp

[jira] [Updated] (SPARK-7075) Project Tungsten: Improving Physical Execution

[ https://issues.apache.org/jira/browse/SPARK-7075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7075: --- Target Version/s: 1.6.0 (was: ) Project Tungsten: Improving Physical Execution

[jira] [Created] (SPARK-9255) Timestamp handling incorrect for Spark 1.4.1 on Linux

Paul Wu created SPARK-9255: -- Summary: Timestamp handling incorrect for Spark 1.4.1 on Linux Key: SPARK-9255 URL: https://issues.apache.org/jira/browse/SPARK-9255 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-9257) Fix the false negative of Aggregate2Sort and FinalAndCompleteAggregate2Sort's missingInput

Yin Huai created SPARK-9257: --- Summary: Fix the false negative of Aggregate2Sort and FinalAndCompleteAggregate2Sort's missingInput Key: SPARK-9257 URL: https://issues.apache.org/jira/browse/SPARK-9257

[jira] [Commented] (SPARK-5992) Locality Sensitive Hashing (LSH) for MLlib

[ https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637337#comment-14637337 ] Maruf Aytekin commented on SPARK-5992: -- In addition to Charikar's scheme for cosine

[jira] [Commented] (SPARK-6885) Decision trees: predict class probabilities

[ https://issues.apache.org/jira/browse/SPARK-6885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637316#comment-14637316 ] Joseph K. Bradley commented on SPARK-6885: -- We can resume this work. Do you

[jira] [Resolved] (SPARK-9082) Filter using non-deterministic expressions should not be pushed down

[ https://issues.apache.org/jira/browse/SPARK-9082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-9082. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7446

[jira] [Resolved] (SPARK-9165) Implement code generation for CreateArray, CreateStruct, and CreateNamedStruct

[ https://issues.apache.org/jira/browse/SPARK-9165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-9165. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7537

[jira] [Updated] (SPARK-6970) Document what the options: Map[String, String] does on DataFrame.save and DataFrame.saveAsTable

[ https://issues.apache.org/jira/browse/SPARK-6970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Muller updated SPARK-6970: --- Affects Version/s: (was: 1.4.1) (was: 1.4.0) Document what the

[jira] [Commented] (SPARK-6028) Provide an alternative RPC implementation based on the network transport module

[ https://issues.apache.org/jira/browse/SPARK-6028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637443#comment-14637443 ] Colin Scott commented on SPARK-6028: Curious: does this new RPC implementation use TCP

[jira] [Created] (SPARK-9259) How to write Python code to send data from Kafka via Spark to HDFS?

sutanu das created SPARK-9259: - Summary: How to write Python code to send data from Kafka via Spark to HDFS? Key: SPARK-9259 URL: https://issues.apache.org/jira/browse/SPARK-9259 Project: Spark

[jira] [Created] (SPARK-9260) Standalone scheduling can overflow a worker with cores

Andrew Or created SPARK-9260: Summary: Standalone scheduling can overflow a worker with cores Key: SPARK-9260 URL: https://issues.apache.org/jira/browse/SPARK-9260 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-6028) Provide an alternative RPC implementation based on the network transport module

[ https://issues.apache.org/jira/browse/SPARK-6028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637443#comment-14637443 ] Colin Scott edited comment on SPARK-6028 at 7/22/15 7:10 PM: -

[jira] [Commented] (SPARK-6028) Provide an alternative RPC implementation based on the network transport module

[ https://issues.apache.org/jira/browse/SPARK-6028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637472#comment-14637472 ] Reynold Xin commented on SPARK-6028: TPC. Provide an alternative RPC implementation

[jira] [Updated] (SPARK-9224) OnlineLDAOptimizer Performance Improvements

[ https://issues.apache.org/jira/browse/SPARK-9224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9224: - Shepherd: Joseph K. Bradley OnlineLDAOptimizer Performance Improvements

[jira] [Updated] (SPARK-9224) OnlineLDAOptimizer Performance Improvements

[ https://issues.apache.org/jira/browse/SPARK-9224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9224: - Assignee: Feynman Liang OnlineLDAOptimizer Performance Improvements

[jira] [Updated] (SPARK-3947) Support Scala/Java UDAF

[ https://issues.apache.org/jira/browse/SPARK-3947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-3947: Summary: Support Scala/Java UDAF (was: Support UDAF) Support Scala/Java UDAF ---

[jira] [Created] (SPARK-9261) StreamingTab calls public APIs in Spark core that expose shaded classes

Marcelo Vanzin created SPARK-9261: - Summary: StreamingTab calls public APIs in Spark core that expose shaded classes Key: SPARK-9261 URL: https://issues.apache.org/jira/browse/SPARK-9261 Project:

[jira] [Commented] (SPARK-9262) Treat Scala compiler warnings as errors

[ https://issues.apache.org/jira/browse/SPARK-9262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637581#comment-14637581 ] Apache Spark commented on SPARK-9262: - User 'rxin' has created a pull request for this

[jira] [Assigned] (SPARK-9262) Treat Scala compiler warnings as errors

[ https://issues.apache.org/jira/browse/SPARK-9262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9262: --- Assignee: Apache Spark (was: Reynold Xin) Treat Scala compiler warnings as errors

[jira] [Created] (SPARK-9258) Remove BroadcastLeftSemiJoinHash

Reynold Xin created SPARK-9258: -- Summary: Remove BroadcastLeftSemiJoinHash Key: SPARK-9258 URL: https://issues.apache.org/jira/browse/SPARK-9258 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-9259) How to write Python code to send data from Kafka via Spark to HDFS?

[ https://issues.apache.org/jira/browse/SPARK-9259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637458#comment-14637458 ] Marcelo Vanzin commented on SPARK-9259: --- Are you trying to report a bug or to ask

[jira] [Resolved] (SPARK-9259) How to write Python code to send data from Kafka via Spark to HDFS?

[ https://issues.apache.org/jira/browse/SPARK-9259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-9259. --- Resolution: Invalid How to write Python code to send data from Kafka via Spark to HDFS?

[jira] [Updated] (SPARK-6970) Document what the options: Map[String, String] does on DataFrame.save and DataFrame.saveAsTable

[ https://issues.apache.org/jira/browse/SPARK-6970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Muller updated SPARK-6970: --- Target Version/s: (was: 1.3.2) Document what the options: Map[String, String] does on

[jira] [Updated] (SPARK-6970) Document what the options: Map[String, String] does on DataFrame.save and DataFrame.saveAsTable

[ https://issues.apache.org/jira/browse/SPARK-6970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Muller updated SPARK-6970: --- Affects Version/s: 1.4.0 1.4.1 Document what the options: Map[String, String]

[jira] [Updated] (SPARK-9258) Remove all semi join physical operator

[ https://issues.apache.org/jira/browse/SPARK-9258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9258: --- Description: We have 4 semi join operators. In this case, they are not very very necessary. We can

[jira] [Resolved] (SPARK-9024) Unsafe HashJoin

[ https://issues.apache.org/jira/browse/SPARK-9024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-9024. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7480

[jira] [Resolved] (SPARK-9224) OnlineLDAOptimizer Performance Improvements

[ https://issues.apache.org/jira/browse/SPARK-9224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-9224. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7454

[jira] [Resolved] (SPARK-4234) Always do paritial aggregation

[ https://issues.apache.org/jira/browse/SPARK-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-4234. - Resolution: Fixed Fix Version/s: 1.5.0 With the interface introduced by SPARK-4233, we have the

[jira] [Updated] (SPARK-9256) Message delay causes Master crash upon registering application

[ https://issues.apache.org/jira/browse/SPARK-9256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Scott updated SPARK-9256: --- Description: This bug occurs when `spark.deploy.recoveryMode` is set to FILESYSTEM, and I believe it

[jira] [Created] (SPARK-9262) Treat Scala compiler warnings as errors

Reynold Xin created SPARK-9262: -- Summary: Treat Scala compiler warnings as errors Key: SPARK-9262 URL: https://issues.apache.org/jira/browse/SPARK-9262 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-9262) Treat Scala compiler warnings as errors

[ https://issues.apache.org/jira/browse/SPARK-9262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9262: --- Assignee: Reynold Xin (was: Apache Spark) Treat Scala compiler warnings as errors

[jira] [Updated] (SPARK-9258) Remove all semi join physical operator

[ https://issues.apache.org/jira/browse/SPARK-9258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9258: --- Summary: Remove all semi join physical operator (was: Remove BroadcastLeftSemiJoinHash) Remove all

[jira] [Closed] (SPARK-6970) Document what the options: Map[String, String] does on DataFrame.save and DataFrame.saveAsTable

[ https://issues.apache.org/jira/browse/SPARK-6970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Muller closed SPARK-6970. -- Undocumented parts of DataFrames were deprecated Document what the options: Map[String, String] does on

[jira] [Resolved] (SPARK-6970) Document what the options: Map[String, String] does on DataFrame.save and DataFrame.saveAsTable

[ https://issues.apache.org/jira/browse/SPARK-6970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Muller resolved SPARK-6970. Resolution: Won't Fix Fix Version/s: 1.4.0 Resolving as won't fix. The new DataFrames API

[jira] [Updated] (SPARK-9256) Message delay causes Master crash upon registering application

[ https://issues.apache.org/jira/browse/SPARK-9256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Scott updated SPARK-9256: --- Description: This bug occurs when `spark.deploy.recoveryMode` is set to FILESYSTEM, and I believe it

[jira] [Commented] (SPARK-6802) User Defined Aggregate Function Refactoring

[ https://issues.apache.org/jira/browse/SPARK-6802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637555#comment-14637555 ] Yin Huai commented on SPARK-6802: - We have added Scala/Java UDAF support through

[jira] [Resolved] (SPARK-4233) Simplify the Aggregation Function implementation

[ https://issues.apache.org/jira/browse/SPARK-4233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-4233. Resolution: Fixed Assignee: Cheng Hao Fix Version/s: 1.5.0 Simplify the

[jira] [Resolved] (SPARK-4367) Partial aggregation support the DISTINCT aggregation

[ https://issues.apache.org/jira/browse/SPARK-4367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-4367. Resolution: Fixed Assignee: Yin Huai Fix Version/s: 1.5.0 Partial aggregation

[jira] [Updated] (SPARK-9231) DistributedLDAModel method for top topics per document

[ https://issues.apache.org/jira/browse/SPARK-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9231: - Description: Helper method in DistributedLDAModel of this form: {code} /** * For each

[jira] [Commented] (SPARK-9223) Support model save/load in Python's LDA

[ https://issues.apache.org/jira/browse/SPARK-9223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636386#comment-14636386 ] Apache Spark commented on SPARK-9223: - User 'MechCoder' has created a pull request for

[jira] [Commented] (SPARK-8856) Better instrumentation and visualization for physical plan

[ https://issues.apache.org/jira/browse/SPARK-8856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636405#comment-14636405 ] Apache Spark commented on SPARK-8856: - User 'feynmanliang' has created a pull request

[jira] [Assigned] (SPARK-8856) Better instrumentation and visualization for physical plan

[ https://issues.apache.org/jira/browse/SPARK-8856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8856: --- Assignee: Apache Spark (was: Shixiong Zhu) Better instrumentation and visualization for

[jira] [Updated] (SPARK-9213) Improve regular expression performance (via joni)

[ https://issues.apache.org/jira/browse/SPARK-9213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-9213: -- Target Version/s: 1.6.0 (was: ) Improve regular expression performance (via joni)

[jira] [Created] (SPARK-9250) ./dev/change-scala-version.sh should offer guidance what versions are accepted, i.e. 2.10 or 2.11

Jacek Laskowski created SPARK-9250: -- Summary: ./dev/change-scala-version.sh should offer guidance what versions are accepted, i.e. 2.10 or 2.11 Key: SPARK-9250 URL:

[jira] [Assigned] (SPARK-7075) Project Tungsten: Improving Physical Execution

[ https://issues.apache.org/jira/browse/SPARK-7075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7075: --- Assignee: Reynold Xin (was: Apache Spark) Project Tungsten: Improving Physical Execution

[jira] [Commented] (SPARK-7075) Project Tungsten: Improving Physical Execution

[ https://issues.apache.org/jira/browse/SPARK-7075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636496#comment-14636496 ] Apache Spark commented on SPARK-7075: - User 'davies' has created a pull request for

[jira] [Commented] (SPARK-9131) UDFs change data values

[ https://issues.apache.org/jira/browse/SPARK-9131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636508#comment-14636508 ] Luis Guerra commented on SPARK-9131: By the way, UDFs code should be changed to return

[jira] [Created] (SPARK-9248) Closing curly-braces should always be on their own line

Yu Ishikawa created SPARK-9248: -- Summary: Closing curly-braces should always be on their own line Key: SPARK-9248 URL: https://issues.apache.org/jira/browse/SPARK-9248 Project: Spark Issue

[jira] [Assigned] (SPARK-9251) do not order by expressions which still need evaluation

[ https://issues.apache.org/jira/browse/SPARK-9251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9251: --- Assignee: (was: Apache Spark) do not order by expressions which still need evaluation

[jira] [Commented] (SPARK-9083) If order by clause has non-deterministic expressions, we should add a project to materialize results of these expressions

[ https://issues.apache.org/jira/browse/SPARK-9083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636546#comment-14636546 ] Apache Spark commented on SPARK-9083: - User 'cloud-fan' has created a pull request for

[jira] [Commented] (SPARK-9251) do not order by expressions which still need evaluation

[ https://issues.apache.org/jira/browse/SPARK-9251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636545#comment-14636545 ] Apache Spark commented on SPARK-9251: - User 'cloud-fan' has created a pull request for

[jira] [Assigned] (SPARK-9083) If order by clause has non-deterministic expressions, we should add a project to materialize results of these expressions

[ https://issues.apache.org/jira/browse/SPARK-9083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9083: --- Assignee: Wenchen Fan (was: Apache Spark) If order by clause has non-deterministic

[jira] [Assigned] (SPARK-9083) If order by clause has non-deterministic expressions, we should add a project to materialize results of these expressions

[ https://issues.apache.org/jira/browse/SPARK-9083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9083: --- Assignee: Apache Spark (was: Wenchen Fan) If order by clause has non-deterministic

[jira] [Assigned] (SPARK-9251) do not order by expressions which still need evaluation

[ https://issues.apache.org/jira/browse/SPARK-9251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9251: --- Assignee: Apache Spark do not order by expressions which still need evaluation

[jira] [Assigned] (SPARK-9223) Support model save/load in Python's LDA

[ https://issues.apache.org/jira/browse/SPARK-9223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9223: --- Assignee: Apache Spark Support model save/load in Python's LDA

[jira] [Assigned] (SPARK-9223) Support model save/load in Python's LDA

[ https://issues.apache.org/jira/browse/SPARK-9223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9223: --- Assignee: (was: Apache Spark) Support model save/load in Python's LDA

[jira] [Commented] (SPARK-8187) date/time function: date_sub

[ https://issues.apache.org/jira/browse/SPARK-8187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636407#comment-14636407 ] Apache Spark commented on SPARK-8187: - User 'adrian-wang' has created a pull request

[jira] [Assigned] (SPARK-8856) Better instrumentation and visualization for physical plan

[ https://issues.apache.org/jira/browse/SPARK-8856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8856: --- Assignee: Shixiong Zhu (was: Apache Spark) Better instrumentation and visualization for

[jira] [Commented] (SPARK-8186) date/time function: date_add

[ https://issues.apache.org/jira/browse/SPARK-8186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636406#comment-14636406 ] Apache Spark commented on SPARK-8186: - User 'adrian-wang' has created a pull request

[jira] [Commented] (SPARK-8856) Better instrumentation and visualization for physical plan

[ https://issues.apache.org/jira/browse/SPARK-8856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636413#comment-14636413 ] Reynold Xin commented on SPARK-8856: It's fine to mark it as in progress since it is

[jira] [Commented] (SPARK-8856) Better instrumentation and visualization for physical plan

[ https://issues.apache.org/jira/browse/SPARK-8856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636412#comment-14636412 ] Feynman Liang commented on SPARK-8856: -- Oops, I tagged the wrong JIRA in the PR. Can

[jira] [Commented] (SPARK-9131) UDFs change data values

[ https://issues.apache.org/jira/browse/SPARK-9131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636490#comment-14636490 ] Luis Guerra commented on SPARK-9131: Actually, the file is reduced by compression to

[jira] [Commented] (SPARK-9131) UDFs change data values

[ https://issues.apache.org/jira/browse/SPARK-9131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636489#comment-14636489 ] Luis Guerra commented on SPARK-9131: Agree, I have prepared a dataset.json and is

[jira] [Updated] (SPARK-9131) UDFs change data values

[ https://issues.apache.org/jira/browse/SPARK-9131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luis Guerra updated SPARK-9131: --- Attachment: testjson_jira9131.z02 testjson_jira9131.z03

[jira] [Created] (SPARK-9245) DistributedLDAModel predict top topic per doc-term instance

Joseph K. Bradley created SPARK-9245: Summary: DistributedLDAModel predict top topic per doc-term instance Key: SPARK-9245 URL: https://issues.apache.org/jira/browse/SPARK-9245 Project: Spark

[jira] [Commented] (SPARK-8861) Add basic instrumentation to each SparkPlan operator

[ https://issues.apache.org/jira/browse/SPARK-8861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636411#comment-14636411 ] Apache Spark commented on SPARK-8861: - User 'feynmanliang' has created a pull request

[jira] [Assigned] (SPARK-8861) Add basic instrumentation to each SparkPlan operator

[ https://issues.apache.org/jira/browse/SPARK-8861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8861: --- Assignee: (was: Apache Spark) Add basic instrumentation to each SparkPlan operator

[jira] [Assigned] (SPARK-8861) Add basic instrumentation to each SparkPlan operator

[ https://issues.apache.org/jira/browse/SPARK-8861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8861: --- Assignee: Apache Spark Add basic instrumentation to each SparkPlan operator

[jira] [Created] (SPARK-9246) DistributedLDAModel predict top docs per topic

Joseph K. Bradley created SPARK-9246: Summary: DistributedLDAModel predict top docs per topic Key: SPARK-9246 URL: https://issues.apache.org/jira/browse/SPARK-9246 Project: Spark Issue

[jira] [Deleted] (SPARK-7590) Test Issue to Debug JIRA Problem

[ https://issues.apache.org/jira/browse/SPARK-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-7590: -- Test Issue to Debug JIRA Problem Key: SPARK-7590

[jira] [Commented] (SPARK-8579) Support arbitrary object in UnsafeRow

[ https://issues.apache.org/jira/browse/SPARK-8579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636495#comment-14636495 ] Apache Spark commented on SPARK-8579: - User 'rxin' has created a pull request for this

[jira] [Assigned] (SPARK-7075) Project Tungsten: Improving Physical Execution

[ https://issues.apache.org/jira/browse/SPARK-7075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7075: --- Assignee: Apache Spark (was: Reynold Xin) Project Tungsten: Improving Physical Execution

[jira] [Created] (SPARK-9247) Use BytesToBytesMap in unsafe broadcast join

Davies Liu created SPARK-9247: - Summary: Use BytesToBytesMap in unsafe broadcast join Key: SPARK-9247 URL: https://issues.apache.org/jira/browse/SPARK-9247 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-9249) local variable assigned but may not be used

Yu Ishikawa created SPARK-9249: -- Summary: local variable assigned but may not be used Key: SPARK-9249 URL: https://issues.apache.org/jira/browse/SPARK-9249 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-9244) Increase some default memory limits

[ https://issues.apache.org/jira/browse/SPARK-9244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9244: --- Assignee: Apache Spark (was: Matei Zaharia) Increase some default memory limits

[jira] [Assigned] (SPARK-9244) Increase some default memory limits

[ https://issues.apache.org/jira/browse/SPARK-9244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9244: --- Assignee: Matei Zaharia (was: Apache Spark) Increase some default memory limits

[jira] [Resolved] (SPARK-9232) Duplicate code in JSONRelation

[ https://issues.apache.org/jira/browse/SPARK-9232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9232. Resolution: Fixed Fix Version/s: 1.5.0 Duplicate code in JSONRelation

[jira] [Commented] (SPARK-9144) Remove DAGScheduler.runLocallyWithinThread and spark.localExecution.enabled

[ https://issues.apache.org/jira/browse/SPARK-9144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636367#comment-14636367 ] Apache Spark commented on SPARK-9144: - User 'rxin' has created a pull request for this

[jira] [Commented] (SPARK-9244) Increase some default memory limits

[ https://issues.apache.org/jira/browse/SPARK-9244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636371#comment-14636371 ] Apache Spark commented on SPARK-9244: - User 'mateiz' has created a pull request for

  1   2   3   >