[jira] [Created] (SPARK-13938) word2phrase feature created in ML

Steve Weng created SPARK-13938: -- Summary: word2phrase feature created in ML Key: SPARK-13938 URL: https://issues.apache.org/jira/browse/SPARK-13938 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-13968) Use MurmurHash3 for hashing String features

[ https://issues.apache.org/jira/browse/SPARK-13968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200254#comment-15200254 ] Nick Pentreath commented on SPARK-13968: Sure, I will assign to you. But I'd like

[jira] [Updated] (SPARK-13960) HTTP-based JAR Server doesn't respect spark.driver.host and there is no "spark.fileserver.host" option

[ https://issues.apache.org/jira/browse/SPARK-13960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ilya Ostrovskiy updated SPARK-13960: Description: There is no option to specify which hostname/IP address the jar/file server l

[jira] [Commented] (SPARK-13969) Extend input format that feature hashing can handle

[ https://issues.apache.org/jira/browse/SPARK-13969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15202007#comment-15202007 ] Joseph K. Bradley commented on SPARK-13969: --- I think HashingTF could be extende

[jira] [Commented] (SPARK-13461) Duplicated example code merge and cleanup

[ https://issues.apache.org/jira/browse/SPARK-13461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15203041#comment-15203041 ] Gabor Liptak commented on SPARK-13461: -- [~yinxusen] {{examples/src/main/scala/org/a

[jira] [Assigned] (SPARK-13958) Executor OOM due to unbounded growth of pointer array in Sorter

[ https://issues.apache.org/jira/browse/SPARK-13958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13958: Assignee: (was: Apache Spark) > Executor OOM due to unbounded growth of pointer array

[jira] [Commented] (SPARK-12719) SQL generation support for generators (including UDTF)

[ https://issues.apache.org/jira/browse/SPARK-12719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200419#comment-15200419 ] Apache Spark commented on SPARK-12719: -- User 'yy2016' has created a pull request for

[jira] [Resolved] (SPARK-10788) Decision Tree duplicates bins for unordered categorical features

[ https://issues.apache.org/jira/browse/SPARK-10788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-10788. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 9474 [ht

[jira] [Updated] (SPARK-13776) Web UI is not available after ./sbin/start-master.sh

[ https://issues.apache.org/jira/browse/SPARK-13776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13776: -- Assignee: Shixiong Zhu > Web UI is not available after ./sbin/start-master.sh > ---

[jira] [Updated] (SPARK-13972) hive tests should fail if SQL generation failed

[ https://issues.apache.org/jira/browse/SPARK-13972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13972: --- Assignee: Wenchen Fan > hive tests should fail if SQL generation failed > ---

[jira] [Commented] (SPARK-13865) TPCDS query 87 returns wrong results compared to TPC official result set

[ https://issues.apache.org/jira/browse/SPARK-13865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200516#comment-15200516 ] Xiao Li commented on SPARK-13865: - This is the same as the https://issues.apache.org/jira

[jira] [Updated] (SPARK-13948) MiMa Check should catch if the visibility change to `private`

[ https://issues.apache.org/jira/browse/SPARK-13948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-13948: --- Component/s: Project Infra > MiMa Check should catch if the visibility change to `private` > --

[jira] [Assigned] (SPARK-11319) PySpark silently accepts null values in non-nullable DataFrame fields.

[ https://issues.apache.org/jira/browse/SPARK-11319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11319: Assignee: (was: Apache Spark) > PySpark silently accepts null values in non-nullable D

[jira] [Commented] (SPARK-13629) Add binary toggle Param to CountVectorizer

[ https://issues.apache.org/jira/browse/SPARK-13629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201993#comment-15201993 ] Joseph K. Bradley commented on SPARK-13629: --- [~mlnick] Thanks for handling thes

[jira] [Commented] (SPARK-13968) Use MurmurHash3 for hashing String features

[ https://issues.apache.org/jira/browse/SPARK-13968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15202003#comment-15202003 ] Joseph K. Bradley commented on SPARK-13968: --- I'm going to close this in favor o

[jira] [Commented] (SPARK-14005) Make RDD more compatible with Scala's collection

[ https://issues.apache.org/jira/browse/SPARK-14005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15203056#comment-15203056 ] zhengruifeng commented on SPARK-14005: -- ok, plz close this jira. > Make RDD more co

[jira] [Resolved] (SPARK-13034) PySpark ml.classification support export/import

[ https://issues.apache.org/jira/browse/SPARK-13034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-13034. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11707 [h

[jira] [Commented] (SPARK-13733) Support initial weight distribution in personalized PageRank

[ https://issues.apache.org/jira/browse/SPARK-13733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15198327#comment-15198327 ] Gayathri Murali commented on SPARK-13733: - [~mengxr] Should the rest of the verti

[jira] [Assigned] (SPARK-13993) PySpark ml.feature.RFormula/RFormulaModel support export/import

[ https://issues.apache.org/jira/browse/SPARK-13993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13993: Assignee: Apache Spark > PySpark ml.feature.RFormula/RFormulaModel support export/import >

[jira] [Comment Edited] (SPARK-13821) TPC-DS Query 20 fails to compile

[ https://issues.apache.org/jira/browse/SPARK-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201506#comment-15201506 ] Roy Cecil edited comment on SPARK-13821 at 3/18/16 2:09 PM: D

[jira] [Commented] (SPARK-13928) Move org.apache.spark.Logging into org.apache.spark.internal.Logging

[ https://issues.apache.org/jira/browse/SPARK-13928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197584#comment-15197584 ] Apache Spark commented on SPARK-13928: -- User 'cloud-fan' has created a pull request

[jira] [Created] (SPARK-13961) spark.ml ChiSqSelector should support other numeric types for label

Nick Pentreath created SPARK-13961: -- Summary: spark.ml ChiSqSelector should support other numeric types for label Key: SPARK-13961 URL: https://issues.apache.org/jira/browse/SPARK-13961 Project: Spar

[jira] [Updated] (SPARK-12789) Support order by position in SQL

[ https://issues.apache.org/jira/browse/SPARK-12789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12789: Description: This is to support order by position in SQL, e.g. {noformat} select c1, c2, c3 from t

[jira] [Commented] (SPARK-13960) JAR/File HTTP Server doesn't respect "spark.driver.host" and there is no "spark.fileserver.host" option

[ https://issues.apache.org/jira/browse/SPARK-13960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200690#comment-15200690 ] Ilya Ostrovskiy commented on SPARK-13960: - exporting the SPARK_LOCAL_IP environme

[jira] [Updated] (SPARK-12789) Support order by position in SQL

[ https://issues.apache.org/jira/browse/SPARK-12789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12789: Summary: Support order by position in SQL (was: Support order by position) > Support order by posi

[jira] [Updated] (SPARK-13983) HiveThriftServer2 can not get "--hiveconf" or ''--hivevar" variables since 1.6 version (both multi-session and single session)

[ https://issues.apache.org/jira/browse/SPARK-13983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-13983: --- Assignee: Cheng Lian > HiveThriftServer2 can not get "--hiveconf" or ''--hivevar" variables since >

[jira] [Comment Edited] (SPARK-13935) Other clients' connection hang up when someone do huge load

[ https://issues.apache.org/jira/browse/SPARK-13935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197554#comment-15197554 ] Tao Wang edited comment on SPARK-13935 at 3/16/16 3:51 PM: --- [~m

[jira] [Commented] (SPARK-13761) Deprecate validateParams

[ https://issues.apache.org/jira/browse/SPARK-13761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200097#comment-15200097 ] Apache Spark commented on SPARK-13761: -- User 'jkbradley' has created a pull request

[jira] [Closed] (SPARK-13821) TPC-DS Query 20 fails to compile

[ https://issues.apache.org/jira/browse/SPARK-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roy Cecil closed SPARK-13821. - Resolution: Not A Problem > TPC-DS Query 20 fails to compile > > >

[jira] [Commented] (SPARK-13937) PySpark ML JavaWrapper, variable _java_obj should not be static

[ https://issues.apache.org/jira/browse/SPARK-13937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197902#comment-15197902 ] Apache Spark commented on SPARK-13937: -- User 'BryanCutler' has created a pull reques

[jira] [Commented] (SPARK-13461) Duplicated example code merge and cleanup

[ https://issues.apache.org/jira/browse/SPARK-13461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15203076#comment-15203076 ] Xusen Yin commented on SPARK-13461: --- Yes we'll delete it. > Duplicated example code me

[jira] [Resolved] (SPARK-13776) Web UI is not available after ./sbin/start-master.sh

[ https://issues.apache.org/jira/browse/SPARK-13776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13776. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11615 [https://github.co

[jira] [Created] (SPARK-14009) Fail the tests if the any catalyst rule reach max number of iteration.

Davies Liu created SPARK-14009: -- Summary: Fail the tests if the any catalyst rule reach max number of iteration. Key: SPARK-14009 URL: https://issues.apache.org/jira/browse/SPARK-14009 Project: Spark

[jira] [Updated] (SPARK-13038) PySpark ml.pipeline support export/import - non-nested Pipelines

[ https://issues.apache.org/jira/browse/SPARK-13038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-13038: -- Summary: PySpark ml.pipeline support export/import - non-nested Pipelines (was: PySpar

[jira] [Updated] (SPARK-7992) Hide private classes/objects in in generated Java API doc

[ https://issues.apache.org/jira/browse/SPARK-7992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7992: - Assignee: (was: Xiangrui Meng) > Hide private classes/objects in in generated Java API doc > -

[jira] [Updated] (SPARK-13982) SparkR - KMeans predict: Output column name of features is an unclear, automatic genetared text

[ https://issues.apache.org/jira/browse/SPARK-13982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Narine Kokhlikyan updated SPARK-13982: -- Summary: SparkR - KMeans predict: Output column name of features is an unclear, automat

[jira] [Assigned] (SPARK-13858) TPCDS query 21 returns wrong results compared to TPC official result set

[ https://issues.apache.org/jira/browse/SPARK-13858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13858: Assignee: Apache Spark > TPCDS query 21 returns wrong results compared to TPC official res

[jira] [Commented] (SPARK-13950) Generate code for sort merge left/right outer join

[ https://issues.apache.org/jira/browse/SPARK-13950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15198162#comment-15198162 ] Apache Spark commented on SPARK-13950: -- User 'davies' has created a pull request for

[jira] [Updated] (SPARK-13932) CUBE Query with filter (HAVING) and condition (IF) raises an AnalysisException

[ https://issues.apache.org/jira/browse/SPARK-13932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tien-Dung LE updated SPARK-13932: - Affects Version/s: 2.0.0 > CUBE Query with filter (HAVING) and condition (IF) raises an AnalysisE

[jira] [Created] (SPARK-13946) PySpark DataFrames allows you to silently use aggregate expressions derived from different table expressions

Wes McKinney created SPARK-13946: Summary: PySpark DataFrames allows you to silently use aggregate expressions derived from different table expressions Key: SPARK-13946 URL: https://issues.apache.org/jira/browse/S

[jira] [Assigned] (SPARK-13957) Support group by ordinal in SQL

[ https://issues.apache.org/jira/browse/SPARK-13957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13957: Assignee: Apache Spark > Support group by ordinal in SQL > ---

[jira] [Commented] (SPARK-13957) Support group by ordinal in SQL

[ https://issues.apache.org/jira/browse/SPARK-13957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15203089#comment-15203089 ] Apache Spark commented on SPARK-13957: -- User 'gatorsmile' has created a pull request

[jira] [Assigned] (SPARK-13957) Support group by ordinal in SQL

[ https://issues.apache.org/jira/browse/SPARK-13957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13957: Assignee: (was: Apache Spark) > Support group by ordinal in SQL >

[jira] [Updated] (SPARK-14010) ColumnPruning is conflict with PushPredicateThroughProject

[ https://issues.apache.org/jira/browse/SPARK-14010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-14010: --- Description: ColumnPruning will insert a Project before Filter, but PushPredicateThroughProject will

[jira] [Created] (SPARK-13976) do not remove sub-queries added by user when generate SQL

Wenchen Fan created SPARK-13976: --- Summary: do not remove sub-queries added by user when generate SQL Key: SPARK-13976 URL: https://issues.apache.org/jira/browse/SPARK-13976 Project: Spark Issue

[jira] [Assigned] (SPARK-13951) PySpark ml.pipeline support export/import - nested Piplines

[ https://issues.apache.org/jira/browse/SPARK-13951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13951: Assignee: Apache Spark > PySpark ml.pipeline support export/import - nested Piplines > ---

[jira] [Updated] (SPARK-12789) Support order by position in SQL

[ https://issues.apache.org/jira/browse/SPARK-12789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12789: Description: This is to support order by position in SQL, e.g. {noformat} select c1, c2, c3 from t

[jira] [Updated] (SPARK-13963) Add binary toggle Param to ml.HashingTF

[ https://issues.apache.org/jira/browse/SPARK-13963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath updated SPARK-13963: --- Assignee: Bryan Cutler > Add binary toggle Param to ml.HashingTF > --

[jira] [Updated] (SPARK-13964) Feature hashing improvements

[ https://issues.apache.org/jira/browse/SPARK-13964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath updated SPARK-13964: --- Priority: Minor (was: Major) > Feature hashing improvements > >

[jira] [Commented] (SPARK-14014) Replace existing analysis.Catalog with SessionCatalog

[ https://issues.apache.org/jira/browse/SPARK-14014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15202318#comment-15202318 ] Apache Spark commented on SPARK-14014: -- User 'andrewor14' has created a pull request

[jira] [Updated] (SPARK-13905) Change signature of as.data.frame() to be consistent with the R base package

[ https://issues.apache.org/jira/browse/SPARK-13905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sun Rui updated SPARK-13905: Description: (was: SparkR provides a method as.data.frame() to collect a SparkR DataFrame into a local

[jira] [Resolved] (SPARK-13901) We get wrong logdebug information when jump to the next locality level.

[ https://issues.apache.org/jira/browse/SPARK-13901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13901. --- Resolution: Fixed Fix Version/s: 1.6.2 2.0.0 Issue resolved by pull request

[jira] [Resolved] (SPARK-13816) Add parameter checks for algorithms in Graphx

[ https://issues.apache.org/jira/browse/SPARK-13816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13816. - Resolution: Fixed Assignee: zhengruifeng Fix Version/s: 2.0.0 > Add parameter che

[jira] [Updated] (SPARK-14010) ColumnPruning is conflict with PushPredicateThroughProject

[ https://issues.apache.org/jira/browse/SPARK-14010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-14010: --- Description: ColumnPruning will insert a Project before Filter, but > ColumnPruning is conflict with

[jira] [Updated] (SPARK-13979) Killed executor is respawned without AWS keys in standalone spark cluster

[ https://issues.apache.org/jira/browse/SPARK-13979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen George updated SPARK-13979: - Description: I'm having a problem where respawning a failed executor during a job that reads/wri

[jira] [Assigned] (SPARK-13938) word2phrase feature created in ML

[ https://issues.apache.org/jira/browse/SPARK-13938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13938: Assignee: (was: Apache Spark) > word2phrase feature created in ML > --

[jira] [Commented] (SPARK-13865) TPCDS query 87 returns wrong results compared to TPC official result set

[ https://issues.apache.org/jira/browse/SPARK-13865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200821#comment-15200821 ] Xiao Li commented on SPARK-13865: - The query I posted here is downloaded from the officia

[jira] [Issue Comment Deleted] (SPARK-13963) Add binary toggle Param to ml.HashingTF

[ https://issues.apache.org/jira/browse/SPARK-13963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath updated SPARK-13963: --- Comment: was deleted (was: Sure, assigned to you.) > Add binary toggle Param to ml.HashingTF

[jira] [Assigned] (SPARK-14011) Enable `LineLength` Java checkstyle rule

[ https://issues.apache.org/jira/browse/SPARK-14011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14011: Assignee: Apache Spark > Enable `LineLength` Java checkstyle rule > --

[jira] [Created] (SPARK-13943) The behavior of sum(booleantype) in Spark DataFrames is not intuitive

Wes McKinney created SPARK-13943: Summary: The behavior of sum(booleantype) in Spark DataFrames is not intuitive Key: SPARK-13943 URL: https://issues.apache.org/jira/browse/SPARK-13943 Project: Spark

[jira] [Commented] (SPARK-13861) TPCDS query 40 returns wrong results compared to TPC official result set

[ https://issues.apache.org/jira/browse/SPARK-13861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15198526#comment-15198526 ] Xiao Li commented on SPARK-13861: - Great job! I am just wondering if only cs_sales_price

[jira] [Commented] (SPARK-13877) Consider removing Kafka modules from Spark / Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-13877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200252#comment-15200252 ] Kostas Sakellis commented on SPARK-13877: - How is this any different than creatin

[jira] [Commented] (SPARK-13933) hadoop-2.7 profile's curator version should be 2.7.1

[ https://issues.apache.org/jira/browse/SPARK-13933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197217#comment-15197217 ] Sean Owen commented on SPARK-13933: --- Tachyon isn't used in the project anymore in 2.x a

[jira] [Updated] (SPARK-13978) [GSoC 2016] Build monitoring UI (and infrastructure) for Spark SQL and structured streaming

[ https://issues.apache.org/jira/browse/SPARK-13978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-13978: - Summary: [GSoC 2016] Build monitoring UI (and infrastructure) for Spark SQL and structured streaming (wa

[jira] [Created] (SPARK-13939) Kafka createDirectStream not parallelizing properly

Ben Teeuwen created SPARK-13939: --- Summary: Kafka createDirectStream not parallelizing properly Key: SPARK-13939 URL: https://issues.apache.org/jira/browse/SPARK-13939 Project: Spark Issue Type:

<    1   2   3   4   5   6