[jira] [Assigned] (SPARK-21784) Add ALTER TABLE ADD CONSTRANT DDL to support defining primary key and foreign keys

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21784: Assignee: Apache Spark > Add ALTER TABLE ADD CONSTRANT DDL to support defining primary

[jira] [Assigned] (SPARK-21808) Add R interface of binarizer

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21808: Assignee: Apache Spark > Add R interface of binarizer > > >

[jira] [Commented] (SPARK-18769) Spark to be smarter about what the upper bound is and to restrict number of executor when dynamic allocation is enabled

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144040#comment-16144040 ] Apache Spark commented on SPARK-18769: -- User 'vanzin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21774) The rule PromoteStrings cast string to a wrong data type

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21774: Assignee: (was: Apache Spark) > The rule PromoteStrings cast string to a wrong data

[jira] [Assigned] (SPARK-21821) Support to force kill the CoarseGrainedExecutorBackend process which is likely be orphaned.

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21821: Assignee: Apache Spark > Support to force kill the CoarseGrainedExecutorBackend process

[jira] [Commented] (SPARK-21821) Support to force kill the CoarseGrainedExecutorBackend process which is likely be orphaned.

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144038#comment-16144038 ] Apache Spark commented on SPARK-21821: -- User 'zuotingbing' has created a pull request for this

[jira] [Commented] (SPARK-21774) The rule PromoteStrings cast string to a wrong data type

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144029#comment-16144029 ] Apache Spark commented on SPARK-21774: -- User 'stanzhai' has created a pull request for this issue:

[jira] [Commented] (SPARK-21787) Support for pushing down filters for date types in ORC

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144037#comment-16144037 ] Apache Spark commented on SPARK-21787: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-21729) Generic test for ProbabilisticClassifier to ensure consistent output columns

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21729: Assignee: (was: Apache Spark) > Generic test for ProbabilisticClassifier to ensure

[jira] [Assigned] (SPARK-21849) Make the serializer function more robust

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21849: Assignee: (was: Apache Spark) > Make the serializer function more robust >

[jira] [Assigned] (SPARK-21848) Create trait to identify user-defined functions

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21848: Assignee: Apache Spark > Create trait to identify user-defined functions >

[jira] [Commented] (SPARK-19256) Hive bucketing support

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144033#comment-16144033 ] Apache Spark commented on SPARK-19256: -- User 'tejasapatil' has created a pull request for this

[jira] [Assigned] (SPARK-21834) Incorrect executor request in case of dynamic allocation

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21834: Assignee: (was: Apache Spark) > Incorrect executor request in case of dynamic

[jira] [Assigned] (SPARK-21811) Inconsistency when finding the widest common type of a combination of DateType, StringType, and NumericType

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21811: Assignee: Apache Spark > Inconsistency when finding the widest common type of a

[jira] [Assigned] (SPARK-21813) [core] Modify TaskMemoryManager.MAXIMUM_PAGE_SIZE_BYTES comments

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21813: Assignee: Apache Spark > [core] Modify TaskMemoryManager.MAXIMUM_PAGE_SIZE_BYTES comments

[jira] [Assigned] (SPARK-21829) Enable config to permanently blacklist a list of nodes

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21829: Assignee: (was: Apache Spark) > Enable config to permanently blacklist a list of

[jira] [Assigned] (SPARK-21774) The rule PromoteStrings cast string to a wrong data type

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21774: Assignee: Apache Spark > The rule PromoteStrings cast string to a wrong data type >

[jira] [Assigned] (SPARK-21568) ConsoleProgressBar should only be enabled in shells

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21568: Assignee: (was: Apache Spark) > ConsoleProgressBar should only be enabled in shells >

[jira] [Assigned] (SPARK-21737) Create communication channel between arbitrary clients and the Spark AM in YARN mode

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21737: Assignee: Apache Spark > Create communication channel between arbitrary clients and the

[jira] [Commented] (SPARK-21737) Create communication channel between arbitrary clients and the Spark AM in YARN mode

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144034#comment-16144034 ] Apache Spark commented on SPARK-21737: -- User 'yoonlee95' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21822) When insert Hive Table is finished, it is better to clean out the tmpLocation dir

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21822: Assignee: (was: Apache Spark) > When insert Hive Table is finished, it is better to

[jira] [Assigned] (SPARK-19256) Hive bucketing support

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19256: Assignee: (was: Apache Spark) > Hive bucketing support > -- > >

[jira] [Assigned] (SPARK-21688) performance improvement in mllib SVM with native BLAS

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21688: Assignee: (was: Apache Spark) > performance improvement in mllib SVM with native BLAS

[jira] [Commented] (SPARK-21771) SparkSQLEnv creates a useless meta hive client

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144032#comment-16144032 ] Apache Spark commented on SPARK-21771: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21845) Make codegen fallback of expressions configurable

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21845: Assignee: Xiao Li (was: Apache Spark) > Make codegen fallback of expressions

[jira] [Commented] (SPARK-21688) performance improvement in mllib SVM with native BLAS

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144027#comment-16144027 ] Apache Spark commented on SPARK-21688: -- User 'VinceShieh' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21845) Make codegen fallback of expressions configurable

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21845: Assignee: Apache Spark (was: Xiao Li) > Make codegen fallback of expressions

[jira] [Assigned] (SPARK-21688) performance improvement in mllib SVM with native BLAS

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21688: Assignee: Apache Spark > performance improvement in mllib SVM with native BLAS >

[jira] [Commented] (SPARK-21784) Add ALTER TABLE ADD CONSTRANT DDL to support defining primary key and foreign keys

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144039#comment-16144039 ] Apache Spark commented on SPARK-21784: -- User 'sureshthalamati' has created a pull request for this

[jira] [Assigned] (SPARK-21787) Support for pushing down filters for date types in ORC

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21787: Assignee: (was: Apache Spark) > Support for pushing down filters for date types in

[jira] [Assigned] (SPARK-21811) Inconsistency when finding the widest common type of a combination of DateType, StringType, and NumericType

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21811: Assignee: (was: Apache Spark) > Inconsistency when finding the widest common type of

[jira] [Assigned] (SPARK-21771) SparkSQLEnv creates a useless meta hive client

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21771: Assignee: (was: Apache Spark) > SparkSQLEnv creates a useless meta hive client >

[jira] [Assigned] (SPARK-20589) Allow limiting task concurrency per stage

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20589: Assignee: (was: Apache Spark) > Allow limiting task concurrency per stage >

[jira] [Commented] (SPARK-20589) Allow limiting task concurrency per stage

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144025#comment-16144025 ] Apache Spark commented on SPARK-20589: -- User 'dhruve' has created a pull request for this issue:

[jira] [Commented] (SPARK-21811) Inconsistency when finding the widest common type of a combination of DateType, StringType, and NumericType

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144036#comment-16144036 ] Apache Spark commented on SPARK-21811: -- User 'ryanbald' has created a pull request for this issue:

[jira] [Commented] (SPARK-21813) [core] Modify TaskMemoryManager.MAXIMUM_PAGE_SIZE_BYTES comments

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144035#comment-16144035 ] Apache Spark commented on SPARK-21813: -- User 'Geek-He' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21737) Create communication channel between arbitrary clients and the Spark AM in YARN mode

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21737: Assignee: (was: Apache Spark) > Create communication channel between arbitrary

[jira] [Assigned] (SPARK-21787) Support for pushing down filters for date types in ORC

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21787: Assignee: Apache Spark > Support for pushing down filters for date types in ORC >

[jira] [Assigned] (SPARK-21829) Enable config to permanently blacklist a list of nodes

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21829: Assignee: Apache Spark > Enable config to permanently blacklist a list of nodes >

[jira] [Assigned] (SPARK-21771) SparkSQLEnv creates a useless meta hive client

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21771: Assignee: Apache Spark > SparkSQLEnv creates a useless meta hive client >

[jira] [Assigned] (SPARK-21813) [core] Modify TaskMemoryManager.MAXIMUM_PAGE_SIZE_BYTES comments

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21813: Assignee: (was: Apache Spark) > [core] Modify

[jira] [Commented] (SPARK-21822) When insert Hive Table is finished, it is better to clean out the tmpLocation dir

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144031#comment-16144031 ] Apache Spark commented on SPARK-21822: -- User 'figo77' has created a pull request for this issue:

[jira] [Assigned] (SPARK-19256) Hive bucketing support

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19256: Assignee: Apache Spark > Hive bucketing support > -- > >

[jira] [Assigned] (SPARK-21822) When insert Hive Table is finished, it is better to clean out the tmpLocation dir

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21822: Assignee: Apache Spark > When insert Hive Table is finished, it is better to clean out

[jira] [Commented] (SPARK-21829) Enable config to permanently blacklist a list of nodes

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144030#comment-16144030 ] Apache Spark commented on SPARK-21829: -- User 'LucaCanali' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21848) Create trait to identify user-defined functions

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21848: Assignee: (was: Apache Spark) > Create trait to identify user-defined functions >

[jira] [Assigned] (SPARK-21835) RewritePredicateSubquery should not produce unresolved query plans

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21835: Assignee: (was: Apache Spark) > RewritePredicateSubquery should not produce

[jira] [Assigned] (SPARK-21729) Generic test for ProbabilisticClassifier to ensure consistent output columns

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21729: Assignee: Apache Spark > Generic test for ProbabilisticClassifier to ensure consistent

[jira] [Assigned] (SPARK-21835) RewritePredicateSubquery should not produce unresolved query plans

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21835: Assignee: Apache Spark > RewritePredicateSubquery should not produce unresolved query

[jira] [Assigned] (SPARK-21849) Make the serializer function more robust

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21849: Assignee: Apache Spark > Make the serializer function more robust >

[jira] [Commented] (SPARK-4131) Support "Writing data into the filesystem from queries"

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144028#comment-16144028 ] Apache Spark commented on SPARK-4131: - User 'janewangfb' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21568) ConsoleProgressBar should only be enabled in shells

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21568: Assignee: Apache Spark > ConsoleProgressBar should only be enabled in shells >

[jira] [Commented] (SPARK-21520) Improvement a special case for non-deterministic projects in optimizer

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144024#comment-16144024 ] Apache Spark commented on SPARK-21520: -- User 'heary-cao' has created a pull request for this issue:

[jira] [Commented] (SPARK-19372) Code generation for Filter predicate including many OR conditions exceeds JVM method size limit

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144026#comment-16144026 ] Apache Spark commented on SPARK-19372: -- User 'poplav' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20589) Allow limiting task concurrency per stage

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20589: Assignee: Apache Spark > Allow limiting task concurrency per stage >

[jira] [Assigned] (SPARK-21834) Incorrect executor request in case of dynamic allocation

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21834: Assignee: Apache Spark > Incorrect executor request in case of dynamic allocation >

[jira] [Assigned] (SPARK-21726) Check for structural integrity of the plan in QO in test mode

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21726: Assignee: Apache Spark > Check for structural integrity of the plan in QO in test mode >

[jira] [Assigned] (SPARK-21590) Structured Streaming window start time should support negative values to adjust time zone

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21590: Assignee: Apache Spark > Structured Streaming window start time should support negative

[jira] [Commented] (SPARK-12961) Work around memory leak in Snappy library

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144020#comment-16144020 ] Apache Spark commented on SPARK-12961: -- User 'maropu' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21692) Modify PythonUDF to support nullability

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21692: Assignee: Apache Spark > Modify PythonUDF to support nullability >

[jira] [Assigned] (SPARK-21469) Add doc and example for FeatureHasher

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21469: Assignee: Apache Spark > Add doc and example for FeatureHasher >

[jira] [Assigned] (SPARK-14371) OnlineLDAOptimizer should not collect stats for each doc in mini-batch to driver

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14371: Assignee: Apache Spark > OnlineLDAOptimizer should not collect stats for each doc in

[jira] [Assigned] (SPARK-21720) Filter predicate with many conditions throw stackoverflow error

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21720: Assignee: (was: Apache Spark) > Filter predicate with many conditions throw

[jira] [Assigned] (SPARK-21791) ORC should support column names with dot

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21791: Assignee: (was: Apache Spark) > ORC should support column names with dot >

[jira] [Commented] (SPARK-21764) Tests failures on Windows: resources not being closed and incorrect paths

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144018#comment-16144018 ] Apache Spark commented on SPARK-21764: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-14371) OnlineLDAOptimizer should not collect stats for each doc in mini-batch to driver

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144022#comment-16144022 ] Apache Spark commented on SPARK-14371: -- User 'akopich' has created a pull request for this issue:

[jira] [Commented] (SPARK-17654) Propagate bucketing information for Hive tables to / from Catalog

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144017#comment-16144017 ] Apache Spark commented on SPARK-17654: -- User 'tejasapatil' has created a pull request for this

[jira] [Commented] (SPARK-21720) Filter predicate with many conditions throw stackoverflow error

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144019#comment-16144019 ] Apache Spark commented on SPARK-21720: -- User 'kiszk' has created a pull request for this issue:

[jira] [Commented] (SPARK-21685) Params isSet in scala Transformer triggered by _setDefault in pyspark

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144021#comment-16144021 ] Apache Spark commented on SPARK-21685: -- User 'BryanCutler' has created a pull request for this

[jira] [Assigned] (SPARK-21791) ORC should support column names with dot

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21791: Assignee: Apache Spark > ORC should support column names with dot >

[jira] [Assigned] (SPARK-14371) OnlineLDAOptimizer should not collect stats for each doc in mini-batch to driver

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14371: Assignee: (was: Apache Spark) > OnlineLDAOptimizer should not collect stats for each

[jira] [Commented] (SPARK-21744) Add retry logic when create new broadcast

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144016#comment-16144016 ] Apache Spark commented on SPARK-21744: -- User 'caneGuy' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21744) Add retry logic when create new broadcast

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21744: Assignee: (was: Apache Spark) > Add retry logic when create new broadcast >

[jira] [Assigned] (SPARK-21781) Modify DataSourceScanExec to use concrete ColumnVector type.

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21781: Assignee: (was: Apache Spark) > Modify DataSourceScanExec to use concrete

[jira] [Assigned] (SPARK-21779) Simpler Dataset.sample API in Python

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21779: Assignee: Apache Spark > Simpler Dataset.sample API in Python >

[jira] [Assigned] (SPARK-21806) BinaryClassificationMetrics pr(): first point (0.0, 1.0) is misleading

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21806: Assignee: Apache Spark > BinaryClassificationMetrics pr(): first point (0.0, 1.0) is

[jira] [Assigned] (SPARK-21720) Filter predicate with many conditions throw stackoverflow error

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21720: Assignee: Apache Spark > Filter predicate with many conditions throw stackoverflow error

[jira] [Assigned] (SPARK-21685) Params isSet in scala Transformer triggered by _setDefault in pyspark

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21685: Assignee: Apache Spark > Params isSet in scala Transformer triggered by _setDefault in

[jira] [Assigned] (SPARK-21764) Tests failures on Windows: resources not being closed and incorrect paths

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21764: Assignee: Apache Spark > Tests failures on Windows: resources not being closed and

[jira] [Commented] (SPARK-19426) Add support for custom coalescers on Data

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144013#comment-16144013 ] Apache Spark commented on SPARK-19426: -- User 'maropu' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21806) BinaryClassificationMetrics pr(): first point (0.0, 1.0) is misleading

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21806: Assignee: (was: Apache Spark) > BinaryClassificationMetrics pr(): first point (0.0,

[jira] [Assigned] (SPARK-21764) Tests failures on Windows: resources not being closed and incorrect paths

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21764: Assignee: (was: Apache Spark) > Tests failures on Windows: resources not being closed

[jira] [Assigned] (SPARK-21685) Params isSet in scala Transformer triggered by _setDefault in pyspark

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21685: Assignee: (was: Apache Spark) > Params isSet in scala Transformer triggered by

[jira] [Assigned] (SPARK-21610) Corrupt records are not handled properly when creating a dataframe from a file

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21610: Assignee: (was: Apache Spark) > Corrupt records are not handled properly when

[jira] [Assigned] (SPARK-21746) nondeterministic expressions incorrectly for filter predicates

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21746: Assignee: (was: Apache Spark) > nondeterministic expressions incorrectly for filter

[jira] [Assigned] (SPARK-21673) Spark local directory is not set correctly

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21673: Assignee: Apache Spark > Spark local directory is not set correctly >

[jira] [Assigned] (SPARK-21717) Decouple the generated codes of consuming rows in operators under whole-stage codegen

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21717: Assignee: Apache Spark > Decouple the generated codes of consuming rows in operators

[jira] [Assigned] (SPARK-21783) Turn on ORC filter push-down by default

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21783: Assignee: Apache Spark > Turn on ORC filter push-down by default >

[jira] [Assigned] (SPARK-21726) Check for structural integrity of the plan in QO in test mode

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21726: Assignee: (was: Apache Spark) > Check for structural integrity of the plan in QO in

[jira] [Assigned] (SPARK-21746) nondeterministic expressions incorrectly for filter predicates

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21746: Assignee: Apache Spark > nondeterministic expressions incorrectly for filter predicates >

[jira] [Assigned] (SPARK-21469) Add doc and example for FeatureHasher

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21469: Assignee: (was: Apache Spark) > Add doc and example for FeatureHasher >

[jira] [Commented] (SPARK-21717) Decouple the generated codes of consuming rows in operators under whole-stage codegen

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144011#comment-16144011 ] Apache Spark commented on SPARK-21717: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21779) Simpler Dataset.sample API in Python

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21779: Assignee: (was: Apache Spark) > Simpler Dataset.sample API in Python >

[jira] [Commented] (SPARK-21590) Structured Streaming window start time should support negative values to adjust time zone

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144008#comment-16144008 ] Apache Spark commented on SPARK-21590: -- User 'KevinZwx' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21707) Improvement a special case for non-deterministic filters in optimizer

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21707: Assignee: Apache Spark > Improvement a special case for non-deterministic filters in

[jira] [Commented] (SPARK-21707) Improvement a special case for non-deterministic filters in optimizer

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144015#comment-16144015 ] Apache Spark commented on SPARK-21707: -- User 'heary-cao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21748) Migrate the implementation of HashingTF from MLlib to ML

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21748: Assignee: Apache Spark > Migrate the implementation of HashingTF from MLlib to ML >

[jira] [Commented] (SPARK-21704) Add the description of 'sbin/stop-slave.sh' in spark-standalone.html.

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144007#comment-16144007 ] Apache Spark commented on SPARK-21704: -- User 'guoxiaolongzte' has created a pull request for this

[jira] [Assigned] (SPARK-21781) Modify DataSourceScanExec to use concrete ColumnVector type.

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21781: Assignee: Apache Spark > Modify DataSourceScanExec to use concrete ColumnVector type. >

[jira] [Assigned] (SPARK-21707) Improvement a special case for non-deterministic filters in optimizer

2017-08-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21707: Assignee: (was: Apache Spark) > Improvement a special case for non-deterministic

<    1   2   3   4   5   6   >