[jira] [Commented] (SPARK-9690) Adding the possibility to set the seed of the rand in the CrossValidator fold

[ https://issues.apache.org/jira/browse/SPARK-9690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660270#comment-14660270 ] Apache Spark commented on SPARK-9690: - User 'mmenestret' has created a pull request

[jira] [Assigned] (SPARK-9690) Adding the possibility to set the seed of the rand in the CrossValidator fold

[ https://issues.apache.org/jira/browse/SPARK-9690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9690: --- Assignee: Apache Spark Adding the possibility to set the seed of the rand in the

[jira] [Assigned] (SPARK-9690) Adding the possibility to set the seed of the rand in the CrossValidator fold

[ https://issues.apache.org/jira/browse/SPARK-9690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9690: --- Assignee: (was: Apache Spark) Adding the possibility to set the seed of the rand in the

[jira] [Commented] (SPARK-9182) filter and groupBy on DataFrames are not passed through to jdbc source

[ https://issues.apache.org/jira/browse/SPARK-9182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660278#comment-14660278 ] Cheng Lian commented on SPARK-9182: --- Hey [~grahn], sorry for the late reply, I somehow

[jira] [Updated] (SPARK-9690) Adding the possibility to set the seed of the rand in the CrossValidator fold

[ https://issues.apache.org/jira/browse/SPARK-9690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9690: - Fix Version/s: (was: 1.5.0) [~Mmenestret] Don't set fix version

[jira] [Commented] (SPARK-9515) Creating JavaSparkContext with yarn-cluster mode throws NPE

[ https://issues.apache.org/jira/browse/SPARK-9515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660286#comment-14660286 ] nirav patel commented on SPARK-9515: [~srowen] I just gave a reason why I can't use

[jira] [Resolved] (SPARK-8978) Implement the DirectKafkaRateController

[ https://issues.apache.org/jira/browse/SPARK-8978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-8978. -- Resolution: Fixed Assignee: Iulian Dragos Implement the DirectKafkaRateController

[jira] [Commented] (SPARK-7550) Support setting the right schema serde when writing to Hive metastore

[ https://issues.apache.org/jira/browse/SPARK-7550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660726#comment-14660726 ] Reynold Xin commented on SPARK-7550: [~lian cheng] shouldn't this also be merged into

[jira] [Created] (SPARK-9702) Repartition operator should use Exchange to perform its shuffle

Josh Rosen created SPARK-9702: - Summary: Repartition operator should use Exchange to perform its shuffle Key: SPARK-9702 URL: https://issues.apache.org/jira/browse/SPARK-9702 Project: Spark

[jira] [Updated] (SPARK-7549) Support aggregating over nested fields

[ https://issues.apache.org/jira/browse/SPARK-7549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7549: --- Parent Issue: SPARK-9576 (was: SPARK-6116) Support aggregating over nested fields

[jira] [Updated] (SPARK-7160) Support converting DataFrames to typed RDDs.

[ https://issues.apache.org/jira/browse/SPARK-7160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7160: --- Parent Issue: SPARK-9576 (was: SPARK-6116) Support converting DataFrames to typed RDDs.

[jira] [Resolved] (SPARK-9493) Chain logistic regression with isotonic regression under the pipeline API

[ https://issues.apache.org/jira/browse/SPARK-9493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-9493. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7952

[jira] [Updated] (SPARK-6116) DataFrame API improvement umbrella ticket (Spark 1.5)

[ https://issues.apache.org/jira/browse/SPARK-6116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6116: --- Description: An umbrella ticket for DataFrame API improvements for Spark 1.5. SPARK-9576 is the

[jira] [Updated] (SPARK-9363) SortMergeJoin operator should support UnsafeRow

[ https://issues.apache.org/jira/browse/SPARK-9363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9363: --- Sprint: Spark 1.5 release SortMergeJoin operator should support UnsafeRow

[jira] [Commented] (SPARK-1517) Publish nightly snapshots of documentation, maven artifacts, and binary builds

[ https://issues.apache.org/jira/browse/SPARK-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660796#comment-14660796 ] Patrick Wendell commented on SPARK-1517: Hey Ryan, IIRC - the Apache snapshot

[jira] [Updated] (SPARK-5180) Data source API improvement

[ https://issues.apache.org/jira/browse/SPARK-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-5180: --- Sprint: Spark 1.5 release Data source API improvement ---

[jira] [Updated] (SPARK-9691) PySpark SQL rand function treats seed 0 as no seed

[ https://issues.apache.org/jira/browse/SPARK-9691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9691: --- Sprint: Spark 1.5 doc/QA sprint PySpark SQL rand function treats seed 0 as no seed

[jira] [Updated] (SPARK-9683) deep copy UTF8String when convert unsafe row to safe row

[ https://issues.apache.org/jira/browse/SPARK-9683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9683: --- Target Version/s: 1.5.0 Priority: Critical (was: Major) deep copy UTF8String when

[jira] [Closed] (SPARK-9675) GenerateUnsafeProjection seems to corrupt MapType data

[ https://issues.apache.org/jira/browse/SPARK-9675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-9675. -- Resolution: Duplicate Fix Version/s: 1.5.0 GenerateUnsafeProjection seems to corrupt MapType

[jira] [Updated] (SPARK-9596) Avoid reloading Hadoop classes like UserGroupInformation

[ https://issues.apache.org/jira/browse/SPARK-9596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9596: Shepherd: Michael Armbrust Avoid reloading Hadoop classes like UserGroupInformation

[jira] [Updated] (SPARK-9665) ML 1.5 QA: API: Experimental, DeveloperApi, final audit

[ https://issues.apache.org/jira/browse/SPARK-9665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9665: - Description: We should make a pass through the items marked as Experimental or

[jira] [Created] (SPARK-9707) Test sort-based fallback mode for dynamic partition insert

Reynold Xin created SPARK-9707: -- Summary: Test sort-based fallback mode for dynamic partition insert Key: SPARK-9707 URL: https://issues.apache.org/jira/browse/SPARK-9707 Project: Spark Issue

[jira] [Updated] (SPARK-9665) ML 1.5 QA: API: Experimental, DeveloperApi, final, sealed audit

[ https://issues.apache.org/jira/browse/SPARK-9665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9665: - Summary: ML 1.5 QA: API: Experimental, DeveloperApi, final, sealed audit (was: ML 1.5

[jira] [Resolved] (SPARK-9211) HiveComparisonTest generates incorrect file name for golden answer files on Windows

[ https://issues.apache.org/jira/browse/SPARK-9211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-9211. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7563

[jira] [Commented] (SPARK-9453) Support records larger than default page size in UnsafeShuffleExternalSorter

[ https://issues.apache.org/jira/browse/SPARK-9453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660830#comment-14660830 ] Apache Spark commented on SPARK-9453: - User 'davies' has created a pull request for

[jira] [Resolved] (SPARK-9624) Make RateControllerSuite faster and more robust

[ https://issues.apache.org/jira/browse/SPARK-9624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-9624. -- Resolution: Fixed Fix Version/s: 1.5.0 Make RateControllerSuite faster and more robust

[jira] [Resolved] (SPARK-9619) Rename Receiver.executor to Receiver.supervisor

[ https://issues.apache.org/jira/browse/SPARK-9619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-9619. -- Resolution: Fixed Fix Version/s: 1.5.0 Rename Receiver.executor to Receiver.supervisor

[jira] [Resolved] (SPARK-9556) Make all BlockGenerators subscribe to rate limit updates

[ https://issues.apache.org/jira/browse/SPARK-9556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-9556. -- Resolution: Fixed Fix Version/s: 1.5.0 Make all BlockGenerators subscribe to rate limit

[jira] [Assigned] (SPARK-9710) RPackageUtilsSuite fails if R is not installer

[ https://issues.apache.org/jira/browse/SPARK-9710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9710: --- Assignee: Apache Spark RPackageUtilsSuite fails if R is not installer

[jira] [Commented] (SPARK-8167) Tasks that fail due to YARN preemption can cause job failure

[ https://issues.apache.org/jira/browse/SPARK-8167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660871#comment-14660871 ] Apache Spark commented on SPARK-8167: - User 'mccheah' has created a pull request for

[jira] [Updated] (SPARK-9710) RPackageUtilsSuite fails if R is not installed

[ https://issues.apache.org/jira/browse/SPARK-9710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-9710: -- Summary: RPackageUtilsSuite fails if R is not installed (was: RPackageUtilsSuite fails if R is

[jira] [Resolved] (SPARK-9630) Cleanup Hybrid Aggregate Operator.

[ https://issues.apache.org/jira/browse/SPARK-9630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9630. Resolution: Fixed Fix Version/s: 1.5.0 Cleanup Hybrid Aggregate Operator.

[jira] [Assigned] (SPARK-8167) Tasks that fail due to YARN preemption can cause job failure

[ https://issues.apache.org/jira/browse/SPARK-8167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8167: --- Assignee: Apache Spark (was: Matt Cheah) Tasks that fail due to YARN preemption can cause

[jira] [Assigned] (SPARK-9710) RPackageUtilsSuite fails if R is not installer

[ https://issues.apache.org/jira/browse/SPARK-9710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9710: --- Assignee: (was: Apache Spark) RPackageUtilsSuite fails if R is not installer

[jira] [Commented] (SPARK-9710) RPackageUtilsSuite fails if R is not installer

[ https://issues.apache.org/jira/browse/SPARK-9710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660870#comment-14660870 ] Apache Spark commented on SPARK-9710: - User 'vanzin' has created a pull request for

[jira] [Assigned] (SPARK-8167) Tasks that fail due to YARN preemption can cause job failure

[ https://issues.apache.org/jira/browse/SPARK-8167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8167: --- Assignee: Matt Cheah (was: Apache Spark) Tasks that fail due to YARN preemption can cause

[jira] [Commented] (SPARK-8890) Reduce memory consumption for dynamic partition insert

[ https://issues.apache.org/jira/browse/SPARK-8890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660893#comment-14660893 ] Apache Spark commented on SPARK-8890: - User 'marmbrus' has created a pull request for

[jira] [Updated] (SPARK-5180) Data source API improvement

[ https://issues.apache.org/jira/browse/SPARK-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-5180: --- Issue Type: Story (was: Umbrella) Data source API improvement ---

[jira] [Updated] (SPARK-9706) List Public API Compatibility Issues with japi-compliance checker

[ https://issues.apache.org/jira/browse/SPARK-9706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-9706: - Attachment: compat_reports.zip List Public API Compatibility Issues with japi-compliance checker

[jira] [Created] (SPARK-9706) Check Public API Compatibility with japi-compliance checker

Feynman Liang created SPARK-9706: Summary: Check Public API Compatibility with japi-compliance checker Key: SPARK-9706 URL: https://issues.apache.org/jira/browse/SPARK-9706 Project: Spark

[jira] [Updated] (SPARK-9706) List Public API Compatibility Issues with japi-compliance checker

[ https://issues.apache.org/jira/browse/SPARK-9706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-9706: - Description: To identify potential API issues, list public API changes which affect binary and

[jira] [Updated] (SPARK-9705) outdated Python 3 and IPython information

[ https://issues.apache.org/jira/browse/SPARK-9705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-9705: -- Target Version/s: 1.4.1, 1.4.0, 1.5.0 (was: 1.4.0, 1.4.1) outdated Python 3 and IPython information

[jira] [Resolved] (SPARK-9639) JobHandler may throw NPE if JobScheduler has been stopped

[ https://issues.apache.org/jira/browse/SPARK-9639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-9639. -- Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 1.5.0 JobHandler may

[jira] [Created] (SPARK-9710) RPackageUtilsSuite fails if R is not installer

Marcelo Vanzin created SPARK-9710: - Summary: RPackageUtilsSuite fails if R is not installer Key: SPARK-9710 URL: https://issues.apache.org/jira/browse/SPARK-9710 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-9709) Avoid starving an unsafe operator in a sort

[ https://issues.apache.org/jira/browse/SPARK-9709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9709: --- Assignee: Andrew Or (was: Apache Spark) Avoid starving an unsafe operator in a sort

[jira] [Updated] (SPARK-7398) Add back-pressure to Spark Streaming (umbrella JIRA)

[ https://issues.apache.org/jira/browse/SPARK-7398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-7398: - Target Version/s: (was: 1.5.0) Add back-pressure to Spark Streaming (umbrella JIRA)

[jira] [Assigned] (SPARK-9703) EnsureRequirements should not add unnecessary shuffles when only ordering requirements are unsatisfied

[ https://issues.apache.org/jira/browse/SPARK-9703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9703: --- Assignee: Josh Rosen (was: Apache Spark) EnsureRequirements should not add unnecessary

[jira] [Updated] (SPARK-9228) Combine unsafe and codegen into a single option

[ https://issues.apache.org/jira/browse/SPARK-9228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9228: --- Sprint: Spark 1.5 release (was: Spark 1.5 doc/QA sprint) Combine unsafe and codegen into a single

[jira] [Updated] (SPARK-9228) Combine unsafe and codegen into a single option

[ https://issues.apache.org/jira/browse/SPARK-9228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9228: --- Sprint: Spark 1.5 doc/QA sprint Combine unsafe and codegen into a single option

[jira] [Commented] (SPARK-9703) EnsureRequirements should not add unnecessary shuffles when only ordering requirements are unsatisfied

[ https://issues.apache.org/jira/browse/SPARK-9703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660743#comment-14660743 ] Apache Spark commented on SPARK-9703: - User 'JoshRosen' has created a pull request for

[jira] [Assigned] (SPARK-9703) EnsureRequirements should not add unnecessary shuffles when only ordering requirements are unsatisfied

[ https://issues.apache.org/jira/browse/SPARK-9703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9703: --- Assignee: Apache Spark (was: Josh Rosen) EnsureRequirements should not add unnecessary

[jira] [Updated] (SPARK-9683) deep copy UTF8String when convert unsafe row to safe row

[ https://issues.apache.org/jira/browse/SPARK-9683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9683: --- Sprint: Spark 1.5 release deep copy UTF8String when convert unsafe row to safe row

[jira] [Updated] (SPARK-9706) List Public API Compatibility Issues with japi-compliance checker

[ https://issues.apache.org/jira/browse/SPARK-9706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-9706: - Description: Using command: {code} japi-compliance-checker spark-mllib_2.10-1.4.2-SNAPSHOT.jar

[jira] [Assigned] (SPARK-6902) Row() object can be mutated even though it should be immutable

[ https://issues.apache.org/jira/browse/SPARK-6902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6902: --- Assignee: Davies Liu (was: Apache Spark) Row() object can be mutated even though it should

[jira] [Assigned] (SPARK-6902) Row() object can be mutated even though it should be immutable

[ https://issues.apache.org/jira/browse/SPARK-6902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6902: --- Assignee: Apache Spark (was: Davies Liu) Row() object can be mutated even though it should

[jira] [Commented] (SPARK-6902) Row() object can be mutated even though it should be immutable

[ https://issues.apache.org/jira/browse/SPARK-6902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660873#comment-14660873 ] Apache Spark commented on SPARK-6902: - User 'davies' has created a pull request for

[jira] [Updated] (SPARK-9211) HiveComparisonTest generates incorrect file name for golden answer files on Windows

[ https://issues.apache.org/jira/browse/SPARK-9211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9211: Assignee: Christian Kadner HiveComparisonTest generates incorrect file name for golden

[jira] [Assigned] (SPARK-9709) Avoid starving an unsafe operator in a sort

[ https://issues.apache.org/jira/browse/SPARK-9709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9709: --- Assignee: Apache Spark (was: Andrew Or) Avoid starving an unsafe operator in a sort

[jira] [Commented] (SPARK-9709) Avoid starving an unsafe operator in a sort

[ https://issues.apache.org/jira/browse/SPARK-9709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660901#comment-14660901 ] Apache Spark commented on SPARK-9709: - User 'andrewor14' has created a pull request

[jira] [Commented] (SPARK-9618) SQLContext.read.schema().parquet() ignores the supplied schema

[ https://issues.apache.org/jira/browse/SPARK-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660734#comment-14660734 ] Reynold Xin commented on SPARK-9618: [~lian cheng] this was not merged into

[jira] [Updated] (SPARK-5180) Data source API improvement

[ https://issues.apache.org/jira/browse/SPARK-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-5180: --- Issue Type: Umbrella (was: Improvement) Data source API improvement ---

[jira] [Updated] (SPARK-5180) Data source API improvement

[ https://issues.apache.org/jira/browse/SPARK-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-5180: --- Target Version/s: 1.5.0 (was: 1.6.0) Data source API improvement ---

[jira] [Created] (SPARK-9705) outdated Python 3 and IPython information

Piotr Migdał created SPARK-9705: --- Summary: outdated Python 3 and IPython information Key: SPARK-9705 URL: https://issues.apache.org/jira/browse/SPARK-9705 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-9704) Make some ML APIs public: VectorUDT, Identifiable, ProbabilisticClassifier

[ https://issues.apache.org/jira/browse/SPARK-9704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9704: --- Assignee: Joseph K. Bradley (was: Apache Spark) Make some ML APIs public: VectorUDT,

[jira] [Commented] (SPARK-9704) Make some ML APIs public: VectorUDT, Identifiable, ProbabilisticClassifier

[ https://issues.apache.org/jira/browse/SPARK-9704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660769#comment-14660769 ] Apache Spark commented on SPARK-9704: - User 'jkbradley' has created a pull request for

[jira] [Updated] (SPARK-9565) Spark SQL 1.5.0 QA/testing umbrella

[ https://issues.apache.org/jira/browse/SPARK-9565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9565: --- Issue Type: Story (was: Test) Spark SQL 1.5.0 QA/testing umbrella

[jira] [Assigned] (SPARK-9704) Make some ML APIs public: VectorUDT, Identifiable, ProbabilisticClassifier

[ https://issues.apache.org/jira/browse/SPARK-9704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9704: --- Assignee: Apache Spark (was: Joseph K. Bradley) Make some ML APIs public: VectorUDT,

[jira] [Commented] (SPARK-9704) Make some ML APIs public: VectorUDT, Identifiable, ProbabilisticClassifier

[ https://issues.apache.org/jira/browse/SPARK-9704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660791#comment-14660791 ] Eron Wright commented on SPARK-9704: - Thanks for accepting the suggestions, and I

[jira] [Created] (SPARK-9709) Avoid starving an unsafe operator in a sort

Andrew Or created SPARK-9709: Summary: Avoid starving an unsafe operator in a sort Key: SPARK-9709 URL: https://issues.apache.org/jira/browse/SPARK-9709 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-9548) BytesToBytesMap could have a destructive iterator

[ https://issues.apache.org/jira/browse/SPARK-9548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9548. Resolution: Fixed Assignee: Liang-Chi Hsieh Fix Version/s: 1.5.0 BytesToBytesMap

[jira] [Commented] (SPARK-4561) PySparkSQL's Row.asDict() should convert nested rows to dictionaries

[ https://issues.apache.org/jira/browse/SPARK-4561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660860#comment-14660860 ] Apache Spark commented on SPARK-4561: - User 'davies' has created a pull request for

[jira] [Resolved] (SPARK-9645) External shuffle service does not work with kerberos on

[ https://issues.apache.org/jira/browse/SPARK-9645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-9645. --- Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 1.5.0 External

[jira] [Assigned] (SPARK-9363) SortMergeJoin operator should support UnsafeRow

[ https://issues.apache.org/jira/browse/SPARK-9363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9363: --- Assignee: Apache Spark (was: Josh Rosen) SortMergeJoin operator should support UnsafeRow

[jira] [Assigned] (SPARK-9363) SortMergeJoin operator should support UnsafeRow

[ https://issues.apache.org/jira/browse/SPARK-9363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9363: --- Assignee: Josh Rosen (was: Apache Spark) SortMergeJoin operator should support UnsafeRow

[jira] [Commented] (SPARK-9363) SortMergeJoin operator should support UnsafeRow

[ https://issues.apache.org/jira/browse/SPARK-9363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660720#comment-14660720 ] Apache Spark commented on SPARK-9363: - User 'JoshRosen' has created a pull request for

[jira] [Updated] (SPARK-9691) PySpark SQL rand function treats seed 0 as no seed

[ https://issues.apache.org/jira/browse/SPARK-9691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9691: --- Sprint: Spark 1.5 release (was: Spark 1.5 doc/QA sprint) PySpark SQL rand function treats seed 0 as

[jira] [Created] (SPARK-9704) Make some ML APIs public: VectorUDT, Identifiable, ProbabilisticClassifier

Joseph K. Bradley created SPARK-9704: Summary: Make some ML APIs public: VectorUDT, Identifiable, ProbabilisticClassifier Key: SPARK-9704 URL: https://issues.apache.org/jira/browse/SPARK-9704

[jira] [Updated] (SPARK-9706) List Public API Compatibility Issues with japi-compliance checker

[ https://issues.apache.org/jira/browse/SPARK-9706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-9706: - Issue Type: Task (was: Bug) List Public API Compatibility Issues with japi-compliance checker

[jira] [Updated] (SPARK-9706) List Public API Compatibility Issues with japi-compliance checker

[ https://issues.apache.org/jira/browse/SPARK-9706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-9706: - Description: Using command: {code} japi-compliance-checker spark-mllib_2.10-1.4.2-SNAPSHOT.jar

[jira] [Updated] (SPARK-9706) List Public API Compatibility Issues with japi-compliance checker

[ https://issues.apache.org/jira/browse/SPARK-9706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-9706: - Description: Using command: {{code}} japi-compliance-checker spark-mllib_2.10-1.4.2-SNAPSHOT.jar

[jira] [Updated] (SPARK-8848) Write Parquet LISTs and MAPs conforming to Parquet format spec

[ https://issues.apache.org/jira/browse/SPARK-8848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8848: Target Version/s: 1.5.0 (was: 1.6.0) Write Parquet LISTs and MAPs conforming to Parquet

[jira] [Commented] (SPARK-9381) Migrate JSON data source to the new partitioning data source

[ https://issues.apache.org/jira/browse/SPARK-9381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660735#comment-14660735 ] Reynold Xin commented on SPARK-9381: This was also not merged into branch-1.5. I

[jira] [Updated] (SPARK-7550) Support setting the right schema serde when writing to Hive metastore

[ https://issues.apache.org/jira/browse/SPARK-7550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7550: --- Fix Version/s: 1.5.0 Support setting the right schema serde when writing to Hive metastore

[jira] [Updated] (SPARK-6923) Spark SQL CLI does not read Data Source schema correctly

[ https://issues.apache.org/jira/browse/SPARK-6923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6923: --- Fix Version/s: 1.5.0 Spark SQL CLI does not read Data Source schema correctly

[jira] [Commented] (SPARK-7550) Support setting the right schema serde when writing to Hive metastore

[ https://issues.apache.org/jira/browse/SPARK-7550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660739#comment-14660739 ] Reynold Xin commented on SPARK-7550: I cherry-picked it into branch-1.5. Support

[jira] [Resolved] (SPARK-9706) List Public API Compatibility Issues with japi-compliance checker

[ https://issues.apache.org/jira/browse/SPARK-9706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang resolved SPARK-9706. -- Resolution: Fixed List Public API Compatibility Issues with japi-compliance checker

[jira] [Updated] (SPARK-9706) List Public API Compatibility Issues with japi-compliance checker

[ https://issues.apache.org/jira/browse/SPARK-9706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-9706: - Summary: List Public API Compatibility Issues with japi-compliance checker (was: Check Public

[jira] [Commented] (SPARK-1517) Publish nightly snapshots of documentation, maven artifacts, and binary builds

[ https://issues.apache.org/jira/browse/SPARK-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660816#comment-14660816 ] Ryan Williams commented on SPARK-1517: -- That all makes sense, thanks. I guess I was

[jira] [Created] (SPARK-9711) spark-submit fails after restarting cluster with spark-ec2

Guangyang Li created SPARK-9711: --- Summary: spark-submit fails after restarting cluster with spark-ec2 Key: SPARK-9711 URL: https://issues.apache.org/jira/browse/SPARK-9711 Project: Spark Issue

[jira] [Updated] (SPARK-9683) deep copy UTF8String when convert unsafe row to safe row

[ https://issues.apache.org/jira/browse/SPARK-9683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-9683: -- Assignee: Wenchen Fan deep copy UTF8String when convert unsafe row to safe row

[jira] [Resolved] (SPARK-9676) Execute GraphX library from R

[ https://issues.apache.org/jira/browse/SPARK-9676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9676. -- Resolution: Invalid Please use u...@spark.apache.org to ask questions. Execute GraphX library from R

[jira] [Created] (SPARK-9685) Unsupported dataType: char(X) in Hive

Ángel Álvarez created SPARK-9685: Summary: Unsupported dataType: char(X) in Hive Key: SPARK-9685 URL: https://issues.apache.org/jira/browse/SPARK-9685 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-9641) spark.shuffle.service.port is not documented

[ https://issues.apache.org/jira/browse/SPARK-9641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9641: --- Assignee: (was: Apache Spark) spark.shuffle.service.port is not documented

[jira] [Resolved] (SPARK-9684) sbt/sbt assembly Error: Invalid or corrupt jarfile sbt/sbt-launch-0.13.6.jar

[ https://issues.apache.org/jira/browse/SPARK-9684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9684. -- Resolution: Duplicate [~prabeeshk] please search JIRA first. Also, you're reporting vs an ancient

[jira] [Commented] (SPARK-9641) spark.shuffle.service.port is not documented

[ https://issues.apache.org/jira/browse/SPARK-9641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14659778#comment-14659778 ] Apache Spark commented on SPARK-9641: - User 'srowen' has created a pull request for

[jira] [Commented] (SPARK-9684) sbt/sbt assembly Error: Invalid or corrupt jarfile sbt/sbt-launch-0.13.6.jar

[ https://issues.apache.org/jira/browse/SPARK-9684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14659779#comment-14659779 ] Prabeesh K commented on SPARK-9684: --- [~pwendell] Please have a look sbt/sbt assembly

[jira] [Assigned] (SPARK-9641) spark.shuffle.service.port is not documented

[ https://issues.apache.org/jira/browse/SPARK-9641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9641: --- Assignee: Apache Spark spark.shuffle.service.port is not documented

[jira] [Commented] (SPARK-9684) sbt/sbt assembly Error: Invalid or corrupt jarfile sbt/sbt-launch-0.13.6.jar

[ https://issues.apache.org/jira/browse/SPARK-9684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14659785#comment-14659785 ] Prabeesh K commented on SPARK-9684: --- It is fixed in the master. But I can't find a

[jira] [Assigned] (SPARK-9681) Support R feature interactions in RFormula

[ https://issues.apache.org/jira/browse/SPARK-9681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9681: --- Assignee: Apache Spark Support R feature interactions in RFormula

[jira] [Created] (SPARK-9683) deep copy UTF8String when convert unsafe row to safe row

Wenchen Fan created SPARK-9683: -- Summary: deep copy UTF8String when convert unsafe row to safe row Key: SPARK-9683 URL: https://issues.apache.org/jira/browse/SPARK-9683 Project: Spark Issue

  1   2   3   4   5   >