[jira] [Assigned] (SPARK-22821) Basic tests for WidenSetOperationTypes, BooleanEquality, StackCoercion and Division
[ https://issues.apache.org/jira/browse/SPARK-22821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22821: Assignee: (was: Apache Spark) > Basic tests for WidenSetOperationTypes, BooleanEquality, StackCoercion and > Division > --- > > Key: SPARK-22821 > URL: https://issues.apache.org/jira/browse/SPARK-22821 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 2.3.0 >Reporter: Yuming Wang > -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-22821) Basic tests for WidenSetOperationTypes, BooleanEquality, StackCoercion and Division
[ https://issues.apache.org/jira/browse/SPARK-22821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16294519#comment-16294519 ] Apache Spark commented on SPARK-22821: -- User 'wangyum' has created a pull request for this issue: https://github.com/apache/spark/pull/20006 > Basic tests for WidenSetOperationTypes, BooleanEquality, StackCoercion and > Division > --- > > Key: SPARK-22821 > URL: https://issues.apache.org/jira/browse/SPARK-22821 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 2.3.0 >Reporter: Yuming Wang > -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-22821) Basic tests for WidenSetOperationTypes, BooleanEquality, StackCoercion and Division
[ https://issues.apache.org/jira/browse/SPARK-22821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22821: Assignee: Apache Spark > Basic tests for WidenSetOperationTypes, BooleanEquality, StackCoercion and > Division > --- > > Key: SPARK-22821 > URL: https://issues.apache.org/jira/browse/SPARK-22821 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 2.3.0 >Reporter: Yuming Wang >Assignee: Apache Spark > -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-22821) Basic tests for WidenSetOperationTypes, BooleanEquality, StackCoercion and Division
Yuming Wang created SPARK-22821: --- Summary: Basic tests for WidenSetOperationTypes, BooleanEquality, StackCoercion and Division Key: SPARK-22821 URL: https://issues.apache.org/jira/browse/SPARK-22821 Project: Spark Issue Type: Sub-task Components: SQL Affects Versions: 2.3.0 Reporter: Yuming Wang -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-22818) csv escape of quote escape
[ https://issues.apache.org/jira/browse/SPARK-22818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22818: Assignee: Apache Spark > csv escape of quote escape > -- > > Key: SPARK-22818 > URL: https://issues.apache.org/jira/browse/SPARK-22818 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 2.2.1 >Reporter: Soonmok Kwon >Assignee: Apache Spark >Priority: Minor > Original Estimate: 24h > Remaining Estimate: 24h > > A DataFrame is stored in CSV format and loaded again. When there's backslash > followed by quotation mark, csv reading seems to make an error. > This issue was raised before in > https://issues.apache.org/jira/browse/SPARK-19834 and postponed due to a bug > in its dependency. Now it is resolved and this issue can be reopened. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-22818) csv escape of quote escape
[ https://issues.apache.org/jira/browse/SPARK-22818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16294434#comment-16294434 ] Apache Spark commented on SPARK-22818: -- User 'ep1804' has created a pull request for this issue: https://github.com/apache/spark/pull/20004 > csv escape of quote escape > -- > > Key: SPARK-22818 > URL: https://issues.apache.org/jira/browse/SPARK-22818 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 2.2.1 >Reporter: Soonmok Kwon >Priority: Minor > Original Estimate: 24h > Remaining Estimate: 24h > > A DataFrame is stored in CSV format and loaded again. When there's backslash > followed by quotation mark, csv reading seems to make an error. > This issue was raised before in > https://issues.apache.org/jira/browse/SPARK-19834 and postponed due to a bug > in its dependency. Now it is resolved and this issue can be reopened. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-22818) csv escape of quote escape
[ https://issues.apache.org/jira/browse/SPARK-22818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22818: Assignee: (was: Apache Spark) > csv escape of quote escape > -- > > Key: SPARK-22818 > URL: https://issues.apache.org/jira/browse/SPARK-22818 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 2.2.1 >Reporter: Soonmok Kwon >Priority: Minor > Original Estimate: 24h > Remaining Estimate: 24h > > A DataFrame is stored in CSV format and loaded again. When there's backslash > followed by quotation mark, csv reading seems to make an error. > This issue was raised before in > https://issues.apache.org/jira/browse/SPARK-19834 and postponed due to a bug > in its dependency. Now it is resolved and this issue can be reopened. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-22820) Spark 2.3 SQL API audit
Xiao Li created SPARK-22820: --- Summary: Spark 2.3 SQL API audit Key: SPARK-22820 URL: https://issues.apache.org/jira/browse/SPARK-22820 Project: Spark Issue Type: Umbrella Components: SQL Affects Versions: 2.3.0 Reporter: Xiao Li Check all the API changes in Spark 2.3 release -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-22816) Basic tests for PromoteStrings and InConversion
[ https://issues.apache.org/jira/browse/SPARK-22816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22816. - Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 2.3.0 > Basic tests for PromoteStrings and InConversion > --- > > Key: SPARK-22816 > URL: https://issues.apache.org/jira/browse/SPARK-22816 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 2.3.0 >Reporter: Yuming Wang >Assignee: Yuming Wang > Fix For: 2.3.0 > > -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-22762) Basic tests for IfCoercion and CaseWhenCoercion
[ https://issues.apache.org/jira/browse/SPARK-22762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22762. - Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 2.3.0 > Basic tests for IfCoercion and CaseWhenCoercion > --- > > Key: SPARK-22762 > URL: https://issues.apache.org/jira/browse/SPARK-22762 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 2.3.0 >Reporter: Yuming Wang >Assignee: Yuming Wang > Fix For: 2.3.0 > > -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-22805) Use aliases for StorageLevel in event logs
[
https://issues.apache.org/jira/browse/SPARK-22805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16294230#comment-16294230
]
Sergei Lebedev commented on SPARK-22805:
It doesn't save much storage if block updates tracking is turned off (default,
starting from 2.3). If it is on, it saves ~50%. What do you think? Should we
kill this ticket?
> Use aliases for StorageLevel in event logs
> --
>
> Key: SPARK-22805
> URL: https://issues.apache.org/jira/browse/SPARK-22805
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
>Affects Versions: 2.1.2, 2.2.1
>Reporter: Sergei Lebedev
>Priority: Minor
>
> Fact 1: {{StorageLevel}} has a private constructor, therefore a list of
> predefined levels is not extendable (by the users).
> Fact 2: The format of event logs uses redundant representation for storage
> levels
> {code}
> >>> len('{"Use Disk": true, "Use Memory": false, "Deserialized": true,
> >>> "Replication": 1}')
> 79
> >>> len('DISK_ONLY')
> 9
> {code}
> Fact 3: This leads to excessive log sizes for workloads with lots of
> partitions, because every partition would have the storage level field which
> is 60-70 bytes more than it should be.
> Suggested quick win: use the names of the predefined levels to identify them
> in the event log.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-22819) Download page - updating package type does nothing
[ https://issues.apache.org/jira/browse/SPARK-22819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22819. --- Resolution: Fixed Assignee: holdenk Fix Version/s: 2.3.0 > Download page - updating package type does nothing > -- > > Key: SPARK-22819 > URL: https://issues.apache.org/jira/browse/SPARK-22819 > Project: Spark > Issue Type: Bug > Components: Documentation >Affects Versions: 2.2.1 >Reporter: Yohann Jardin >Assignee: holdenk > Fix For: 2.3.0 > > > How to reproduce: > Go to the download page: [https://spark.apache.org/downloads.html]. > Update the package type > What happens: > Nothing > What did I expect: > The link to download spark is updated > -- > Inspecting the source code, that drop-down menu calls onPackageSelect() when > a new value is selected. > However downloads.js does not contain that method. Though it contains the > method onVersionSelect(). > -- > I'm not yet familiar with the Spark repository, that's why I'm creating this > jira without a Pull Request. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-19834) csv escape of quote escape (prev)
[ https://issues.apache.org/jira/browse/SPARK-19834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-19834: - Shepherd: (was: Hyukjin Kwon) > csv escape of quote escape (prev) > - > > Key: SPARK-19834 > URL: https://issues.apache.org/jira/browse/SPARK-19834 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 2.1.0 >Reporter: Soonmok Kwon >Priority: Minor > Original Estimate: 4h > Remaining Estimate: 4h > > A DataFrame is stored in CSV format and loaded again. When there's backslash > followed by quotation mark, csv reading seems to make an error. > reference: > http://stackoverflow.com/questions/42607208/spark-csv-error-when-reading-backslash-and-quotation-mark -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-22818) csv escape of quote escape
[ https://issues.apache.org/jira/browse/SPARK-22818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-22818: - External issue URL: (was: https://issues.apache.org/jira/browse/SPARK-19834) > csv escape of quote escape > -- > > Key: SPARK-22818 > URL: https://issues.apache.org/jira/browse/SPARK-22818 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 2.2.1 >Reporter: Soonmok Kwon >Priority: Minor > Original Estimate: 24h > Remaining Estimate: 24h > > A DataFrame is stored in CSV format and loaded again. When there's backslash > followed by quotation mark, csv reading seems to make an error. > This issue was raised before in > https://issues.apache.org/jira/browse/SPARK-19834 and postponed due to a bug > in its dependency. Now it is resolved and this issue can be reopened. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-22818) csv escape of quote escape
[ https://issues.apache.org/jira/browse/SPARK-22818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-22818: - Shepherd: (was: Hyukjin Kwon) > csv escape of quote escape > -- > > Key: SPARK-22818 > URL: https://issues.apache.org/jira/browse/SPARK-22818 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 2.2.1 >Reporter: Soonmok Kwon >Priority: Minor > Original Estimate: 24h > Remaining Estimate: 24h > > A DataFrame is stored in CSV format and loaded again. When there's backslash > followed by quotation mark, csv reading seems to make an error. > This issue was raised before in > https://issues.apache.org/jira/browse/SPARK-19834 and postponed due to a bug > in its dependency. Now it is resolved and this issue can be reopened. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Reopened] (SPARK-22819) Download page - updating package type does nothing
[ https://issues.apache.org/jira/browse/SPARK-22819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-22819: --- No you're correct; actually the latest docs release somehow un-did the fix for the issue in https://github.com/apache/spark-website/pull/75 . It might have been generated before the fix or something and we didn't catch it. I'll re-patch. > Download page - updating package type does nothing > -- > > Key: SPARK-22819 > URL: https://issues.apache.org/jira/browse/SPARK-22819 > Project: Spark > Issue Type: Bug > Components: Documentation >Affects Versions: 2.2.1 >Reporter: Yohann Jardin > > How to reproduce: > Go to the download page: [https://spark.apache.org/downloads.html]. > Update the package type > What happens: > Nothing > What did I expect: > The link to download spark is updated > -- > Inspecting the source code, that drop-down menu calls onPackageSelect() when > a new value is selected. > However downloads.js does not contain that method. Though it contains the > method onVersionSelect(). > -- > I'm not yet familiar with the Spark repository, that's why I'm creating this > jira without a Pull Request. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-20970) Deprecate TaskMetrics._updatedBlockStatuses
[ https://issues.apache.org/jira/browse/SPARK-20970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-20970: -- Target Version/s: 3.0.0 > Deprecate TaskMetrics._updatedBlockStatuses > --- > > Key: SPARK-20970 > URL: https://issues.apache.org/jira/browse/SPARK-20970 > Project: Spark > Issue Type: Improvement > Components: Spark Core >Affects Versions: 2.2.0 >Reporter: Thomas Graves > > TaskMetrics._updatedBlockStatuses isn't used anywhere internally by spark. It > could be used by users though since its exposed by SparkListenerTaskEnd. We > made it configurable to turn off the tracking of it since it uses a lot of > memory in https://issues.apache.org/jira/browse/SPARK-20923. That config is > still true for backwards compatibility. We should turn that to false in next > release and deprecate that api altogether. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-22805) Use aliases for StorageLevel in event logs
[
https://issues.apache.org/jira/browse/SPARK-22805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16294197#comment-16294197
]
Sean Owen commented on SPARK-22805:
---
OK, are you saying this doesn't save much storage? if not, may not be worth
changing the format.
> Use aliases for StorageLevel in event logs
> --
>
> Key: SPARK-22805
> URL: https://issues.apache.org/jira/browse/SPARK-22805
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
>Affects Versions: 2.1.2, 2.2.1
>Reporter: Sergei Lebedev
>Priority: Minor
>
> Fact 1: {{StorageLevel}} has a private constructor, therefore a list of
> predefined levels is not extendable (by the users).
> Fact 2: The format of event logs uses redundant representation for storage
> levels
> {code}
> >>> len('{"Use Disk": true, "Use Memory": false, "Deserialized": true,
> >>> "Replication": 1}')
> 79
> >>> len('DISK_ONLY')
> 9
> {code}
> Fact 3: This leads to excessive log sizes for workloads with lots of
> partitions, because every partition would have the storage level field which
> is 60-70 bytes more than it should be.
> Suggested quick win: use the names of the predefined levels to identify them
> in the event log.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-22819) Download page - updating package type does nothing
[ https://issues.apache.org/jira/browse/SPARK-22819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yohann Jardin resolved SPARK-22819. --- Resolution: Duplicate > Download page - updating package type does nothing > -- > > Key: SPARK-22819 > URL: https://issues.apache.org/jira/browse/SPARK-22819 > Project: Spark > Issue Type: Bug > Components: Documentation >Affects Versions: 2.2.1 >Reporter: Yohann Jardin > > How to reproduce: > Go to the download page: [https://spark.apache.org/downloads.html]. > Update the package type > What happens: > Nothing > What did I expect: > The link to download spark is updated > -- > Inspecting the source code, that drop-down menu calls onPackageSelect() when > a new value is selected. > However downloads.js does not contain that method. Though it contains the > method onVersionSelect(). > -- > I'm not yet familiar with the Spark repository, that's why I'm creating this > jira without a Pull Request. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-22819) Download page - updating package type does nothing
[ https://issues.apache.org/jira/browse/SPARK-22819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16294177#comment-16294177 ] Yohann Jardin commented on SPARK-22819: --- I initially searched for JIRA in the backlog only. After looking for the downloads.js file and its history, I ended up on https://issues.apache.org/jira/browse/SPARK-22525 Sry for the duplicate jira. > Download page - updating package type does nothing > -- > > Key: SPARK-22819 > URL: https://issues.apache.org/jira/browse/SPARK-22819 > Project: Spark > Issue Type: Bug > Components: Documentation >Affects Versions: 2.2.1 >Reporter: Yohann Jardin > > How to reproduce: > Go to the download page: [https://spark.apache.org/downloads.html]. > Update the package type > What happens: > Nothing > What did I expect: > The link to download spark is updated > -- > Inspecting the source code, that drop-down menu calls onPackageSelect() when > a new value is selected. > However downloads.js does not contain that method. Though it contains the > method onVersionSelect(). > -- > I'm not yet familiar with the Spark repository, that's why I'm creating this > jira without a Pull Request. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-22819) Download page - updating package type does nothing
[ https://issues.apache.org/jira/browse/SPARK-22819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yohann Jardin updated SPARK-22819: -- Description: How to reproduce: Go to the download page: [https://spark.apache.org/downloads.html]. Update the package type What happens: Nothing What did I expect: The link to download spark is updated -- Inspecting the source code, that drop-down menu calls onPackageSelect() when a new value is selected. However downloads.js does not contain that method. Though it contains the method onVersionSelect(). -- I'm not yet familiar with the Spark repository, that's why I'm creating this jira without a Pull Request. was: How to reproduce: Go to the download page: [https://spark.apache.org/downloads.html]. Update the package type What happens: Nothing What did I expected: The link to download spark is updated -- Inspecting the source code, that dropdown menu calls onPackageSelect() when a new value is selected. However downloads.js does not contain that method. Though it contains the method onVersionSelect(). -- I'm not yet familiar with Spark repository, that's why I'm creating this jira without a Pull Request. > Download page - updating package type does nothing > -- > > Key: SPARK-22819 > URL: https://issues.apache.org/jira/browse/SPARK-22819 > Project: Spark > Issue Type: Bug > Components: Documentation >Affects Versions: 2.2.1 >Reporter: Yohann Jardin > > How to reproduce: > Go to the download page: [https://spark.apache.org/downloads.html]. > Update the package type > What happens: > Nothing > What did I expect: > The link to download spark is updated > -- > Inspecting the source code, that drop-down menu calls onPackageSelect() when > a new value is selected. > However downloads.js does not contain that method. Though it contains the > method onVersionSelect(). > -- > I'm not yet familiar with the Spark repository, that's why I'm creating this > jira without a Pull Request. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-22819) Download page - updating package type does nothing
Yohann Jardin created SPARK-22819: - Summary: Download page - updating package type does nothing Key: SPARK-22819 URL: https://issues.apache.org/jira/browse/SPARK-22819 Project: Spark Issue Type: Bug Components: Documentation Affects Versions: 2.2.1 Reporter: Yohann Jardin How to reproduce: Go to the download page: [https://spark.apache.org/downloads.html]. Update the package type What happens: Nothing What did I expected: The link to download spark is updated -- Inspecting the source code, that dropdown menu calls onPackageSelect() when a new value is selected. However downloads.js does not contain that method. Though it contains the method onVersionSelect(). -- I'm not yet familiar with Spark repository, that's why I'm creating this jira without a Pull Request. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Comment Edited] (SPARK-19834) csv escape of quote escape (prev)
[ https://issues.apache.org/jira/browse/SPARK-19834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16294077#comment-16294077 ] Soonmok Kwon edited comment on SPARK-19834 at 12/17/17 10:57 AM: - Now, Spark uses univocity-parser 2.5.9. I reopen this issue: https://issues.apache.org/jira/browse/SPARK-22818 was (Author: ep1804): Now, Spark uses univocity-parser 2.5.9. I reopen this issue and the pull request: https://github.com/apache/spark/pull/17177 > csv escape of quote escape (prev) > - > > Key: SPARK-19834 > URL: https://issues.apache.org/jira/browse/SPARK-19834 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 2.1.0 >Reporter: Soonmok Kwon >Priority: Minor > Original Estimate: 4h > Remaining Estimate: 4h > > A DataFrame is stored in CSV format and loaded again. When there's backslash > followed by quotation mark, csv reading seems to make an error. > reference: > http://stackoverflow.com/questions/42607208/spark-csv-error-when-reading-backslash-and-quotation-mark -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-22818) csv escape of quote escape
[ https://issues.apache.org/jira/browse/SPARK-22818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Soonmok Kwon updated SPARK-22818: - External issue URL: https://issues.apache.org/jira/browse/SPARK-19834 > csv escape of quote escape > -- > > Key: SPARK-22818 > URL: https://issues.apache.org/jira/browse/SPARK-22818 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 2.2.1 >Reporter: Soonmok Kwon >Priority: Minor > Original Estimate: 24h > Remaining Estimate: 24h > > A DataFrame is stored in CSV format and loaded again. When there's backslash > followed by quotation mark, csv reading seems to make an error. > This issue was raised before in > https://issues.apache.org/jira/browse/SPARK-19834 and postponed due to a bug > in its dependency. Now it is resolved and this issue can be reopened. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-22818) csv escape of quote escape
Soonmok Kwon created SPARK-22818: Summary: csv escape of quote escape Key: SPARK-22818 URL: https://issues.apache.org/jira/browse/SPARK-22818 Project: Spark Issue Type: Bug Components: SQL Affects Versions: 2.2.1 Reporter: Soonmok Kwon Priority: Minor A DataFrame is stored in CSV format and loaded again. When there's backslash followed by quotation mark, csv reading seems to make an error. This issue was raised before in https://issues.apache.org/jira/browse/SPARK-19834 and postponed due to a bug in its dependency. Now it is resolved and this issue can be reopened. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-19834) csv escape of quote escape (prev)
[ https://issues.apache.org/jira/browse/SPARK-19834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Soonmok Kwon updated SPARK-19834: - Summary: csv escape of quote escape (prev) (was: csv escape of quote escape) > csv escape of quote escape (prev) > - > > Key: SPARK-19834 > URL: https://issues.apache.org/jira/browse/SPARK-19834 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 2.1.0 >Reporter: Soonmok Kwon >Priority: Minor > Original Estimate: 4h > Remaining Estimate: 4h > > A DataFrame is stored in CSV format and loaded again. When there's backslash > followed by quotation mark, csv reading seems to make an error. > reference: > http://stackoverflow.com/questions/42607208/spark-csv-error-when-reading-backslash-and-quotation-mark -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-19834) csv escape of quote escape
[ https://issues.apache.org/jira/browse/SPARK-19834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16294077#comment-16294077 ] Soonmok Kwon commented on SPARK-19834: -- Now, Spark uses univocity-parser 2.5.9. I reopen this issue and the pull request: https://github.com/apache/spark/pull/17177 > csv escape of quote escape > -- > > Key: SPARK-19834 > URL: https://issues.apache.org/jira/browse/SPARK-19834 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 2.1.0 >Reporter: Soonmok Kwon >Priority: Minor > Original Estimate: 4h > Remaining Estimate: 4h > > A DataFrame is stored in CSV format and loaded again. When there's backslash > followed by quotation mark, csv reading seems to make an error. > reference: > http://stackoverflow.com/questions/42607208/spark-csv-error-when-reading-backslash-and-quotation-mark -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
