[jira] [Comment Edited] (SPARK-23715) from_utc_timestamp returns incorrect results for some UTC date/time values

[ https://issues.apache.org/jira/browse/SPARK-23715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16457893#comment-16457893 ] Hyukjin Kwon edited comment on SPARK-23715 at 4/29/18 3:31 AM:

[jira] [Resolved] (SPARK-23724) Custom record separator for jsons in charsets different from UTF-8

[ https://issues.apache.org/jira/browse/SPARK-23724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-23724. -- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 20937 [https://git

[jira] [Assigned] (SPARK-23723) New charset option for json datasource

[ https://issues.apache.org/jira/browse/SPARK-23723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-23723: Assignee: Maxim Gekk > New charset option for json datasource > --

[jira] [Assigned] (SPARK-23094) Json Readers choose wrong encoding when bad records are present and fail

[ https://issues.apache.org/jira/browse/SPARK-23094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-23094: Assignee: Maxim Gekk (was: Burak Yavuz) > Json Readers choose wrong encoding when bad rec

[jira] [Resolved] (SPARK-23723) New charset option for json datasource

[ https://issues.apache.org/jira/browse/SPARK-23723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-23723. -- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 20937 [https://git

[jira] [Assigned] (SPARK-23724) Custom record separator for jsons in charsets different from UTF-8

[ https://issues.apache.org/jira/browse/SPARK-23724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-23724: Assignee: Maxim Gekk > Custom record separator for jsons in charsets different from UTF-8

[jira] [Resolved] (SPARK-23094) Json Readers choose wrong encoding when bad records are present and fail

[ https://issues.apache.org/jira/browse/SPARK-23094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-23094. -- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 20937 [https://git

[jira] [Commented] (SPARK-23715) from_utc_timestamp returns incorrect results for some UTC date/time values

[ https://issues.apache.org/jira/browse/SPARK-23715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16457896#comment-16457896 ] Bruce Robbins commented on SPARK-23715: --- [~hyukjin.kwon] Yes, I also built from sou

[jira] [Commented] (SPARK-23715) from_utc_timestamp returns incorrect results for some UTC date/time values

[ https://issues.apache.org/jira/browse/SPARK-23715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16457894#comment-16457894 ] Hyukjin Kwon commented on SPARK-23715: -- Right, I agree with the PR approach. I just

[jira] [Commented] (SPARK-23715) from_utc_timestamp returns incorrect results for some UTC date/time values

[ https://issues.apache.org/jira/browse/SPARK-23715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16457893#comment-16457893 ] Hyukjin Kwon commented on SPARK-23715: -- I already built Hive from source. I did this

[jira] [Commented] (SPARK-23715) from_utc_timestamp returns incorrect results for some UTC date/time values

[ https://issues.apache.org/jira/browse/SPARK-23715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16457892#comment-16457892 ] Bruce Robbins commented on SPARK-23715: --- Still, I filed an Jira with Hive so they w

[jira] [Commented] (SPARK-23715) from_utc_timestamp returns incorrect results for some UTC date/time values

[ https://issues.apache.org/jira/browse/SPARK-23715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16457888#comment-16457888 ] Wenchen Fan commented on SPARK-23715: - `from_utc_timestamp` is also in some tradition

[jira] [Commented] (SPARK-22938) Assert that SQLConf.get is accessed only on the driver.

[ https://issues.apache.org/jira/browse/SPARK-22938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16457879#comment-16457879 ] Apache Spark commented on SPARK-22938: -- User 'cloud-fan' has created a pull request

[jira] [Commented] (SPARK-23715) from_utc_timestamp returns incorrect results for some UTC date/time values

[ https://issues.apache.org/jira/browse/SPARK-23715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16457874#comment-16457874 ] Bruce Robbins commented on SPARK-23715: --- I might understand what's going on with Hi

[jira] [Commented] (SPARK-23715) from_utc_timestamp returns incorrect results for some UTC date/time values

[ https://issues.apache.org/jira/browse/SPARK-23715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16457754#comment-16457754 ] Bruce Robbins commented on SPARK-23715: --- I just downloaded and installed hive-2.3.3

[jira] [Commented] (SPARK-23715) from_utc_timestamp returns incorrect results for some UTC date/time values

[ https://issues.apache.org/jira/browse/SPARK-23715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16457674#comment-16457674 ] Bruce Robbins commented on SPARK-23715: --- Could be this: HIVE-14412 > from_utc_time

[jira] [Commented] (SPARK-23715) from_utc_timestamp returns incorrect results for some UTC date/time values

[ https://issues.apache.org/jira/browse/SPARK-23715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16457669#comment-16457669 ] Hyukjin Kwon commented on SPARK-23715: -- Yea but was just wondering what behaviour Hi

[jira] [Commented] (SPARK-23715) from_utc_timestamp returns incorrect results for some UTC date/time values

[ https://issues.apache.org/jira/browse/SPARK-23715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16457665#comment-16457665 ] Bruce Robbins commented on SPARK-23715: --- {quote}Which version did you use?{quote}

[jira] [Commented] (SPARK-23715) from_utc_timestamp returns incorrect results for some UTC date/time values

[ https://issues.apache.org/jira/browse/SPARK-23715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16457658#comment-16457658 ] Hyukjin Kwon commented on SPARK-23715: -- I used the (almost) latest build one. Will d

[jira] [Commented] (SPARK-23715) from_utc_timestamp returns incorrect results for some UTC date/time values

[ https://issues.apache.org/jira/browse/SPARK-23715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16457657#comment-16457657 ] Bruce Robbins commented on SPARK-23715: --- Maybe a configuration setting or differenc

[jira] [Updated] (SPARK-23171) Reduce the time costs of the rule runs that do not change the plans

[ https://issues.apache.org/jira/browse/SPARK-23171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Teng Peng updated SPARK-23171: -- Issue Type: Improvement (was: Umbrella) > Reduce the time costs of the rule runs that do not change th

[jira] [Updated] (SPARK-23171) Reduce the time costs of the rule runs that do not change the plans

[ https://issues.apache.org/jira/browse/SPARK-23171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Teng Peng updated SPARK-23171: -- Issue Type: Umbrella (was: Improvement) > Reduce the time costs of the rule runs that do not change th

[jira] [Commented] (SPARK-23715) from_utc_timestamp returns incorrect results for some UTC date/time values

[ https://issues.apache.org/jira/browse/SPARK-23715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16457604#comment-16457604 ] Hyukjin Kwon commented on SPARK-23715: -- [~bersprockets], mind if I ask to clarify

[jira] [Commented] (SPARK-24117) Unified the getSizePerRow

[ https://issues.apache.org/jira/browse/SPARK-24117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16457549#comment-16457549 ] Apache Spark commented on SPARK-24117: -- User 'wangyum' has created a pull request fo

[jira] [Assigned] (SPARK-24117) Unified the getSizePerRow

[ https://issues.apache.org/jira/browse/SPARK-24117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24117: Assignee: (was: Apache Spark) > Unified the getSizePerRow > -

[jira] [Assigned] (SPARK-24117) Unified the getSizePerRow

[ https://issues.apache.org/jira/browse/SPARK-24117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24117: Assignee: Apache Spark > Unified the getSizePerRow > - > >

[jira] [Created] (SPARK-24117) Unified the getSizePerRow

Yuming Wang created SPARK-24117: --- Summary: Unified the getSizePerRow Key: SPARK-24117 URL: https://issues.apache.org/jira/browse/SPARK-24117 Project: Spark Issue Type: Improvement Com

[jira] [Commented] (SPARK-24046) Rate Source doesn't gradually increase rate when rampUpTime>=RowsPerSecond

[ https://issues.apache.org/jira/browse/SPARK-24046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16457430#comment-16457430 ] Apache Spark commented on SPARK-24046: -- User 'jerryshao' has created a pull request

[jira] [Assigned] (SPARK-24046) Rate Source doesn't gradually increase rate when rampUpTime>=RowsPerSecond

[ https://issues.apache.org/jira/browse/SPARK-24046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24046: Assignee: (was: Apache Spark) > Rate Source doesn't gradually increase rate when rampU

[jira] [Assigned] (SPARK-24046) Rate Source doesn't gradually increase rate when rampUpTime>=RowsPerSecond

[ https://issues.apache.org/jira/browse/SPARK-24046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24046: Assignee: Apache Spark > Rate Source doesn't gradually increase rate when rampUpTime>=Rows