[jira] (SPARK-19406) Function to_json ignores the user-provided options

2017-01-30 Thread Xiao Li (JIRA)
Title: Message Title
 
 
 
 
 
 
 
 
 
 
  
 
 Xiao Li resolved as Fixed 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 Spark /  SPARK-19406 
 
 
 
  Function to_json ignores the user-provided options  
 
 
 
 
 
 
 
 
 

Change By:
 
 Xiao Li 
 
 
 

Resolution:
 
 Fixed 
 
 
 

Fix Version/s:
 
 2.2.0 
 
 
 

Fix Version/s:
 
 2.1.1 
 
 
 

Status:
 
 In Progress Resolved 
 
 
 
 
 
 
 
 
 
 
 
 

 
 Add Comment 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 

 This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d) 
 
 
 
 
  
 
 
 
 
 
 
 
 
   



[jira] (SPARK-19406) Function to_json ignores the user-provided options

2017-01-30 Thread Apache Spark (JIRA)
Title: Message Title
 
 
 
 
 
 
 
 
 
 
  
 
 Apache Spark commented on  SPARK-19406 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
  Re: Function to_json ignores the user-provided options  
 
 
 
 
 
 
 
 
 
 
User 'gatorsmile' has created a pull request for this issue: https://github.com/apache/spark/pull/16745 
 
 
 
 
 
 
 
 
 
 
 
 

 
 Add Comment 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 

 This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d) 
 
 
 
 
  
 
 
 
 
 
 
 
 
   



[jira] (SPARK-19406) Function to_json ignores the user-provided options

2017-01-30 Thread Apache Spark (JIRA)
Title: Message Title
 
 
 
 
 
 
 
 
 
 
  
 
 Apache Spark assigned an issue to Apache Spark 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 Spark /  SPARK-19406 
 
 
 
  Function to_json ignores the user-provided options  
 
 
 
 
 
 
 
 
 

Change By:
 
 Apache Spark 
 
 
 

Assignee:
 
 Xiao Li Apache Spark 
 
 
 
 
 
 
 
 
 
 
 
 

 
 Add Comment 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 

 This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d) 
 
 
 
 
  
 
 
 
 
 
 
 
 
   



[jira] (SPARK-19406) Function to_json ignores the user-provided options

2017-01-30 Thread Apache Spark (JIRA)
Title: Message Title
 
 
 
 
 
 
 
 
 
 
  
 
 Apache Spark assigned an issue to Xiao Li 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 Spark /  SPARK-19406 
 
 
 
  Function to_json ignores the user-provided options  
 
 
 
 
 
 
 
 
 

Change By:
 
 Apache Spark 
 
 
 

Assignee:
 
 Apache Spark Xiao Li 
 
 
 
 
 
 
 
 
 
 
 
 

 
 Add Comment 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 

 This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d) 
 
 
 
 
  
 
 
 
 
 
 
 
 
   



[jira] (SPARK-19406) Function to_json ignores the user-provided options

2017-01-30 Thread Xiao Li (JIRA)
Title: Message Title
 
 
 
 
 
 
 
 
 
 
  
 
 Xiao Li updated an issue 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 Spark /  SPARK-19406 
 
 
 
  Function to_json ignores the user-provided options  
 
 
 
 
 
 
 
 
 

Change By:
 
 Xiao Li 
 
 
 
 
 
 
 
 
 
 {noformat} val df = Seq(Tuple1(Tuple1(java.sql.Timestamp.valueOf("2015-08-26 18:00:00.0".toDF("a")val options = Map("timestampFormat" -> "dd/MM/ HH:mm")df.select(to_json($"a", options)).show(false) {noformat}  The current output is like{noformat} +--+|structtojson(a)   |+--+|{"_1":"2015-08-26T18:00:00.000-07:00"}|+--+ {noformat}The expected output should be like{noformat} +-+|structtojson(a)  |+-+|{"_1":"26/08/2015 18:00"}|+-+ {noformat} 
 
 
 
 
 
 
 
 
 
 
 
 

 
 Add Comment 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 

 This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d) 
 
 
 
 
  
 
 
 
 
 
 
 
 
   



[jira] (SPARK-19406) Function to_json ignores the user-provided options

2017-01-30 Thread Xiao Li (JIRA)
Title: Message Title
 
 
 
 
 
 
 
 
 
 
  
 
 Xiao Li created an issue 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 Spark /  SPARK-19406 
 
 
 
  Function to_json ignores the user-provided options  
 
 
 
 
 
 
 
 
 

Issue Type:
 
  Bug 
 
 
 

Affects Versions:
 

 2.1.0 
 
 
 

Assignee:
 

 Unassigned 
 
 
 

Components:
 

 SQL 
 
 
 

Created:
 

 30/Jan/17 21:43 
 
 
 

Priority:
 
  Major 
 
 
 

Reporter:
 
 Xiao Li 
 
 
 
 
 
 
 
 
 
 
val df = Seq(Tuple1(Tuple1(java.sql.Timestamp.valueOf("2015-08-26 18:00:00.0".toDF("a") val options = Map("timestampFormat" -> "dd/MM/ HH:mm") df.select(to_json($"a", options)).show(false) 


--
 

 
 

structtojson(a) 
 
 

 


--

[jira] (SPARK-19406) Function to_json ignores the user-provided options

2017-01-30 Thread Xiao Li (JIRA)
Title: Message Title
 
 
 
 
 
 
 
 
 
 
  
 
 Xiao Li assigned an issue to Xiao Li 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 Spark /  SPARK-19406 
 
 
 
  Function to_json ignores the user-provided options  
 
 
 
 
 
 
 
 
 

Change By:
 
 Xiao Li 
 
 
 

Assignee:
 
 Xiao Li 
 
 
 
 
 
 
 
 
 
 
 
 

 
 Add Comment 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 

 This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)