Re: Error aliasing an array column.

2016-02-09 Thread Rakesh Chalasani
at >>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >>>> at java.lang.reflect.Method.invoke(Method.java:497) >>>> at >>>> org.apache.spark.repl.SparkIMain$ReadEvalPrint.call(SparkIMain.

Re: Error aliasing an array column.

2016-02-09 Thread Michael Armbrust
supportedOperationException" when trying to alias an >>> array column. The issue seems to be at "CreateArray" expression -> >>> dataType, >>> which checks for nullability of its children, while aliasing is creating

Re: Error aliasing an array column.

2016-02-09 Thread Rakesh Chalasani
IMain.interpret(SparkIMain.scala:819) >> >> On Tue, Feb 9, 2016 at 4:23 PM Ted Yu wrote: >> >>> Do you mind pastebin'ning code snippet and exception one more time - I >>> couldn't see them in your original email. >>> >>> Which Spark re

Re: Error aliasing an array column.

2016-02-09 Thread Ted Yu
at >>> org.apache.spark.repl.SparkIMain$Request.loadAndRun(SparkIMain.scala:1346) >>> at >>> org.apache.spark.repl.SparkIMain.loadAndRunReq$1(SparkIMain.scala:840) >>> at >>> org.apache.spark.repl.SparkIMain.interpret(SparkIMain.sc

Re: Error aliasing an array column.

2016-02-09 Thread Ted Yu
; I am getting an "UnsupportedOperationException" when trying to alias an >>> array column. The issue seems to be at "CreateArray" expression -> >>> dataType, >>> which checks for nullability of its c

Re: Error aliasing an array column.

2016-02-09 Thread Rakesh Chalasani
>> PrettyAttribute that does not implement nullability. >> >> Below is an example to reproduce it. >> >> >> >> this throws the following exception: >> >> >> >> >> -- >> View

Re: Error aliasing an array column.

2016-02-09 Thread Ted Yu
to reproduce it. > > > > this throws the following exception: > > > > > -- > View this message in context: > http://apache-spark-developers-list.1001551.n3.nabble.com/Error-aliasing-an-array-column-t

Error aliasing an array column.

2016-02-09 Thread rakeshchalasani
ullability. Below is an example to reproduce it. this throws the following exception: -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Error-aliasing-an-array-column-tp16288.html Sent from the Apache Spark Developers List mailing lis