Prabhu Joseph created ZEPPELIN-1759:
---------------------------------------
Summary: Zeppelin NoteBook Error logs are truncated
Key: ZEPPELIN-1759
URL: https://issues.apache.org/jira/browse/ZEPPELIN-1759
Project: Zeppelin
Issue Type: Bug
Components: Core
Affects Versions: 0.6.2
Reporter: Prabhu Joseph
Attachments: TruncatedErrorMessage.png, TruncatedErrorMessage_1.png
Error thrown from Spark Sql interpreter is truncated on Zeppelin NoteBook. For
example: Below Spark program which tries to access people1.txt from hdfs /tmp
which is not present will fail and error message will be thrown. Top of the
error message is truncated.
{code}
%spark
val people = sc.textFile("hdfs:///tmp/people1.txt")
val schemaString = "name age"
import org.apache.spark.sql.Row;
import org.apache.spark.sql.types.{StructType,StructField,StringType};
val schema =StructType(schemaString.split(" ").map(fieldName =>
StructField(fieldName, StringType, true)))
val rowRDD = people.map(_.split(",")).map(p => Row(p(0), p(1).trim))
val peopleDataFrame = sqlContext.createDataFrame(rowRDD, schema)
peopleDataFrame.registerTempTable("people")
val results = sqlContext.sql("SELECT name FROM people")
results.map(t => "Name: " + t(0)).collect().foreach(println)
{code}
Truncated Error Message is attached. On removing some blank lines from the
paragraph, the error message is shown like the attached image full error
message.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
