[ https://issues.apache.org/jira/browse/LIVY-569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16970542#comment-16970542 ]
Venkatesh Avula edited comment on LIVY-569 at 11/8/19 7:41 PM: --------------------------------------------------------------- I agree with [~fdegier], I too use Hortonworks Livy and face the same error. I do not think this is specific to AWS EMR. > BinaryClassificationMetrics give AttributeError > ----------------------------------------------- > > Key: LIVY-569 > URL: https://issues.apache.org/jira/browse/LIVY-569 > Project: Livy > Issue Type: Bug > Reporter: Fred de Gier > Priority: Major > > When using the BinaryClassificationMetrics there is an error, possible > related to conversion of data types. This only occurs when using Sparkmagic > and Livy. > *Input:* > {code:java} > from pyspark import SparkContext > from pyspark.sql import SparkSession > import pyspark > from pyspark.mllib.evaluation import BinaryClassificationMetrics > a = sc.parallelize([ > (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), > (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), > (0.0, 1.0), (0.0, 1.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), > (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), > (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0) > ]) > metrics = BinaryClassificationMetrics(a) > {code} > > *Output:* > {code:java} > 'StructField' object has no attribute '_get_object_id' {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)