[ https://issues.apache.org/jira/browse/LIVY-569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16969199#comment-16969199 ]
Xin Pang commented on LIVY-569: ------------------------------- Hi there, I am using AWS EMR Livy to do something similar as the code shown above, and I encountered the same issue. Could you advise on when this will be solved? Thank you! The version I have is emr-5.22.0, Spark 2.4.0 > BinaryClassificationMetrics give AttributeError > ----------------------------------------------- > > Key: LIVY-569 > URL: https://issues.apache.org/jira/browse/LIVY-569 > Project: Livy > Issue Type: Bug > Reporter: Fred de Gier > Priority: Major > > When using the BinaryClassificationMetrics there is an error, possible > related to conversion of data types. This only occurs when using Sparkmagic > and Livy. > *Input:* > {code:java} > from pyspark import SparkContext > from pyspark.sql import SparkSession > import pyspark > from pyspark.mllib.evaluation import BinaryClassificationMetrics > a = sc.parallelize([ > (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), > (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), > (0.0, 1.0), (0.0, 1.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), > (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), > (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0) > ]) > metrics = BinaryClassificationMetrics(a) > {code} > > *Output:* > {code:java} > 'StructField' object has no attribute '_get_object_id' {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)