[ https://issues.apache.org/jira/browse/LIVY-569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964538#comment-16964538 ]
Yiheng Wang commented on LIVY-569: ---------------------------------- >From the comments of the stack overflow question, it looks like it's related >with AWS EMR Livy. Are you also using the AWS EMR livy? > BinaryClassificationMetrics give AttributeError > ----------------------------------------------- > > Key: LIVY-569 > URL: https://issues.apache.org/jira/browse/LIVY-569 > Project: Livy > Issue Type: Bug > Reporter: Fred de Gier > Priority: Major > > When using the BinaryClassificationMetrics there is an error, possible > related to conversion of data types. This only occurs when using Sparkmagic > and Livy. > *Input:* > {code:java} > from pyspark import SparkContext > from pyspark.sql import SparkSession > import pyspark > from pyspark.mllib.evaluation import BinaryClassificationMetrics > a = sc.parallelize([ > (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), > (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), > (0.0, 1.0), (0.0, 1.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), > (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), > (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0) > ]) > metrics = BinaryClassificationMetrics(a) > {code} > > *Output:* > {code:java} > 'StructField' object has no attribute '_get_object_id' {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)