Andy Grove created SPARK-12932:
----------------------------------
Summary: Cannot convert list of simple Java objects to Dataset (no
encoder found)
Key: SPARK-12932
URL: https://issues.apache.org/jira/browse/SPARK-12932
Project: Spark
Issue Type: Bug
Components: Java API
Affects Versions: 1.6.0
Environment: Ubuntu 15.10 / Java 8
Reporter: Andy Grove
When trying to create a Dataset from an RDD of Person (all using the Java API),
I get the error "java.lang.UnsupportedOperationException: no encoder found for
example_java.dataset.Person".
{code:title=Example.java}
public class JavaDatasetExample {
public static void main(String[] args) throws Exception {
SparkConf sparkConf = new SparkConf()
.setAppName("Example")
.setMaster("local[*]");
JavaSparkContext sc = new JavaSparkContext(sparkConf);
SQLContext sqlContext = new SQLContext(sc);
List<Person> people = ImmutableList.of(
new Person("Joe", "Bloggs", 21, "NY")
);
Dataset<Person> dataset = sqlContext.createDataset(people,
Encoders.bean(Person.class));
{code}
{code:Person.java}
class Person implements Serializable {
String first;
String last;
int age;
String state;
public Person() {
}
public Person(String first, String last, int age, String state) {
this.first = first;
this.last = last;
this.age = age;
this.state = state;
}
public String getFirst() {
return first;
}
public String getLast() {
return last;
}
public int getAge() {
return age;
}
public String getState() {
return state;
}
}
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
