What happened to the Row class in 1.3.0?
I am trying to call Row.create(object[]) similarly to what's shown in this programming guide https://spark.apache.org/docs/latest/sql-programming-guide.html#programmatically-specifying-the-schema , but the create() method is no longer recognized. I tried to look up the documentation for the Row api, but it does not seem to exist: http://people.apache.org/~pwendell/spark-1.3.0-snapshot1-docs/api/scala/index.html#org.apache.spark.sql.api.java.Row Is there a new equivalent for doing this programmatic specification of schema in 1.3.0? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/What-happened-to-the-Row-class-in-1-3-0-tp22389.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
Re: What happened to the Row class in 1.3.0?
From scaladoc of sql/catalyst/src/main/scala/org/apache/spark/sql/Row.scala : * To create a new Row, use [[RowFactory.create()]] in Java or [[Row.apply()]] in Scala. * Cheers On Mon, Apr 6, 2015 at 7:23 AM, ARose ashley.r...@telarix.com wrote: I am trying to call Row.create(object[]) similarly to what's shown in this programming guide https://spark.apache.org/docs/latest/sql-programming-guide.html#programmatically-specifying-the-schema , but the create() method is no longer recognized. I tried to look up the documentation for the Row api, but it does not seem to exist: http://people.apache.org/~pwendell/spark-1.3.0-snapshot1-docs/api/scala/index.html#org.apache.spark.sql.api.java.Row Is there a new equivalent for doing this programmatic specification of schema in 1.3.0? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/What-happened-to-the-Row-class-in-1-3-0-tp22389.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
Re: What happened to the Row class in 1.3.0?
I searched code base but didn't find RowFactory class. Pardon me. On Mon, Apr 6, 2015 at 7:39 AM, Ted Yu yuzhih...@gmail.com wrote: From scaladoc of sql/catalyst/src/main/scala/org/apache/spark/sql/Row.scala : * To create a new Row, use [[RowFactory.create()]] in Java or [[Row.apply()]] in Scala. * Cheers On Mon, Apr 6, 2015 at 7:23 AM, ARose ashley.r...@telarix.com wrote: I am trying to call Row.create(object[]) similarly to what's shown in this programming guide https://spark.apache.org/docs/latest/sql-programming-guide.html#programmatically-specifying-the-schema , but the create() method is no longer recognized. I tried to look up the documentation for the Row api, but it does not seem to exist: http://people.apache.org/~pwendell/spark-1.3.0-snapshot1-docs/api/scala/index.html#org.apache.spark.sql.api.java.Row Is there a new equivalent for doing this programmatic specification of schema in 1.3.0? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/What-happened-to-the-Row-class-in-1-3-0-tp22389.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
Re: What happened to the Row class in 1.3.0?
Row class was not documented mistakenly in 1.3.0 you can check the 1.3.1 API doc http://people.apache.org/~pwendell/spark-1.3.1-rc1-docs/api/scala/index.html#org.apache.spark.sql.Row Best, -- Nan Zhu http://codingcat.me On Monday, April 6, 2015 at 10:23 AM, ARose wrote: I am trying to call Row.create(object[]) similarly to what's shown in this programming guide https://spark.apache.org/docs/latest/sql-programming-guide.html#programmatically-specifying-the-schema , but the create() method is no longer recognized. I tried to look up the documentation for the Row api, but it does not seem to exist: http://people.apache.org/~pwendell/spark-1.3.0-snapshot1-docs/api/scala/index.html#org.apache.spark.sql.api.java.Row Is there a new equivalent for doing this programmatic specification of schema in 1.3.0? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/What-happened-to-the-Row-class-in-1-3-0-tp22389.html Sent from the Apache Spark User List mailing list archive at Nabble.com (http://Nabble.com). - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org (mailto:user-unsubscr...@spark.apache.org) For additional commands, e-mail: user-h...@spark.apache.org (mailto:user-h...@spark.apache.org)
Re: What happened to the Row class in 1.3.0?
Hi, Ted It’s here: https://github.com/apache/spark/blob/61b427d4b1c4934bd70ed4da844b64f0e9a377aa/sql/catalyst/src/main/java/org/apache/spark/sql/RowFactory.java Best, -- Nan Zhu http://codingcat.me On Monday, April 6, 2015 at 10:44 AM, Ted Yu wrote: I searched code base but didn't find RowFactory class. Pardon me. On Mon, Apr 6, 2015 at 7:39 AM, Ted Yu yuzhih...@gmail.com (mailto:yuzhih...@gmail.com) wrote: From scaladoc of sql/catalyst/src/main/scala/org/apache/spark/sql/Row.scala : * To create a new Row, use [[RowFactory.create()]] in Java or [[Row.apply()]] in Scala. * Cheers On Mon, Apr 6, 2015 at 7:23 AM, ARose ashley.r...@telarix.com (mailto:ashley.r...@telarix.com) wrote: I am trying to call Row.create(object[]) similarly to what's shown in this programming guide https://spark.apache.org/docs/latest/sql-programming-guide.html#programmatically-specifying-the-schema , but the create() method is no longer recognized. I tried to look up the documentation for the Row api, but it does not seem to exist: http://people.apache.org/~pwendell/spark-1.3.0-snapshot1-docs/api/scala/index.html#org.apache.spark.sql.api.java.Row Is there a new equivalent for doing this programmatic specification of schema in 1.3.0? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/What-happened-to-the-Row-class-in-1-3-0-tp22389.html Sent from the Apache Spark User List mailing list archive at Nabble.com (http://Nabble.com). - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org (mailto:user-unsubscr...@spark.apache.org) For additional commands, e-mail: user-h...@spark.apache.org (mailto:user-h...@spark.apache.org)
Re: What happened to the Row class in 1.3.0?
Thanks Nan. I was searching for RowFactory.scala Cheers On Mon, Apr 6, 2015 at 7:52 AM, Nan Zhu zhunanmcg...@gmail.com wrote: Hi, Ted It’s here: https://github.com/apache/spark/blob/61b427d4b1c4934bd70ed4da844b64f0e9a377aa/sql/catalyst/src/main/java/org/apache/spark/sql/RowFactory.java Best, -- Nan Zhu http://codingcat.me On Monday, April 6, 2015 at 10:44 AM, Ted Yu wrote: I searched code base but didn't find RowFactory class. Pardon me. On Mon, Apr 6, 2015 at 7:39 AM, Ted Yu yuzhih...@gmail.com wrote: From scaladoc of sql/catalyst/src/main/scala/org/apache/spark/sql/Row.scala : * To create a new Row, use [[RowFactory.create()]] in Java or [[Row.apply()]] in Scala. * Cheers On Mon, Apr 6, 2015 at 7:23 AM, ARose ashley.r...@telarix.com wrote: I am trying to call Row.create(object[]) similarly to what's shown in this programming guide https://spark.apache.org/docs/latest/sql-programming-guide.html#programmatically-specifying-the-schema , but the create() method is no longer recognized. I tried to look up the documentation for the Row api, but it does not seem to exist: http://people.apache.org/~pwendell/spark-1.3.0-snapshot1-docs/api/scala/index.html#org.apache.spark.sql.api.java.Row Is there a new equivalent for doing this programmatic specification of schema in 1.3.0? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/What-happened-to-the-Row-class-in-1-3-0-tp22389.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
