Yeah, currently there isn't such a repo. However, the Spark team is
working on this.
Cheng
On 1/30/15 8:19 AM, Ayoub wrote:
I am not personally aware of a repo for snapshot builds.
In my use case, I had to build spark 1.2.1-snapshot
see https://spark.apache.org/docs/latest/building-spark.html
2015-01-30 17:11 GMT+01:00 Debajyoti Roy <[hidden email]
</user/SendEmail.jtp?type=node&node=21442&i=0>>:
Thanks Ayoub and Zhan,
I am new to spark and wanted to make sure i am not trying
something stupid or using a wrong API.
Is there a repo where i can pull the snapshot or nighly builds for
spark ?
On Fri, Jan 30, 2015 at 2:45 AM, Ayoub Benali <[hidden email]
</user/SendEmail.jtp?type=node&node=21442&i=1>> wrote:
Hello,
I had the same issue then I found this JIRA ticket
https://issues.apache.org/jira/browse/SPARK-4825
So I switched to Spark 1.2.1-snapshot witch solved the problem.
2015-01-30 8:40 GMT+01:00 Zhan Zhang <[hidden email]
</user/SendEmail.jtp?type=node&node=21442&i=2>>:
I think it is expected. Refer to the comments in
saveAsTable "Note that this currently only works with
SchemaRDDs that are created from a HiveContext”. If I
understand correctly, here the SchemaRDD means those
generated by HiveContext.sql, instead of applySchema.
Thanks.
Zhan Zhang
On Jan 29, 2015, at 9:38 PM, matroyd <[hidden email]
</user/SendEmail.jtp?type=node&node=21442&i=3>> wrote:
Hi, I am trying saveAsTable on SchemaRDD created from
HiveContext and it fails. This is on Spark 1.2.0.
Following are details of the code, command and
exceptions:
http://stackoverflow.com/questions/28222496/how-to-enable-sql-on-schemardd-via-the-jdbc-interface-is-it-even-possible
<http://cp.mcafee.com/d/5fHCMUe6zqb2qrVEVso73ztPqdT7HLIcII6QrK6zBxNB55cSztNWXX3bbVJ6XxEVvjKOMedywEjS1454WNDm1yIiJendAWNDm1yIiJendS76zB4xpx_HYO-OMe7tuVtdBBzD1NEVKCqeumKzp55l55zBgY-F6lK1FJ4SOrLOtXTLuZXTdTdw0WjSNmFDUKDRcsLwITZ9OH2C9L9FFI6zBP2tj1uti_MQwvVuwIunH0LiNfRtywwncOQLcDVshg8mbOxfUKXrOYG5Vjb-p-1tqJai87-rrFYiYvCT61tdZxZYKa2xfo4jytoPH0Nm9mDbwGySNaZGSS9_M04SOevpdxuhDNaI9-7Pd45E_I_gd40NoDWKwIe3zhfgQgkQPUxg4WgfYQgiEq88lCq835oBpg8Cy2I3h0zOvndK3zsm65OVJP>
Thanks in advance for any guidance
------------------------------------------------------------------------
View this message in context: HiveContext created
SchemaRDD's saveAsTable is not working on 1.2.0
<http://cp.mcafee.com/d/FZsScxNJ5xddYQsKc3xNKVJ6XzRTS6mm3qdT3hOMUOyyCrhKUZtZxBBYSztMQsLFTpo76Ngk9X0y2ytoPH0Nm9mDbCOtoPH0Nm9mDbCX3zhOygIM_R-pvpo73KLsKCOONPwUQsTjd7fbnhIyyGyyNOEuvkzaT0QSCrpdTVeZXTLuZXCXCM0uHroDVuySNaBSWv4KvaA-hLt5ZO_gpW6A21_YLwnApYiH2vxYOZE_I_gbz5yvGW2MUebQbQQPUxg4WgfYLaxu5pBP5oBpg8BWMbEBQOZOYRAQm6me1NJKDNbN-rso5QTS7TOUEa4Zwhe9RzeI35oBqsK2Gbr4HSHroD_00jr8VZAS5V6v4GMDUvcQgmz-PZ0Qg35yvGW2MUed4Z3h1jjfy50jF0_Ph1axEwxmpEwclylB0yq8aMd42f9ZsSUedGaVp>
Sent from the Apache Spark User List mailing list archive
<http://cp.mcafee.com/d/k-Kr43qb2qrVEVso73ztPqdT7HLIcII6QrK6zBxNB55cSztNWXX3bbVJ6XxEVvjKOMedywEjS1454WNDm1yIiJendAWNDm1yIiJendS76zB4xpx_HYO-OMe7tuVtdBBzD1NEVKCqeumKzp55l55zBgY-F6lK1FJASOrLOtXTLuZXTdTdw0ZmSNfOZ5JylbJQ-9s-l9YzuWbXB-wPQd843_Vv3rtfynzYSUMbFLIfLBNgk9X0ysjH6to6aNaQVs5kmS9nJmSNf-00CShPX9IbOc-9lxfM-pEwJ7ZDW1Ew6b4_lQ5xMsq9W6y2CCv4a0Di1_Cy2l3h12IPh0oH4Ha14Qglwq84ujWVJMsrlDSD>
at Nabble.com <http://Nabble.com>.
--
Thanks,
*Debajyoti Roy*
[hidden email] </user/SendEmail.jtp?type=node&node=21442&i=4>
<a href="tel:646-561-0844" target="_blank">(646)561-0844
350 Madison Ave., FL 16,
New York, NY 10017.
------------------------------------------------------------------------
View this message in context: Re: HiveContext created SchemaRDD's
saveAsTable is not working on 1.2.0
<http://apache-spark-user-list.1001560.n3.nabble.com/Re-HiveContext-created-SchemaRDD-s-saveAsTable-is-not-working-on-1-2-0-tp21442.html>
Sent from the Apache Spark User List mailing list archive
<http://apache-spark-user-list.1001560.n3.nabble.com/> at Nabble.com.
