Re: a question of Graph build api

2014-12-06 Thread Takeshi Yamamuro
Hi, Yes, I think so. However, EdgePartitionBuilder might have edge lists as other types instead of Edge in a future. This is because the change can make fast graph construction. See also SPARK-1987. https://issues.apache.org/jira/browse/SPARK-1987 Thanks, takeshi On Fri, Dec 5, 2014 at 12:12

Re: Protobuf version in mvn vs sbt

2014-12-06 Thread spark.dubovsky.jakub
Hi,   I have created assembly with additional hadoop-2.3 profile and submit is smooth now.   Thank you for quick reply!   Now I can move to another maybe dev related problem. Posted to user mailinglist under Including data nucleus tools.   Jakub -- Původní zpráva -- Od: DB

Re: Unit tests in 5 minutes

2014-12-06 Thread Nicholas Chammas
Ted, I posted some updates https://issues.apache.org/jira/browse/SPARK-3431?focusedCommentId=14236540page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14236540 on JIRA on my progress (or lack thereof) getting SBT to parallelize test suites properly. I'm currently stuck

Re: Unit tests in 5 minutes

2014-12-06 Thread Ted Yu
bq. I may move on to trying Maven. Maven is my favorite :-) On Sat, Dec 6, 2014 at 10:54 AM, Nicholas Chammas nicholas.cham...@gmail.com wrote: Ted, I posted some updates

RE: CREATE TABLE AS SELECT does not work with temp tables in 1.2.0

2014-12-06 Thread Cheng, Hao
I've created(reused) the PR https://github.com/apache/spark/pull/3336, hopefully we can fix this regression. Thanks for the reporting. Cheng Hao -Original Message- From: Michael Armbrust [mailto:mich...@databricks.com] Sent: Saturday, December 6, 2014 4:51 AM To: kb Cc:

Re: Hive Problem in Pig generated Parquet file schema in CREATE EXTERNAL TABLE (e.g. bag::col1)

2014-12-06 Thread Jianshi Huang
Ok, found another possible bug in Hive. My current solution is to use ALTER TABLE CHANGE to rename the column names. The problem is after renaming the column names, the value of the columns became all NULL. Before renaming: scala sql(select `sorted::cre_ts` from pmt limit 1).collect res12: