Hive in IntelliJ

I was trying to implement this example: http://spark.apache.org/docs/1.3.1/sql-programming-guide.html#hive-tables It worked well when I built spark in terminal using command specified: http://spark.apache.org/docs/1.3.1/building-spark.html#building-with-hive-and-jdbc-support But when I try to

Building Spark

I tried to build Spark in my local machine Ubuntu 14.04 ( 4 GB Ram), my system is getting hanged (freezed). When I monitered system processes, the build process is found to consume 85% of my memory. Why does it need lot of resources. Is there any efficient method to build Spark. Thanks Akhil

Re: using hiveContext to select a nested Map-data-type from an AVROmodel+parquet file

I am quoting the reply I got on this - which for some reason did not get posted here. The suggestion in the reply below worked perfectly for me. The error mentioned in the reply is not related (or old). Hope this is helpful to someone. Cheers, BB Hi, BB Ideally you can do the query like

using hiveContext to select a nested Map-data-type from an AVROmodel+parquet file

doing wrong? Q2) How can I use 'where' in the query to filter on specific values? What works: Queries with filtering, and selecting on fields that have simple AVRO data-types, such as long or string works fine. === I hope the explanation makes sense. Thanks. Best, BB