never mind. find my spark is still 1.2 but the avro library requires 1.3. will try again.
On Fri, Mar 27, 2015 at 9:38 PM, Joanne Contact <joannenetw...@gmail.com> wrote: > Hi I am following the instruction on this website. > http://www.infoobjects.com/spark-with-avro/ > > I installed the sparkavro libary on https:// > github.com/databricks/spark-avro > on a machine which only has hive gateway client role on a hadoop cluster. > > somehow I got error on reading the avro file. > > scala> val ufos = > sqlContext.avroFile("hdfs://sssssss/xxxxx/iiiiiiiiiii/iiiiiiiiiiiAaaaSsssss/hhhhhh/2222/00/22/22/iiiiiiiiiiiAaaaSsssss.6.11.469465. > 2099222123.1427497200000.avro") > > <console>:20: error: erroneous or inaccessible type > val ufos = > sqlContext.avroFile("hdfs://sssssss/xxxxx/iiiiiiiiiii/iiiiiiiiiiiAaaaSsssss/hhhhhh/2222/00/22/22/iiiiiiiiiiiAaaaSsssss.6.11.469465. > 2099222123.1427497200000.avro") > > Any advice please? > > Thank you! > > J >
