Re: Java UDF and incompatible schema

2013-11-04 Thread Pradeep Gollakota
This is most likely because you haven't defined the outputSchema method of the UDF. The AS keyword merges the schema generated by the UDF with the user specified schema. If the UDF does not override the method and specify the output schema, it is considered null and you will not be able to use AS t

Java UDF and incompatible schema

2013-11-04 Thread Sameer Tilak
Hi everyone, I have written my custom parser and since my files are sm,all I am using sequence file for efficiency. Each file in the equence file has info about one user and I am parsing that file and I would like to get a bag of tuples for every user/file/. In my Parser class I have implement

Re: support for distributed cache archives

2013-11-04 Thread Alan Gates
I don't see why we couldn't. Step one would be to file a JIRA. After that, if you have the time and inclination feel free to provide a patch for it. Alan. On Nov 1, 2013, at 10:31 PM, Jim Donofrio wrote: > Any thoughts on this? > > On 10/22/2013 10:36 AM, Jim Donofrio wrote: >> JobControlCom

Re: limit map tasks for load function

2013-11-04 Thread John
okay. maybe you are right. thanks 2013/11/4 Pradeep Gollakota > You would only be able to set it for the script... which means it will > apply to all 8 jobs. However, my guess is that you don't need to control > the number of map tasks per machine. > > > On Sun, Nov 3, 2013 at 4:21 PM, John wr