Why pig on spark use RDD API rather than DataFrame API ?

2017-01-07 Thread Jeff Zhang
Hi Folks, I am very interested on the project of pig on spark. When I read the code, I find that the current implementation is based on spark RDD API. I don't know the original background (maybe when this project is started, DataFrame API is not available) , but for now I feel DataFrame API might

RE: Why pig on spark use RDD API rather than DataFrame API ?

2017-01-08 Thread Zhang, Liyun
ary 8, 2017 10:13 AM To: dev@pig.apache.org Subject: Why pig on spark use RDD API rather than DataFrame API ? Hi Folks, I am very interested on the project of pig on spark. When I read the code, I find that the current implementation is based on spark RDD API. I don't know the original backgro

Re: Why pig on spark use RDD API rather than DataFrame API ?

2017-01-08 Thread Pallavi Rao
ent: Sunday, January 8, 2017 10:13 AM > To: dev@pig.apache.org > Subject: Why pig on spark use RDD API rather than DataFrame API ? > > Hi Folks, > > I am very interested on the project of pig on spark. When I read the code, > I find that the current implementation is based on spark

Re: Why pig on spark use RDD API rather than DataFrame API ?

2017-01-09 Thread Jeff Zhang
for optimization work) and work on it if have > > interest. > > > > > > > > Best Regards > > Kelly Zhang/Zhang,Liyun > > > > > > > > -Original Message- > > From: Jeff Zhang [mailto:zjf...@gmail.com] > > Sent: Sunda