Hi,
In Pig version 0.11 there is a CurrentTime function. But if you can't
upgrade, you can use parameter.
now = date "+%Y%m%d"
pig -param currenttime=${now} yourscript.pig
and in your pig code, currenttime+46 gives you get_date +46 days.
thanks
best regards...
On Sat, Dec 14, 2013 at 2:49 AM,
to do a
> join?
>
>
> On Tue, Nov 5, 2013 at 11:07 AM, burakkk wrote:
>
> > There are some small different lookup files so that I need to process
> each
> > single lookup files. From your example it can be that way:
> >
> > a = LOAD 'small1'; --
d';
> dump C;
>
> Note that the smaller relation that will be loaded into memory needs to be
> specified second in the JOIN statement.
>
> Also keep in mind that HDFS doesn't perform well with lots of small files.
> If you're design has (lots of) small files, you mi
Hi,
I'm using Pig 0.8.1-cdh3u5. Is there any method to use distributed cache
inside Pig?
My problem is that: I have lots of small files in hdfs. Let's say 10 files.
Each files contain more than one rows but I need only one row. But there
isn't any relationship between each other. So I filter them
Hi,
I examined a little bit about pig's roadmap page and I'm interested in some
of them. I found that you might be working on in this items. But I couldn't
find the issue on jira about them. İs anyone working on them and if it's
not, how can I contribute it? I mean should I create issues about them
pr 2, 2013 at 7:20 PM, Gianmarco De Francisci Morales wrote:
> FYI, Giraph has a Random Walk implementation.
>
> Pig does not support iteration natively, so any iterative algorithm is not
> a very good fit for it. Just my 2c.
>
> Cheers,
>
> --
> Gianmarco
>
>
So what do you suggest? Is it clear?
On Mon, Apr 1, 2013 at 9:35 PM, burakkk wrote:
> I'm using only WTF graph representation to fit the memory. By the way I
> haven't seen any explanation from the pig 0.11 release page about WTF or
> graph models.
> I don't wanna
ally need you to be
> far more detailed to be able to give you good guidance with regards to
> GSoC.
>
> Best,
> Dmitriy
>
>
> On Sat, Mar 30, 2013 at 10:12 AM, burakkk wrote:
>
> > Sure. We can implement a graph model using "WTF: The Who to Follow
> Service
&
triy Ryaboy wrote:
> Hi Burakk,
> The general idea of making graph processing easier is a good one. I'm not
> sure what exactly you are proposing to do, though. Could you be more
> detailed about what you are thinking?
>
>
> On Thu, Mar 28, 2013 at 1:28 PM, burakkk wrote:
&g
Hi,
I might be a little bit late. I come up with a new idea for the last
minute. Currently I'm working on social graph processing. I think we can
implement a solution for pig. With this idea I'm thinking to apply the
GSOC 2013 so that I can do some tasks about it. Is there any mentor to do
it with
10 matches
Mail list logo
