RE: Visualizing the data flow of a Pig script

2011-05-17 Thread Dmitriy Ryaboy
"explain foo -dot" will dump out a dot file representing the dataflow for producing relation foo. -Original Message- From: "Thomas Kappler" To: user@pig.apache.org Sent: 5/17/2011 2:13 AM Subject: Visualizing the data flow of a Pig script Hi all, are there any tool

Re: Visualizing the data flow of a Pig script

2011-05-17 Thread Thomas Kappler
Thanks Harsh, it sounds pretty good. The latest comments on PIG-366 suggest it doesn't work with Pig 0.8+. I couldn't find a repository for the project, the one on google code is outdated. Do you know whether one can get it to work with Pig 0.8 or 0.9-branch? Thanks, Thomas On Tue, May 17, 2011

Re: Visualizing the data flow of a Pig script

2011-05-17 Thread Harsh J
Hey Thomas, Perhaps you're looking for PigPen, the graphical eclipse plugin for Pig? Ticket: https://issues.apache.org/jira/browse/PIG-366 Wiki: http://wiki.apache.org/pig/PigPen On Tue, May 17, 2011 at 2:43 PM, Thomas Kappler wrote: > Hi all, > > are there any tools that visualize the data flo

Visualizing the data flow of a Pig script

2011-05-17 Thread Thomas Kappler
Hi all, are there any tools that visualize the data flow in a Pig script, such as the joins, unions etc.? Maybe somewhat like this: A B \ / C I imagine that would be very helpful during development of more complex scripts. It might be done with Graphviz or similar tools. I couldn't find an