[ https://issues.apache.org/jira/browse/PIG-760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12788300#action_12788300 ]
Dmitriy V. Ryaboy commented on PIG-760: --------------------------------------- The core test failure is in junit.framework -- doesn't seem related. Can someone confirm this is just Hudson acting out? Here's the error report: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h8.grid.sp2.yahoo.net/109/testReport/junit.framework/TestSuite$1/warning/ The javadoc fix is trivial, holding off uploading a patch in case I need to do something about the junit test failure. > Serialize schemas for PigStorage() and other storage types. > ----------------------------------------------------------- > > Key: PIG-760 > URL: https://issues.apache.org/jira/browse/PIG-760 > Project: Pig > Issue Type: New Feature > Reporter: David Ciemiewicz > Assignee: Dmitriy V. Ryaboy > Fix For: 0.7.0 > > Attachments: pigstorageschema-2.patch, pigstorageschema.patch, > pigstorageschema_3.patch, pigstorageschema_4.patch, pigstorageschema_5.patch, > TEST-org.apache.pig.piggybank.test.TestPigStorageSchema.txt > > > I'm finding PigStorage() really convenient for storage and data interchange > because it compresses well and imports into Excel and other analysis > environments well. > However, it is a pain when it comes to maintenance because the columns are in > fixed locations and I'd like to add columns in some cases. > It would be great if load PigStorage() could read a default schema from a > .schema file stored with the data and if store PigStorage() could store a > .schema file with the data. > I have tested this out and both Hadoop HDFS and Pig in -exectype local mode > will ignore a file called .schema in a directory of part files. > So, for example, if I have a chain of Pig scripts I execute such as: > A = load 'data-1' using PigStorage() as ( a: int , b: int ); > store A into 'data-2' using PigStorage(); > B = load 'data-2' using PigStorage(); > describe B; > describe B should output something like { a: int, b: int } -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.