[jira] Updated: (PIG-1443) DefaultTuple underestimate the memory footprint for string

2010-06-09 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1443: Attachment: PIG-1443-1.patch > DefaultTuple underestimate the memory footprint for string > -

[jira] Commented: (PIG-1443) DefaultTuple underestimate the memory footprint for string

2010-06-09 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12877143#action_12877143 ] Daniel Dai commented on PIG-1443: - Reference: http://www.javamex.com/tutorials/memory/string_

[jira] Created: (PIG-1443) DefaultTuple underestimate the memory footprint for string

2010-06-09 Thread Daniel Dai (JIRA)
DefaultTuple underestimate the memory footprint for string -- Key: PIG-1443 URL: https://issues.apache.org/jira/browse/PIG-1443 Project: Pig Issue Type: Bug Components: impl

[jira] Commented: (PIG-1441) New test targets: unit and smoke

2010-06-08 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12876913#action_12876913 ] Daniel Dai commented on PIG-1441: - +1 > New test targets: unit and smoke > -

[jira] Commented: (PIG-1295) Binary comparator for secondary sort

2010-06-07 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12876354#action_12876354 ] Daniel Dai commented on PIG-1295: - I briefly review the patch, looks good. This is the approa

[jira] Updated: (PIG-282) Custom Partitioner

2010-06-06 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-282: --- Status: Resolved (was: Patch Available) Hadoop Flags: [Reviewed] Resolution: Fixed Manual test

[jira] Updated: (PIG-1437) [Optimization] Rewrite GroupBy-Foreach-flatten(group) to Distinct

2010-06-04 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1437: Parent: PIG-1319 Issue Type: Sub-task (was: Bug) > [Optimization] Rewrite GroupBy-Foreach-flatten(gr

[jira] Commented: (PIG-972) Make describe work with nested foreach

2010-06-03 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12875410#action_12875410 ] Daniel Dai commented on PIG-972: If we have a statement: {code} a = load '1.txt' as (a0:int, a

[jira] Updated: (PIG-282) Custom Partitioner

2010-06-02 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-282: --- Status: Open (was: Patch Available) > Custom Partitioner > -- > > Key: PIG-282

[jira] Updated: (PIG-282) Custom Partitioner

2010-06-02 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-282: --- Status: Patch Available (was: Open) > Custom Partitioner > -- > > Key: PIG-282

[jira] Updated: (PIG-282) Custom Partitioner

2010-06-01 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-282: --- Status: Patch Available (was: Open) > Custom Partitioner > -- > > Key: PIG-282

[jira] Updated: (PIG-282) Custom Partitioner

2010-06-01 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-282: --- Status: Open (was: Patch Available) > Custom Partitioner > -- > > Key: PIG-282

[jira] Commented: (PIG-1343) pig_log file missing even though Main tells it is creating one and an M/R job fails

2010-06-01 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12874269#action_12874269 ] Daniel Dai commented on PIG-1343: - In this case hadoop does not give a meaningful message in

[jira] Commented: (PIG-972) Make describe work with nested foreach

2010-06-01 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12874235#action_12874235 ] Daniel Dai commented on PIG-972: We should handle describe for a foreach nested alias in two s

[jira] Assigned: (PIG-972) Make describe work with nested foreach

2010-06-01 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai reassigned PIG-972: -- Assignee: Aniket Mokashi (was: Ankit Modi) > Make describe work with nested foreach > ---

[jira] Assigned: (PIG-972) Make describe work with nested foreach

2010-06-01 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai reassigned PIG-972: -- Assignee: Ankit Modi > Make describe work with nested foreach > -- > >

[jira] Resolved: (PIG-1347) Clear up output directory for a failed job

2010-05-26 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-1347. - Hadoop Flags: [Reviewed] Resolution: Fixed Patch committed. > Clear up output directory for a failed

[jira] Updated: (PIG-1347) Clear up output directory for a failed job

2010-05-26 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1347: Attachment: PIG-1347-1.patch > Clear up output directory for a failed job > -

[jira] Updated: (PIG-1347) Clear up output directory for a failed job

2010-05-26 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1347: Attachment: (was: PIG-1347-1.patch) > Clear up output directory for a failed job > --

[jira] Updated: (PIG-1347) Clear up output directory for a failed job

2010-05-26 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1347: Attachment: PIG-1347-1.patch Remove redundant code. > Clear up output directory for a failed job > -

[jira] Updated: (PIG-1419) Remove "user.name" from JobConf

2010-05-26 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1419: Status: Resolved (was: Patch Available) Hadoop Flags: [Reviewed] Resolution: Fixed Manual te

[jira] Updated: (PIG-1381) Need a way for Pig to take an alternative property file

2010-05-26 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1381: Status: Resolved (was: Patch Available) Hadoop Flags: [Reviewed] Resolution: Fixed Manual te

[jira] Commented: (PIG-1347) Clear up output directory for a failed job

2010-05-25 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12871514#action_12871514 ] Daniel Dai commented on PIG-1347: - In current code, we use StoreFunc.cleanupOnFailure for thi

[jira] Commented: (PIG-1343) pig_log file missing even though Main tells it is creating one and an M/R job fails

2010-05-25 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12871511#action_12871511 ] Daniel Dai commented on PIG-1343: - This script will reproduce the issue: {code} a = load '1.t

[jira] Updated: (PIG-1419) Remove "user.name" from JobConf

2010-05-25 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1419: Attachment: (was: PIG-1419-2.patch) > Remove "user.name" from JobConf > --- >

[jira] Updated: (PIG-1419) Remove "user.name" from JobConf

2010-05-25 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1419: Attachment: PIG-1419-2.patch > Remove "user.name" from JobConf > --- > >

[jira] Updated: (PIG-1419) Remove "user.name" from JobConf

2010-05-25 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1419: Attachment: PIG-1419-2.patch For Pradeep's review comment, I think we can safely assume HDataStorage is the

[jira] Commented: (PIG-1381) Need a way for Pig to take an alternative property file

2010-05-25 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12871478#action_12871478 ] Daniel Dai commented on PIG-1381: - Patch looks good. Will commit it if test pass. > Need a w

[jira] Commented: (PIG-1381) Need a way for Pig to take an alternative property file

2010-05-24 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12870972#action_12870972 ] Daniel Dai commented on PIG-1381: - Hi, V.V. Chaitanya, It is "ValueExpected.REQUIRED". It do

[jira] Commented: (PIG-1381) Need a way for Pig to take an alternative property file

2010-05-24 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12870796#action_12870796 ] Daniel Dai commented on PIG-1381: - I reviewed the patch. Command line properties file will ov

[jira] Reopened: (PIG-1359) bin/pig script does not pick up correct jar libraries

2010-05-21 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai reopened PIG-1359: - Assignee: Jeff Zhang Since there is no objection, Jeff, can you commit your change? > bin/pig script doe

[jira] Commented: (PIG-1422) Duplicate code in LOPrinter.java

2010-05-20 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12869708#action_12869708 ] Daniel Dai commented on PIG-1422: - +1, please commit to the trunk. > Duplicate code in LOPri

[jira] Commented: (PIG-1359) bin/pig script does not pick up correct jar libraries

2010-05-20 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12869698#action_12869698 ] Daniel Dai commented on PIG-1359: - Yes, I rethink about it and seems we create unnecessary tr

[jira] Assigned: (PIG-282) Custom Partitioner

2010-05-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai reassigned PIG-282: -- Assignee: Aniket Mokashi > Custom Partitioner > -- > > Key: PIG-282 >

[jira] Updated: (PIG-1373) We need to add jdiff output to docs on the website

2010-05-17 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1373: Attachment: PIG-1373-2.patch PIG-1373-2.patch include site change as well. I borrow some forrest and cocoon

[jira] Updated: (PIG-566) Dump and store outputs do not match for PigStorage

2010-05-17 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-566: --- Status: Resolved (was: Patch Available) Hadoop Flags: [Reviewed] Resolution: Fixed Yes, my mist

[jira] Updated: (PIG-1415) LoadFunc signature is not correct in LoadFunc.getSchema sometimes

2010-05-17 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1415: Status: Resolved (was: Patch Available) Hadoop Flags: [Reviewed] Fix Version/s: 0.7.0

[jira] Commented: (PIG-566) Dump and store outputs do not match for PigStorage

2010-05-15 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12867898#action_12867898 ] Daniel Dai commented on PIG-566: Seems hudson is down. I will manually run the tests. > Dump

[jira] Updated: (PIG-1373) We need to add jdiff output to docs on the website

2010-05-14 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1373: Status: Patch Available (was: Open) > We need to add jdiff output to docs on the website > -

[jira] Updated: (PIG-1373) We need to add jdiff output to docs on the website

2010-05-14 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1373: Attachment: PIG-1373-1.patch PIG-1373-1.patch is to do jdiff against pig 0.7.0. Still need to change site on

[jira] Updated: (PIG-1419) Remove "user.name" from JobConf

2010-05-14 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1419: Attachment: PIG-1419-1.patch > Remove "user.name" from JobConf > --- > >

[jira] Updated: (PIG-1419) Remove "user.name" from JobConf

2010-05-14 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1419: Status: Patch Available (was: Open) > Remove "user.name" from JobConf > --- > >

[jira] Created: (PIG-1419) Remove "user.name" from JobConf

2010-05-14 Thread Daniel Dai (JIRA)
Remove "user.name" from JobConf --- Key: PIG-1419 URL: https://issues.apache.org/jira/browse/PIG-1419 Project: Pig Issue Type: Bug Components: impl Affects Versions: 0.7.0 Reporter: Danie

[jira] Updated: (PIG-1403) Make Pig work with remote HDFS in secure mode

2010-05-14 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1403: Status: Resolved (was: Patch Available) Hadoop Flags: [Reviewed] Resolution: Fixed Patch com

[jira] Updated: (PIG-1403) Make Pig work with remote HDFS in secure mode

2010-05-14 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1403: Status: Patch Available (was: Open) > Make Pig work with remote HDFS in secure mode > --

[jira] Updated: (PIG-1403) Make Pig work with remote HDFS in secure mode

2010-05-14 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1403: Status: Open (was: Patch Available) > Make Pig work with remote HDFS in secure mode > --

[jira] Updated: (PIG-1403) Make Pig work with remote HDFS in secure mode

2010-05-14 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1403: Attachment: PIG-1403-2.patch Yes, you are right. Port number should be included, "jc.addResource("pig-cluste

[jira] Commented: (PIG-759) HBaseStorage scheme for Load/Slice function

2010-05-14 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12867577#action_12867577 ] Daniel Dai commented on PIG-759: Alex, It is closed because it is marked with 0.7 and it is cl

[jira] Closed: (PIG-1360) Pig API docs should include Piggybank

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1360. --- > Pig API docs should include Piggybank > - > > Key: PIG-1360 >

[jira] Closed: (PIG-1174) Creation of output path should be done by storage function

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1174. --- > Creation of output path should be done by storage function >

[jira] Closed: (PIG-1278) Type mismatch in key from map: expected org.apache.pig.impl.io.NullableFloatWritable, recieved org.apache.pig.impl.io.NullableText

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1278. --- > Type mismatch in key from map: expected > org.apache.pig.impl.io.NullableFloatWritable, recieved > org.apache.p

[jira] Closed: (PIG-1323) Communicate whether the call to LoadFunc.setLocation is being made in hadoop's front end or backend

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1323. --- > Communicate whether the call to LoadFunc.setLocation is being made in > hadoop's front end or backend >

[jira] Closed: (PIG-1031) PigStorage interpreting chararray/bytearray for a tuple element inside a bag as float or double

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1031. --- > PigStorage interpreting chararray/bytearray for a tuple element inside a bag > as float or double >

[jira] Closed: (PIG-1245) Remove the connection to namenode in HExecutionEngine.init()

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1245. --- > Remove the connection to namenode in HExecutionEngine.init() > -

[jira] Closed: (PIG-1274) Column pruning throws Null pointer exception

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1274. --- > Column pruning throws Null pointer exception > > > K

[jira] Closed: (PIG-1179) Consecutives ORDER BY on the same relation don't work

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1179. --- > Consecutives ORDER BY on the same relation don't work > - > >

[jira] Closed: (PIG-759) HBaseStorage scheme for Load/Slice function

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-759. -- > HBaseStorage scheme for Load/Slice function > --- > > Key: P

[jira] Closed: (PIG-1138) [zebra] Support of PIG's new Load/Store Interfaces

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1138. --- > [zebra] Support of PIG's new Load/Store Interfaces > --- > >

[jira] Closed: (PIG-1374) PushDownForeachFlatten shall not push ForEach below Join if the flattened fields is used in the next statement

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1374. --- > PushDownForeachFlatten shall not push ForEach below Join if the flattened > fields is used in the next statement

[jira] Closed: (PIG-1391) pig unit tests leave behind files in temp directory because MiniCluster files don't get deleted

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1391. --- > pig unit tests leave behind files in temp directory because MiniCluster files > don't get deleted >

[jira] Closed: (PIG-1417) Site changes for 0.7

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1417. --- > Site changes for 0.7 > > > Key: PIG-1417 > URL: https://issu

[jira] Closed: (PIG-1366) PigStorage's pushProjection implementation results in NPE under certain data conditions

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1366. --- > PigStorage's pushProjection implementation results in NPE under certain data > conditions >

[jira] Closed: (PIG-1365) WrappedIOException is missing from Pig.jar

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1365. --- > WrappedIOException is missing from Pig.jar > -- > > Key:

[jira] Closed: (PIG-1394) POCombinerPackage hold too much memory for InternalCachedBag

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1394. --- > POCombinerPackage hold too much memory for InternalCachedBag > --

[jira] Closed: (PIG-1369) POProject does not handle null tuples and non existent fields in some cases

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1369. --- > POProject does not handle null tuples and non existent fields in some cases > ---

[jira] Closed: (PIG-1372) Restore PigInputFormat.sJob for backward compatibility

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1372. --- > Restore PigInputFormat.sJob for backward compatibility > -- >

[jira] Closed: (PIG-1384) Adding contrib javadoc to main Pig javadoc

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1384. --- > Adding contrib javadoc to main Pig javadoc > -- > > Key:

[jira] Closed: (PIG-1361) [Zebra] Zebra TableLoader.getSchema() should return the projectionSchema specified in the constructor of TableLoader instead of pruned proejction by pig

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1361. --- > [Zebra] Zebra TableLoader.getSchema() should return the projectionSchema > specified in the constructor of Table

[jira] Closed: (PIG-1346) In unit tests Util.executeShellCommand relies on java commands being in the path and does not consider JAVA_HOME

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1346. --- > In unit tests Util.executeShellCommand relies on java commands being in the > path and does not consider JAVA_HO

[jira] Closed: (PIG-1349) [Zebra] Hubson test failure in test case TestBasicUnion

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1349. --- > [Zebra] Hubson test failure in test case TestBasicUnion > ---

[jira] Closed: (PIG-1348) PigStorage making unnecessary byte array copy when storing data

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1348. --- > PigStorage making unnecessary byte array copy when storing data > ---

[jira] Closed: (PIG-1352) piggybank UPPER udf throws exception if argument is null

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1352. --- > piggybank UPPER udf throws exception if argument is null > --

[jira] Closed: (PIG-1362) Provide udf context signature in ensureAllKeysInSameSplit() method of loader

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1362. --- > Provide udf context signature in ensureAllKeysInSameSplit() method of loader > --

[jira] Closed: (PIG-1364) Public javadoc on apache site still on 0.2, needs to be updated for each version release

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1364. --- > Public javadoc on apache site still on 0.2, needs to be updated for each > version release > ---

[jira] Closed: (PIG-1336) Optimize POStore serialized into JobConf

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1336. --- > Optimize POStore serialized into JobConf > > > Key: PIG-

[jira] Closed: (PIG-1330) Move pruned schema tracking logic from LoadFunc to core code

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1330. --- > Move pruned schema tracking logic from LoadFunc to core code > --

[jira] Closed: (PIG-1356) [zebra] TableLoader makes unnecessary calls to build a Job instance that create a new JobClient in the hadoop 0.20.9

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1356. --- > [zebra] TableLoader makes unnecessary calls to build a Job instance that > create a new JobClient in the hadoop

[jira] Closed: (PIG-1327) Incorrect column pruning after multiple JOIN operations

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1327. --- > Incorrect column pruning after multiple JOIN operations > ---

[jira] Closed: (PIG-1357) [zebra] Test cases of map-side GROUP-BY should be added.

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1357. --- > [zebra] Test cases of map-side GROUP-BY should be added. > --

[jira] Closed: (PIG-1335) UDFFinder should find LoadFunc used by POCast

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1335. --- > UDFFinder should find LoadFunc used by POCast > - > >

[jira] Closed: (PIG-1325) Provide a way to exclude a testcase when running "ant test"

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1325. --- > Provide a way to exclude a testcase when running "ant test" > ---

[jira] Closed: (PIG-1312) Make Pig work with hadoop security

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1312. --- > Make Pig work with hadoop security > -- > > Key: PIG-1312 >

[jira] Closed: (PIG-1315) [Zebra] Implementing OrderedLoadFunc interface for Zebra TableLoader

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1315. --- > [Zebra] Implementing OrderedLoadFunc interface for Zebra TableLoader > --

[jira] Closed: (PIG-1317) LOLoad should cache results of LoadMetadata.getSchema() for use in subsequent calls to LOLoad.getSchema() or LOLoad.determineSchema()

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1317. --- > LOLoad should cache results of LoadMetadata.getSchema() for use in subsequent > calls to LOLoad.getSchema() or L

[jira] Closed: (PIG-1318) [Zebra] Invalid type for source_table field when using order-preserving Sorted Table Union

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1318. --- > [Zebra] Invalid type for source_table field when using order-preserving > Sorted Table Union > -

[jira] Closed: (PIG-1308) Inifinite loop in JobClient when reading from BinStorage Message: [org.apache.hadoop.mapreduce.lib.input.FileInputFormat - Total input paths to process : 2]

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1308. --- > Inifinite loop in JobClient when reading from BinStorage Message: > [org.apache.hadoop.mapreduce.lib.input.FileI

[jira] Closed: (PIG-1320) Pig/Zebra 0.7.0 Docs

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1320. --- > Pig/Zebra 0.7.0 Docs > > > Key: PIG-1320 > URL: https://issu

[jira] Closed: (PIG-1316) TextLoader should use Bzip2TextInputFormat for bzip files so that bzip files can be efficiently processed by splitting the files

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1316. --- > TextLoader should use Bzip2TextInputFormat for bzip files so that bzip files > can be efficiently processed by s

[jira] Closed: (PIG-1307) when we spill the DefaultDataBag we are not setting the sized changed flag to be true.

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1307. --- > when we spill the DefaultDataBag we are not setting the sized changed flag to > be true. > -

[jira] Closed: (PIG-1305) Document in Load statement syntax that Pig and underlying M/R does not handle concatenated bz2 and gz files correctly

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1305. --- > Document in Load statement syntax that Pig and underlying M/R does not > handle concatenated bz2 and gz files c

[jira] Closed: (PIG-1310) ISO Date UDFs: Conversion, Trucation and Date Math

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1310. --- > ISO Date UDFs: Conversion, Trucation and Date Math > -- > >

[jira] Closed: (PIG-1306) [zebra] Support of locally sorted input splits

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1306. --- > [zebra] Support of locally sorted input splits > -- > >

[jira] Closed: (PIG-1303) unable to set outgoing format for org.apache.pig.piggybank.evaluation.util.apachelogparser.DateExtractor

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1303. --- > unable to set outgoing format for > org.apache.pig.piggybank.evaluation.util.apachelogparser.DateExtractor > ---

[jira] Closed: (PIG-1290) WeightedRangePartitioner should not check if input is empty if quantile file is empty

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1290. --- > WeightedRangePartitioner should not check if input is empty if quantile file > is empty > --

[jira] Closed: (PIG-1301) Problem pruning columns with UDF

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1301. --- > Problem pruning columns with UDF > > > Key: PIG-1301 >

[jira] Closed: (PIG-1298) Restore file traversal behavior to Pig loaders

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1298. --- > Restore file traversal behavior to Pig loaders > -- > >

[jira] Closed: (PIG-1296) Skewed join fail due to negative partition index

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1296. --- > Skewed join fail due to negative partition index > > >

[jira] Closed: (PIG-1285) Allow SingleTupleBag to be serialized

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1285. --- > Allow SingleTupleBag to be serialized > - > > Key: PIG-1285 >

[jira] Closed: (PIG-1300) PigStorage does not load tuples with large #s.

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1300. --- > PigStorage does not load tuples with large #s. > -- > >

[jira] Closed: (PIG-1289) PIG Join fails while doing a filter on joined data

2010-05-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai closed PIG-1289. --- > PIG Join fails while doing a filter on joined data > -- > >

<    1   2   3   4   5   6   7   8   9   10   >