[jira] [Commented] (PIG-2371) attempt to load a non-existen file results in a stack trace rather an error message

[JIRA]

[ 
https://issues.apache.org/jira/browse/PIG-2371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13444708#comment-13444708
 ] 

Renato Javier Marroquín Mogrovejo commented on PIG-2371:


Hi,

So we could fix this within the getSlit method from the PigInputFormat class, 
my guess is that inputs being loaded from conf.get("pig.inputs") is returning 
nothing so could we just add a validation for this or let the ReadToEndLoader 
to verify this, what is the consensus on this one? IMHO ReadToEndLoader should 
do it while in the init() method. Exactly before this code:
{code}
 try {
inpSplits = inputFormat.getSplits(HadoopShims.createJobContext(conf,
new JobID()));
} catch (InterruptedException e) {
throw new IOException(e);
}  
{\code}

> attempt to load a non-existen file results in a stack trace rather an error 
> message
> ---
>
> Key: PIG-2371
> URL: https://issues.apache.org/jira/browse/PIG-2371
> Project: Pig
>  Issue Type: Bug
>Affects Versions: 0.9.2
> Environment: -bash-3.1$ hadoop version
> Hadoop 0.23.0.080202
> Subversion 
> http://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23.0/hadoop-common-project/hadoop-common
>  -r 1196973
> Compiled by hadoopqa on Tue Nov  8 02:12:04 PST 2011
> From source with checksum 4e42b2d96c899a98a8ab8c7cc23f27ae
> -bash-3.1$ pig -version
> Apache Pig version 0.9.2.101150 (r1200499)
> compiled Nov 10 2011, 19:50:15
>Reporter: Araceli Henley
>Priority: Trivial
>
> a = load 'does_not_exist' using PigStorage();
> dump a;
> Failed Jobs:
> JobId   Alias   Feature Message Outputs
> job_1321041443489_2010  a   MAP_ONLYMessage: 
> org.apache.pig.backend.executionengine.ExecException: ERROR 2118: Input path 
> does not exist: 
> hdfs://gsbl90892.blue.ygrid.yahoo.com:8020/user/hadoopqa/does_not_exist
> at 
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:282)
> at 
> org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.java:445)
> at 
> org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:462)
> at 
> org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:360)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1159)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1156)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1156)
> at 
> org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob.submit(ControlledJob.java:336)
> at 
> org.apache.hadoop.mapreduce.lib.jobcontrol.JobControl.run(JobControl.java:233)
> at java.lang.Thread.run(Thread.java:619)
> Caused by: org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input 
> path does not exist: 
> hdfs://gsbl90892.blue.ygrid.yahoo.com:8020/user/hadoopqa/does_not_exist
> at 
> org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:243)
> at 
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigTextInputFormat.listStatus(PigTextInputFormat.java:36)
> at 
> org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:269)
> at 
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:270)
> ... 12 more
> 
> hdfs://gsbl90892.blue.ygrid.yahoo.com:8020/tmp/temp1739481333/tmp-502339,
> Backend error message
> -
> AttemptID:attempt_1321041443489_2008_m_01_0 Info:Error: 
> java.lang.RuntimeException: java.io.IOException: Can't get JobTracker 
> Kerberos principal for use as renewer
> at 
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.partitioners.SkewedPartitioner.setConf(SkewedPartitioner.java:119)
> at 
> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:70)
> at 
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:125)
> at 
> org.apache.hadoop.mapred.MapTask$NewOutputCollector.(MapTask.java:627)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:695)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:328)
> at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:147)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
>

[jira] [Commented] (PIG-2886) Add Scan TimeRange to HBaseStorage

[Dmitriy V. Ryaboy (JIRA)]

[ 
https://issues.apache.org/jira/browse/PIG-2886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13444694#comment-13444694
 ] 

Dmitriy V. Ryaboy commented on PIG-2886:


Hi Ted,
Great to see clouderians contributing to Pig again! :)

Couple of notes:

minTimeRange, maxTimeRange -- maybe better names would be minTimestamp and 
maxTimestamp ?
That's the signature for HBase's scanTimeRange.

Also, please fix up documentation -- minTimestamp in scan.setTimeRange is 
*inclusive* (so, not strictly greater then). maxTimestamp is, indeed, exclusive 
-- the range is [min, max)

space between } and "else" around maxTimeRange  handling.

HBase scan also provides setTimestamp(). Might as well throw that in?

Does your client care about # of returned versions? That's a much tricker 
change.. 




> Add Scan TimeRange to HBaseStorage 
> ---
>
> Key: PIG-2886
> URL: https://issues.apache.org/jira/browse/PIG-2886
> Project: Pig
>  Issue Type: Bug
>Reporter: Ted Malaska
>Priority: Minor
> Attachments: PIG-2886-0.patch, PIG-2886-1.patch
>
>
> I have a client that wants to use pig.  They are using MR now.  They can't 
> use PIG right now because they only want to fetch the last day's worth of 
> data in HBase.  A filter with time range would require reading all the HStore 
> files.  If we hold major compaction until after the fetch and use Scan Time 
> Range we only need to read very little in compression. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Assigned] (PIG-2896) Pig does not fail anymore if two macros are declared with the same name

[Dmitriy V. Ryaboy (JIRA)]

 [ 
https://issues.apache.org/jira/browse/PIG-2896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Dmitriy V. Ryaboy reassigned PIG-2896:
--

Assignee: Julien Le Dem

> Pig does not fail anymore if two macros are declared with the same name
> ---
>
> Key: PIG-2896
> URL: https://issues.apache.org/jira/browse/PIG-2896
> Project: Pig
>  Issue Type: Bug
>Reporter: Julien Le Dem
>Assignee: Julien Le Dem
> Attachments: PIG-2896.patch
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (PIG-2896) Pig does not fail anymore if two macros are declared with the same name

[Dmitriy V. Ryaboy (JIRA)]

[ 
https://issues.apache.org/jira/browse/PIG-2896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13444682#comment-13444682
 ] 

Dmitriy V. Ryaboy commented on PIG-2896:


How do we reconcile this and PIG-2279 ?

> Pig does not fail anymore if two macros are declared with the same name
> ---
>
> Key: PIG-2896
> URL: https://issues.apache.org/jira/browse/PIG-2896
> Project: Pig
>  Issue Type: Bug
>Reporter: Julien Le Dem
> Attachments: PIG-2896.patch
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (PIG-2895) jodatime jar missing in pig-withouthadoop.jar

[Dmitriy V. Ryaboy (JIRA)]

[ 
https://issues.apache.org/jira/browse/PIG-2895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13444679#comment-13444679
 ] 

Dmitriy V. Ryaboy commented on PIG-2895:


+1

thanks, I was just about to file this :)


> jodatime jar missing in pig-withouthadoop.jar
> -
>
> Key: PIG-2895
> URL: https://issues.apache.org/jira/browse/PIG-2895
> Project: Pig
>  Issue Type: Sub-task
>Reporter: Thejas M Nair
>Assignee: Thejas M Nair
> Fix For: 0.11
>
> Attachments: PIG-2895.1.patch, PIG-2895.2.patch
>
>
> jodatime jar is missing in pig-withouthadoop.jar. When an external hadoop.jar 
> is used, pig will fail with class not found error.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (PIG-2888) Improve performance of POPartialAgg

[Dmitriy V. Ryaboy (JIRA)]

 [ 
https://issues.apache.org/jira/browse/PIG-2888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Dmitriy V. Ryaboy updated PIG-2888:
---

Attachment: PIG-2888.final.patch

Attaching final patch, committing under Julien's +1.

Three changes added:
1) Missed a test class earlier which needed the static string moved to 
PigConfiguration. Done now.

2) a slight change to build.xml to ensure junit3 comes before junit4 in the 
test classpath. Otherwise the build occasionally failed to compile, depending 
on environment.

3) An unrelated fix to TestPOCast, which was failing and this preventing me 
from passing test-commit.



> Improve performance of POPartialAgg
> ---
>
> Key: PIG-2888
> URL: https://issues.apache.org/jira/browse/PIG-2888
> Project: Pig
>  Issue Type: Improvement
>Reporter: Dmitriy V. Ryaboy
>Assignee: Dmitriy V. Ryaboy
> Attachments: partialagg_patch_1.patch, partialagg_patch_2.patch, 
> partialagg_patch_3.patch, partialagg_patch_4.patch, partialagg_patch_5.patch, 
> partialagg_patch_6.patch, PIG-2888.final.patch
>
>
> During performance testing, we found that POPartialAgg can cause performance 
> degradation for Pig jobs when the Algebraic UDFs it's being applied to aren't 
> well suited to the operator's assumptions. Changing the implementation to a 
> more flexible hash-based model can provide significant performance 
> improvements.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (PIG-2895) jodatime jar missing in pig-withouthadoop.jar

[Thejas M Nair (JIRA)]

 [ 
https://issues.apache.org/jira/browse/PIG-2895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Thejas M Nair updated PIG-2895:
---

Status: Patch Available  (was: Open)

Patch tested against a multi-node hadoop cluster.


> jodatime jar missing in pig-withouthadoop.jar
> -
>
> Key: PIG-2895
> URL: https://issues.apache.org/jira/browse/PIG-2895
> Project: Pig
>  Issue Type: Sub-task
>Reporter: Thejas M Nair
>Assignee: Thejas M Nair
> Fix For: 0.11
>
> Attachments: PIG-2895.1.patch, PIG-2895.2.patch
>
>
> jodatime jar is missing in pig-withouthadoop.jar. When an external hadoop.jar 
> is used, pig will fail with class not found error.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (PIG-2895) jodatime jar missing in pig-withouthadoop.jar

[Thejas M Nair (JIRA)]

 [ 
https://issues.apache.org/jira/browse/PIG-2895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Thejas M Nair updated PIG-2895:
---

Attachment: PIG-2895.2.patch

PIG-2895.2.patch - adds "org/joda/time" to pigPackagesToSend.
Thanks Julien for the directions!


> jodatime jar missing in pig-withouthadoop.jar
> -
>
> Key: PIG-2895
> URL: https://issues.apache.org/jira/browse/PIG-2895
> Project: Pig
>  Issue Type: Sub-task
>Reporter: Thejas M Nair
>Assignee: Thejas M Nair
> Fix For: 0.11
>
> Attachments: PIG-2895.1.patch, PIG-2895.2.patch
>
>
> jodatime jar is missing in pig-withouthadoop.jar. When an external hadoop.jar 
> is used, pig will fail with class not found error.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Assigned] (PIG-2893) fix DBStorage compile issue

[Thejas M Nair (JIRA)]

 [ 
https://issues.apache.org/jira/browse/PIG-2893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Thejas M Nair reassigned PIG-2893:
--

Assignee: Thejas M Nair

> fix DBStorage compile issue
> ---
>
> Key: PIG-2893
> URL: https://issues.apache.org/jira/browse/PIG-2893
> Project: Pig
>  Issue Type: Sub-task
>Reporter: Thejas M Nair
>Assignee: Thejas M Nair
> Fix For: 0.11
>
> Attachments: PIG-2893.1.patch
>
>
> DBStorage does not compile after the datetime patch was committed. The joda 
> datetime was passed as argument to java.sql.PreparedStatement.setDate() 
> instead of java.sql.Date .

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (PIG-2758) Incomplete implementation in pig

[Dmitriy V. Ryaboy (JIRA)]

[ 
https://issues.apache.org/jira/browse/PIG-2758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13444528#comment-13444528
 ] 

Dmitriy V. Ryaboy commented on PIG-2758:


The two cases you called out are specifically documented as not supporting 
complex types.

> Incomplete implementation in pig
> 
>
> Key: PIG-2758
> URL: https://issues.apache.org/jira/browse/PIG-2758
> Project: Pig
>  Issue Type: Bug
> Environment: All env
>Reporter: Mridul Muralidharan
>
> Support for Map's is not consistent in the builtin evalfunc/impl. There might 
> be other inconsistencies too (like BIGCHARARRAY, but I have not investigated).
> For example: search for Long.class or Long.TYPE - this gives us the list of 
> classes/usecases where "Map" is not supported the same way .. Invoker, 
> MonitoredUDFExecutor.
> This is NOT a principled way to find all instances of this sort of buggy 
> behavior - someone with better knowledge of pig internals (DataType's, other 
> langs, checks, etc) can do a better job.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (PIG-2896) Pig does not fail anymore if two macros are declared with the same name

[Julien Le Dem (JIRA)]

 [ 
https://issues.apache.org/jira/browse/PIG-2896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Julien Le Dem updated PIG-2896:
---

Patch Info: Patch Available

> Pig does not fail anymore if two macros are declared with the same name
> ---
>
> Key: PIG-2896
> URL: https://issues.apache.org/jira/browse/PIG-2896
> Project: Pig
>  Issue Type: Bug
>Reporter: Julien Le Dem
> Attachments: PIG-2896.patch
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (PIG-2896) Pig does not fail anymore if two macros are declared with the same name

[Julien Le Dem (JIRA)]

 [ 
https://issues.apache.org/jira/browse/PIG-2896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Julien Le Dem updated PIG-2896:
---

Attachment: PIG-2896.patch

PIG-2896.patch restores the old behavior

> Pig does not fail anymore if two macros are declared with the same name
> ---
>
> Key: PIG-2896
> URL: https://issues.apache.org/jira/browse/PIG-2896
> Project: Pig
>  Issue Type: Bug
>Reporter: Julien Le Dem
> Attachments: PIG-2896.patch
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (PIG-2896) Pig does not fail anymore if two macros are declared with the same name

[Julien Le Dem (JIRA)]

[ 
https://issues.apache.org/jira/browse/PIG-2896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13444354#comment-13444354
 ] 

Julien Le Dem commented on PIG-2896:


org.apache.pig.test.TestMacroExpansion.duplicationTest() is failing

> Pig does not fail anymore if two macros are declared with the same name
> ---
>
> Key: PIG-2896
> URL: https://issues.apache.org/jira/browse/PIG-2896
> Project: Pig
>  Issue Type: Bug
>Reporter: Julien Le Dem
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (PIG-2888) Improve performance of POPartialAgg

[Dmitriy V. Ryaboy (JIRA)]

 [ 
https://issues.apache.org/jira/browse/PIG-2888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Dmitriy V. Ryaboy updated PIG-2888:
---

Attachment: partialagg_patch_6.patch

Same, but with the offending test removed.

> Improve performance of POPartialAgg
> ---
>
> Key: PIG-2888
> URL: https://issues.apache.org/jira/browse/PIG-2888
> Project: Pig
>  Issue Type: Improvement
>Reporter: Dmitriy V. Ryaboy
>Assignee: Dmitriy V. Ryaboy
> Attachments: partialagg_patch_1.patch, partialagg_patch_2.patch, 
> partialagg_patch_3.patch, partialagg_patch_4.patch, partialagg_patch_5.patch, 
> partialagg_patch_6.patch
>
>
> During performance testing, we found that POPartialAgg can cause performance 
> degradation for Pig jobs when the Algebraic UDFs it's being applied to aren't 
> well suited to the operator's assumptions. Changing the implementation to a 
> more flexible hash-based model can provide significant performance 
> improvements.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (PIG-2888) Improve performance of POPartialAgg

[Dmitriy V. Ryaboy (JIRA)]

 [ 
https://issues.apache.org/jira/browse/PIG-2888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Dmitriy V. Ryaboy updated PIG-2888:
---

Status: Patch Available  (was: Open)

> Improve performance of POPartialAgg
> ---
>
> Key: PIG-2888
> URL: https://issues.apache.org/jira/browse/PIG-2888
> Project: Pig
>  Issue Type: Improvement
>Reporter: Dmitriy V. Ryaboy
>Assignee: Dmitriy V. Ryaboy
> Attachments: partialagg_patch_1.patch, partialagg_patch_2.patch, 
> partialagg_patch_3.patch, partialagg_patch_4.patch, partialagg_patch_5.patch, 
> partialagg_patch_6.patch
>
>
> During performance testing, we found that POPartialAgg can cause performance 
> degradation for Pig jobs when the Algebraic UDFs it's being applied to aren't 
> well suited to the operator's assumptions. Changing the implementation to a 
> more flexible hash-based model can provide significant performance 
> improvements.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (PIG-2896) Pig does not fail anymore if two macros are declared with the same name

[Julien Le Dem (JIRA)]

Julien Le Dem created PIG-2896:
--

 Summary: Pig does not fail anymore if two macros are declared with 
the same name
 Key: PIG-2896
 URL: https://issues.apache.org/jira/browse/PIG-2896
 Project: Pig
  Issue Type: Bug
Reporter: Julien Le Dem




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (PIG-2888) Improve performance of POPartialAgg

[Julien Le Dem (JIRA)]

[ 
https://issues.apache.org/jira/browse/PIG-2888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13444279#comment-13444279
 ] 

Julien Le Dem commented on PIG-2888:


+1

> Improve performance of POPartialAgg
> ---
>
> Key: PIG-2888
> URL: https://issues.apache.org/jira/browse/PIG-2888
> Project: Pig
>  Issue Type: Improvement
>Reporter: Dmitriy V. Ryaboy
>Assignee: Dmitriy V. Ryaboy
> Attachments: partialagg_patch_1.patch, partialagg_patch_2.patch, 
> partialagg_patch_3.patch, partialagg_patch_4.patch, partialagg_patch_5.patch
>
>
> During performance testing, we found that POPartialAgg can cause performance 
> degradation for Pig jobs when the Algebraic UDFs it's being applied to aren't 
> well suited to the operator's assumptions. Changing the implementation to a 
> more flexible hash-based model can provide significant performance 
> improvements.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (PIG-2895) jodatime jar missing in pig-withouthadoop.jar

[Julien Le Dem (JIRA)]

[ 
https://issues.apache.org/jira/browse/PIG-2895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13444228#comment-13444228
 ] 

Julien Le Dem commented on PIG-2895:


You probably want to add joda to the list of pigPackagesToSend in JarManager
see line 87
http://svn.apache.org/viewvc/pig/trunk/src/org/apache/pig/impl/util/JarManager.java?view=markup

> jodatime jar missing in pig-withouthadoop.jar
> -
>
> Key: PIG-2895
> URL: https://issues.apache.org/jira/browse/PIG-2895
> Project: Pig
>  Issue Type: Sub-task
>Reporter: Thejas M Nair
>Assignee: Thejas M Nair
> Fix For: 0.11
>
> Attachments: PIG-2895.1.patch
>
>
> jodatime jar is missing in pig-withouthadoop.jar. When an external hadoop.jar 
> is used, pig will fail with class not found error.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Resolved] (PIG-2893) fix DBStorage compile issue

[Alan Gates (JIRA)]

 [ 
https://issues.apache.org/jira/browse/PIG-2893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alan Gates resolved PIG-2893.
-

   Resolution: Fixed
Fix Version/s: 0.11

I went ahead and checked in the fix since it was breaking my builds for other 
patches.

> fix DBStorage compile issue
> ---
>
> Key: PIG-2893
> URL: https://issues.apache.org/jira/browse/PIG-2893
> Project: Pig
>  Issue Type: Sub-task
>Reporter: Thejas M Nair
> Fix For: 0.11
>
> Attachments: PIG-2893.1.patch
>
>
> DBStorage does not compile after the datetime patch was committed. The joda 
> datetime was passed as argument to java.sql.PreparedStatement.setDate() 
> instead of java.sql.Date .

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (PIG-2892) piggybank build failing on trunk

[Alan Gates (JIRA)]

 [ 
https://issues.apache.org/jira/browse/PIG-2892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alan Gates updated PIG-2892:


Resolution: Duplicate
Status: Resolved  (was: Patch Available)

Duplicates PIG-2893

> piggybank build failing on trunk
> 
>
> Key: PIG-2892
> URL: https://issues.apache.org/jira/browse/PIG-2892
> Project: Pig
>  Issue Type: Bug
>  Components: piggybank
>Reporter: Alan Gates
>Assignee: Cheolsoo Park
>Priority: Critical
> Attachments: PIG-2892.patch
>
>
> When I try to build Piggybank I get:
> {code}
>[javac] 
> /grid/0/hortonal/src/pig/top/trunk/contrib/piggybank/java/build.xml:92: 
> warning: 'includeantruntime' was not set, defaulting to 
> build.sysclasspath=last; set to false for repeatable builds
> [javac] Compiling 159 source files to 
> /grid/0/hortonal/src/pig/top/trunk/contrib/piggybank/java/build/classes
> [javac] 
> /grid/0/hortonal/src/pig/top/trunk/contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/DBStorage.java:121:
>  cannot find symbol
> [javac] symbol  : method setDate(int,java.util.Date)
> [javac] location: interface java.sql.PreparedStatement
> [javac] ps.setDate(sqlPos, ((DateTime) field).toDate());
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Build failed in Jenkins: Pig-trunk #1307

[Apache Jenkins Server]

See 

Changes:

[thejas] removing JobControlCompiler.java.orig that was committed 
unintentionally as part of PIG-1314 changes

--
[...truncated 35827 lines...]
[junit] at 
org.apache.hadoop.hdfs.server.datanode.FSDataset.shutdown(FSDataset.java:1934)
[junit] at 
org.apache.hadoop.hdfs.server.datanode.DataNode.shutdown(DataNode.java:788)
[junit] at 
org.apache.hadoop.hdfs.MiniDFSCluster.shutdownDataNodes(MiniDFSCluster.java:566)
[junit] at 
org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:550)
[junit] at 
org.apache.pig.test.MiniGenericCluster.shutdownMiniDfsClusters(MiniGenericCluster.java:87)
[junit] at 
org.apache.pig.test.MiniGenericCluster.shutdownMiniDfsAndMrClusters(MiniGenericCluster.java:77)
[junit] at 
org.apache.pig.test.MiniGenericCluster.shutDown(MiniGenericCluster.java:68)
[junit] at 
org.apache.pig.test.TestStore.oneTimeTearDown(TestStore.java:132)
[junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit] at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
[junit] at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
[junit] Shutting down DataNode 2
[junit] at java.lang.reflect.Method.invoke(Method.java:597)
[junit] at 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:44)
[junit] at 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15)
[junit] at 
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:41)
[junit] at 
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:37)
[junit] at org.junit.runners.ParentRunner.run(ParentRunner.java:220)
[junit] at 
junit.framework.JUnit4TestAdapter.run(JUnit4TestAdapter.java:39)
[junit] at 
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:420)
[junit] at 
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:911)
[junit] at 
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:768)
[junit] 12/08/29 10:32:42 WARN datanode.FSDatasetAsyncDiskService: 
AsyncDiskService has already shut down.
[junit] 12/08/29 10:32:42 INFO mortbay.log: Stopped 
SelectChannelConnector@localhost:0
[junit] 12/08/29 10:32:42 INFO ipc.Server: Stopping server on 56714
[junit] 12/08/29 10:32:42 INFO ipc.Server: IPC Server handler 0 on 56714: 
exiting
[junit] 12/08/29 10:32:42 INFO metrics.RpcInstrumentation: shut down
[junit] 12/08/29 10:32:42 INFO ipc.Server: IPC Server handler 2 on 56714: 
exiting
[junit] 12/08/29 10:32:42 INFO ipc.Server: Stopping IPC Server listener on 
56714
[junit] 12/08/29 10:32:42 WARN datanode.DataNode: 
DatanodeRegistration(127.0.0.1:60763, 
storageID=DS-139338274-67.195.138.20-60763-1346235901246, infoPort=37563, 
ipcPort=56714):DataXceiveServer:java.nio.channels.AsynchronousCloseException
[junit] at 
java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:185)
[junit] at 
sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:159)
[junit] at 
sun.nio.ch.ServerSocketAdaptor.accept(ServerSocketAdaptor.java:84)
[junit] at 
org.apache.hadoop.hdfs.server.datanode.DataXceiverServer.run(DataXceiverServer.java:131)
[junit] at java.lang.Thread.run(Thread.java:662)
[junit] 
[junit] 12/08/29 10:32:42 INFO datanode.DataNode: Exiting DataXceiveServer
[junit] 12/08/29 10:32:42 INFO datanode.DataNode: Waiting for threadgroup 
to exit, active threads is 1
[junit] 12/08/29 10:32:42 INFO ipc.Server: IPC Server handler 1 on 56714: 
exiting
[junit] 12/08/29 10:32:42 INFO datanode.DataBlockScanner: Exiting 
DataBlockScanner thread.
[junit] 12/08/29 10:32:42 INFO ipc.Server: Stopping IPC Server Responder
[junit] 12/08/29 10:32:42 INFO datanode.DataNode: 
DatanodeRegistration(127.0.0.1:60763, 
storageID=DS-139338274-67.195.138.20-60763-1346235901246, infoPort=37563, 
ipcPort=56714):Finishing DataNode in: 
FSDataset{dirpath='
[junit] 12/08/29 10:32:42 INFO ipc.Server: Stopping server on 56714
[junit] 12/08/29 10:32:42 INFO metrics.RpcInstrumentation: shut down
[junit] 12/08/29 10:32:42 INFO datanode.DataNode: Waiting for threadgroup 
to exit, active threads is 0
[junit] 12/08/29 10:32:42 INFO datanode.FSDatasetAsyncDiskService: Shutting 
down all async disk service threads...
[junit] 12/08/29 10:32:42 INFO datanode.FSDatasetAsyncDiskService: All 
async disk se