[
https://issues.apache.org/jira/browse/PIG-2425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13169112#comment-13169112
]
Prashant Kommireddi commented on PIG-2425:
------------------------------------------
I would be adding a test case to TestPigServer
{code}
@Test
public void testDefaultPigProperties() throws Throwable {
File propertyFile = new File("pig.properties");
Properties properties = PropertiesUtil.loadDefaultProperties();
Assert
.assertTrue(properties.getProperty(
"pig.exec.reducers.max").equals("999"));
Assert.assertTrue(properties.getProperty("aggregate.warning").equals("true"));
Assert.assertTrue(properties.getProperty("opt.multiquery").equals("true"));
Assert.assertTrue(properties.getProperty("stop.on.failure").equals("false"));
PrintWriter out = new PrintWriter(new FileWriter(propertyFile));
out.println("aggregate.warning=false");
out.println("opt.multiquery=false");
out.println("stop.on.failure=true");
out.close();
properties = PropertiesUtil.loadDefaultProperties();
Assert.assertTrue(properties.getProperty("aggregate.warning")
.equals("false"));
Assert.assertTrue(properties.getProperty("opt.multiquery")
.equals("false"));
Assert.assertTrue(properties.getProperty("stop.on.failure")
.equals("true"));
propertyFile.delete();
}
{code}
> Aggregate Warning does not work as expected on Embedding Pig in Java 0.9.1
> --------------------------------------------------------------------------
>
> Key: PIG-2425
> URL: https://issues.apache.org/jira/browse/PIG-2425
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.9.1
> Reporter: Prashant Kommireddi
> Assignee: Prashant Kommireddi
> Labels: patch
> Fix For: 0.9.1
>
> Attachments: aggregateWarning.patch
>
>
> Property "aggregate.warning" is not being set by default when running
> PigServer, embedding Pig in Java.
> I was initially creating a PigServer object this way:
> {code}
> PigServer pigServer = new PigServer(ExecType.MAPREDUCE);
> {code}
> But this generated detailed logs in the log directory. To code around this on
> the client-side you could do
> {code}
> Properties properties = PropertiesUtil.loadDefaultProperties();
> properties.setProperty("aggregate.warning", "true");
> PigServer pigServer = new PigServer(ExecType.MAPREDUCE, properties);
> {code}
> The behavior between Pig scripting and Embedded Pig should be similar.
> Looking at
> the main constructor of PigServer, it looks like "aggregateWarning" is set
> to false if its not loaded in to Properties object.
> {code}
> public PigServer(PigContext context, boolean connect) throws ExecException {
> this.pigContext = context;
> currDAG = new Graph(false);
> aggregateWarning =
> "true".equalsIgnoreCase(pigContext.getProperties().getProperty("aggregate.warning"));
> isMultiQuery =
> "true".equalsIgnoreCase(pigContext.getProperties().getProperty("opt.multiquery","true"));
> jobName = pigContext.getProperties().getProperty(
> PigContext.JOB_NAME,
> PigContext.JOB_NAME_PREFIX + ":DefaultJobName");
> if (connect) {
> pigContext.connect();
> }
> addJarsFromProperties();
> }
> {code}
> I suggest adding "aggregate.warning" to Properties object of PigContext so
> its picked up across all users of this property (MapReduceLauncher)
> {code}
> public PigServer(PigContext context, boolean connect) throws ExecException {
> this.pigContext = context;
> currDAG = new Graph(false);
> aggregateWarning =
> "true".equalsIgnoreCase(pigContext.getProperties().getProperty("aggregate.warning",
> "true"));
> if(aggregateWarning) {
> pigContext.getProperties().setProperty("aggregate.warning",
> "true");
> }
>
> isMultiQuery =
> "true".equalsIgnoreCase(pigContext.getProperties().getProperty("opt.multiquery","true"));
>
> jobName = pigContext.getProperties().getProperty(
> PigContext.JOB_NAME,
> PigContext.JOB_NAME_PREFIX + ":DefaultJobName");
> if (connect) {
> pigContext.connect();
> }
> addJarsFromProperties();
> }
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
