Hi all,
I am a little unclear about which speculative execution you must disable.
What phase do storage functions run at map or reduce?
I've always just done both.
set mapred.reduce.tasks.speculative.execution false
set mapred.map.tasks.speculative.execution false
Thanks for any hints!
On Fri,
Wait did he implement outputSchema? According to the wiki without providing
scheme pig assumes it's a single field of type byte array.
http://wiki.apache.org/pig/UDFManual
Is that the problem?
Sent from my iPhone
On Feb 9, 2011, at 7:39 PM, "Daniel Dai (JIRA)" wrote:
>
>[
> https://is
What about option a but return a map?
Sent from my iPhone
On Jan 27, 2011, at 5:01 PM, "Bill Graham (JIRA)" wrote:
>
>[
> https://issues.apache.org/jira/browse/PIG-1782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12987839#action_12987839
> ]
>
has the work in it) it's still
> worthwhile to have the patch in the JIRA so that those who are using Pig
> with older HBase can apply it to their code and get the benefits.
>
> This functionality should definitely be configurable, since it has
> correctness implications.
>
&
[
https://issues.apache.org/jira/browse/PIG-1825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Corbin Hoenes updated PIG-1825:
---
Attachment: HBaseStorage_noWAL.patch
Patched against branch_0.8.0
> ability to turn off the wr
[
https://issues.apache.org/jira/browse/PIG-1825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Corbin Hoenes updated PIG-1825:
---
Fix Version/s: 0.8.0
Status: Patch Available (was: Open)
Patched against branch_0.8.0
fects Versions: 0.8.0
Reporter: Corbin Hoenes
Priority: Minor
Added an option to allow a caller of HBaseStorage to turn off the WriteAheadLog
feature while doing bulk loads into hbase.
>From the performance tuning wikipage:
>http://wiki.apache.org/hadoop/Performanc
We've got a patch we've made to HBaseStorage which allows a caller to turn
off the WriteAheadLog feature while doing bulk loads into hbase.
>From the performance tuning wikipage:
http://wiki.apache.org/hadoop/PerformanceTuning
"To speed up the inserts in a non critical job (like an import job), yo
Consistency for HBaseStorage
Key: PIG-1769
URL: https://issues.apache.org/jira/browse/PIG-1769
Project: Pig
Issue Type: Improvement
Affects Versions: 0.8.0
Reporter: Corbin Hoenes
In our load
