[ 
https://issues.apache.org/jira/browse/PHOENIX-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15709310#comment-15709310
 ] 

Loknath Priyatham Teja Singamsetty  commented on PHOENIX-3511:
--------------------------------------------------------------

sure [~jamestaylor]. I went with the existing coding convention. Looks like we 
need to fix the same in multiple places.

java/org/apache/phoenix/mapreduce/index/automation/PhoenixMRJobCallable.java:   
     conf.set(TableOutputFormat.OUTPUT_TABLE, physicalIndexTable);
java/org/apache/phoenix/mapreduce/index/IndexTool.java:        
conf.set(TableOutputFormat.OUTPUT_TABLE,
java/org/apache/phoenix/mapreduce/MultiHfileOutputFormat.java:        
conf.setStrings("io.serializations", conf.get("io.serializations"),
java/org/apache/phoenix/mapreduce/MultiHfileOutputFormat.java:               
conf.set(tableName, tableDefns);
java/org/apache/phoenix/util/ConfigUtil.java:      
conf.set(HBASE_MASTER_LOGCLEANER_PLUGINS, "");
java/org/apache/phoenix/util/ConfigUtil.java:      
conf.set(HConstants.ZOOKEEPER_QUORUM, "localhost");
java/org/apache/phoenix/util/PhoenixMRJobUtil.java:        
conf.set("hbase.client.retries.number", String.valueOf(CLIENT_RETRIES_NUMBER));
java/org/apache/phoenix/util/PhoenixMRJobUtil.java:        
conf.set("zookeeper.recovery.retry", 
String.valueOf(ZOOKEEPER_RECOVERY_RETRY_COUNT));
java/org/apache/phoenix/util/PhoenixMRJobUtil.java:        
conf.set("hbase.client.pause", String.valueOf(CLIENT_PAUSE_TIME));
java/org/apache/phoenix/util/PhoenixMRJobUtil.java:        
conf.set(MRJobConfig.QUEUE_NAME,
java/org/apache/phoenix/util/PhoenixMRJobUtil.java:        
conf.setInt(MRJobConfig.JOB_RUNNING_MAP_LIMIT,
java/org/apache/phoenix/util/PhoenixMRJobUtil.java:        
conf.setInt(MRJobConfig.MAP_MEMORY_MB, mapMemoryMB);
java/org/apache/phoenix/util/PhoenixMRJobUtil.java:        
conf.set(MRJobConfig.MAP_JAVA_OPTS, XMX_OPT + ((int) (mapMemoryMB * 0.9)) + 
"m");

> Async Secondary index MR job fails for large data > 200 M records
> -----------------------------------------------------------------
>
>                 Key: PHOENIX-3511
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-3511
>             Project: Phoenix
>          Issue Type: Bug
>    Affects Versions: 4.9.0
>            Reporter: Loknath Priyatham Teja Singamsetty 
>            Assignee: Loknath Priyatham Teja Singamsetty 
>             Fix For: 4.9.0, 4.9.1
>
>         Attachments: phoenix-3511.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to