[ https://issues.apache.org/jira/browse/PHOENIX-3228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15450492#comment-15450492 ]
James Taylor commented on PHOENIX-3228: --------------------------------------- There's also this code in MetaDataClient that sets the MAX_FILESIZE for an index, based on the ratio of the index row size versus data row size: {code} } else if (tableType == PTableType.INDEX && indexId == null) { if (tableProps.get(HTableDescriptor.MAX_FILESIZE) == null) { int nIndexRowKeyColumns = isPK ? 1 : pkColumnsNames.size(); int nIndexKeyValueColumns = columns.size() - nIndexRowKeyColumns; int nBaseRowKeyColumns = parent.getPKColumns().size() - (parent.getBucketNum() == null ? 0 : 1); int nBaseKeyValueColumns = parent.getColumns().size() - parent.getPKColumns().size(); /* * Approximate ratio between index table size and data table size: * More or less equal to the ratio between the number of key value columns in each. We add one to * the key value column count to take into account our empty key value. We add 1/4 for any key * value data table column that was moved into the index table row key. */ double ratio = (1+nIndexKeyValueColumns + (nIndexRowKeyColumns - nBaseRowKeyColumns)/4d)/(1+nBaseKeyValueColumns); HTableDescriptor descriptor = connection.getQueryServices().getTableDescriptor(parent.getPhysicalName().getBytes()); if (descriptor != null) { // Is null for connectionless long maxFileSize = descriptor.getMaxFileSize(); if (maxFileSize == -1) { // If unset, use default maxFileSize = HConstants.DEFAULT_MAX_FILE_SIZE; } tableProps.put(HTableDescriptor.MAX_FILESIZE, (long)(maxFileSize * ratio)); } } {code} > Index table are configured with a custom/smaller MAX_FILESIZE > ------------------------------------------------------------- > > Key: PHOENIX-3228 > URL: https://issues.apache.org/jira/browse/PHOENIX-3228 > Project: Phoenix > Issue Type: Sub-task > Reporter: Lars Hofhansl > Assignee: Lars Hofhansl > Fix For: 4.9.0, 4.8.1 > > Attachments: 3228-remove.txt, 3228.txt > > > I do not think we should do this. The default of 10G is chosen to keep HBase > happy. For smaller tables or initially until the index gets large it might > lead to more index regions and hence be able to utilize more region server, > but generally, this is not the right thing to do. -- This message was sent by Atlassian JIRA (v6.3.4#6332)