[ https://issues.apache.org/jira/browse/CARBONDATA-229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
ChenLiang resolved CARBONDATA-229. ---------------------------------- Resolution: Fixed > Array Index of bound exception thrown from dictionary look up while writing > sort index file > ------------------------------------------------------------------------------------------- > > Key: CARBONDATA-229 > URL: https://issues.apache.org/jira/browse/CARBONDATA-229 > Project: CarbonData > Issue Type: Bug > Reporter: Manish Gupta > Assignee: Manish Gupta > > Whenever we load dictionary data into memory, then in case of populating > reverse dictionary object sometimes a chunk which has no value is also > getting added to the dictionary chunk list. This is happening because the > logic for dictionary chunk distribution in case of forward dictionary is not > implemented for reverse dictionary and 0 size dictionary chunks are not > getting removed while adding to the list of dictionary chunks. > java.lang.IndexOutOfBoundsException: Index: 0, Size: 0 > at java.util.ArrayList.rangeCheck(ArrayList.java:653) > at java.util.ArrayList.get(ArrayList.java:429) > at > org.apache.carbondata.core.cache.dictionary.DictionaryChunksWrapper.next(DictionaryChunksWrapper.java:92) > at > org.apache.carbondata.core.writer.sortindex.CarbonDictionarySortInfoPreparator.prepareDictionarySortModels(CarbonDictionarySortInfoPreparator.java:120) > at > org.apache.carbondata.core.writer.sortindex.CarbonDictionarySortInfoPreparator.getDictionarySortInfo(CarbonDictionarySortInfoPreparator.java:51) > at > org.apache.carbondata.spark.tasks.SortIndexWriterTask.execute(SortIndexWriterTask.scala:44) > at > org.apache.carbondata.spark.rdd.CarbonGlobalDictionaryGenerateRDD$$anon$1.<init>(CarbonGlobalDictionaryRDD.scala:387) > at > org.apache.carbondata.spark.rdd.CarbonGlobalDictionaryGenerateRDD.compute(CarbonGlobalDictionaryRDD.scala:294) -- This message was sent by Atlassian JIRA (v6.3.4#6332)