[jira] [Commented] (KYLIN-2316) Build Base Cuboid Data ERROR

2017-04-24 Thread kangkaisen (JIRA) 

[ 
https://issues.apache.org/jira/browse/KYLIN-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15980935#comment-15980935
 ] 

kangkaisen commented on KYLIN-2316:
---

Hi, [~liyang.g...@gmail.com]  this commit has not fixed this issue?

>  Build Base Cuboid Data ERROR
> -
>
> Key: KYLIN-2316
> URL: https://issues.apache.org/jira/browse/KYLIN-2316
> Project: Kylin
>  Issue Type: Bug
>  Components: General
>Affects Versions: v1.6.0
> Environment: hadoop:cdh 5.7.0
> kylin:apache-kylin-1.6.0-cdh.5.7.0
> system:centos 6.8
>Reporter: konglei
>Assignee: kangkaisen
> Fix For: v2.0.0
>
>
> Dec 23, 2016 3:24:40 PM com.google.common.cache.LocalCache 
> processPendingNotifications
> WARNING: Exception thrown by removal listener
> java.lang.RuntimeException: unexpected evict reason COLLECTED
>   at 
> org.apache.kylin.dict.CachedTreeMap$1.onRemoval(CachedTreeMap.java:155)
>   at 
> com.google.common.cache.LocalCache.processPendingNotifications(LocalCache.java:2004)
>   at 
> com.google.common.cache.LocalCache$Segment.runUnlockedCleanup(LocalCache.java:3490)
>   at 
> com.google.common.cache.LocalCache$Segment.postWriteCleanup(LocalCache.java:3466)
>   at 
> com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2304)
>   at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2228)
>   at com.google.common.cache.LocalCache.get(LocalCache.java:3965)
>   at com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:3969)
>   at 
> com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4829)
>   at org.apache.kylin.dict.CachedTreeMap.get(CachedTreeMap.java:292)
>   at org.apache.kylin.dict.CachedTreeMap.get(CachedTreeMap.java:52)
>   at 
> org.apache.kylin.dict.AppendTrieDictionary.getIdFromValueBytesImpl(AppendTrieDictionary.java:971)
>   at 
> org.apache.kylin.common.util.Dictionary.getIdFromValueBytes(Dictionary.java:160)
>   at 
> org.apache.kylin.dimension.DictionaryDimEnc.encode(DictionaryDimEnc.java:91)
>   at 
> org.apache.kylin.cube.kv.RowKeyColumnIO.writeColumn(RowKeyColumnIO.java:55)
>   at 
> org.apache.kylin.cube.kv.RowKeyEncoder.fillColumnValue(RowKeyEncoder.java:195)
>   at org.apache.kylin.cube.kv.RowKeyEncoder.encode(RowKeyEncoder.java:163)
>   at 
> org.apache.kylin.engine.mr.steps.BaseCuboidMapperBase.buildKey(BaseCuboidMapperBase.java:151)
>   at 
> org.apache.kylin.engine.mr.steps.BaseCuboidMapperBase.outputKV(BaseCuboidMapperBase.java:198)
>   at 
> org.apache.kylin.engine.mr.steps.HiveToBaseCuboidMapper.map(HiveToBaseCuboidMapper.java:52)
>   at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
>   at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
>   at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
>   at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at javax.security.auth.Subject.doAs(Subject.java:415)
>   at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
>   at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (KYLIN-2316) Build Base Cuboid Data ERROR

2017-02-09 Thread kangkaisen (JIRA) 

[ 
https://issues.apache.org/jira/browse/KYLIN-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15859430#comment-15859430
 ] 

kangkaisen commented on KYLIN-2316:
---

commit: 
https://github.com/apache/kylin/commit/3ee49467ce686d11afcecbc636bb5213b0927427

>  Build Base Cuboid Data ERROR
> -
>
> Key: KYLIN-2316
> URL: https://issues.apache.org/jira/browse/KYLIN-2316
> Project: Kylin
>  Issue Type: Test
>  Components: General
>Affects Versions: v1.6.0
> Environment: hadoop:cdh 5.7.0
> kylin:apache-kylin-1.6.0-cdh.5.7.0
> system:centos 6.8
>Reporter: konglei
>Assignee: kangkaisen
> Fix For: v2.0.0
>
>
> Dec 23, 2016 3:24:40 PM com.google.common.cache.LocalCache 
> processPendingNotifications
> WARNING: Exception thrown by removal listener
> java.lang.RuntimeException: unexpected evict reason COLLECTED
>   at 
> org.apache.kylin.dict.CachedTreeMap$1.onRemoval(CachedTreeMap.java:155)
>   at 
> com.google.common.cache.LocalCache.processPendingNotifications(LocalCache.java:2004)
>   at 
> com.google.common.cache.LocalCache$Segment.runUnlockedCleanup(LocalCache.java:3490)
>   at 
> com.google.common.cache.LocalCache$Segment.postWriteCleanup(LocalCache.java:3466)
>   at 
> com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2304)
>   at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2228)
>   at com.google.common.cache.LocalCache.get(LocalCache.java:3965)
>   at com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:3969)
>   at 
> com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4829)
>   at org.apache.kylin.dict.CachedTreeMap.get(CachedTreeMap.java:292)
>   at org.apache.kylin.dict.CachedTreeMap.get(CachedTreeMap.java:52)
>   at 
> org.apache.kylin.dict.AppendTrieDictionary.getIdFromValueBytesImpl(AppendTrieDictionary.java:971)
>   at 
> org.apache.kylin.common.util.Dictionary.getIdFromValueBytes(Dictionary.java:160)
>   at 
> org.apache.kylin.dimension.DictionaryDimEnc.encode(DictionaryDimEnc.java:91)
>   at 
> org.apache.kylin.cube.kv.RowKeyColumnIO.writeColumn(RowKeyColumnIO.java:55)
>   at 
> org.apache.kylin.cube.kv.RowKeyEncoder.fillColumnValue(RowKeyEncoder.java:195)
>   at org.apache.kylin.cube.kv.RowKeyEncoder.encode(RowKeyEncoder.java:163)
>   at 
> org.apache.kylin.engine.mr.steps.BaseCuboidMapperBase.buildKey(BaseCuboidMapperBase.java:151)
>   at 
> org.apache.kylin.engine.mr.steps.BaseCuboidMapperBase.outputKV(BaseCuboidMapperBase.java:198)
>   at 
> org.apache.kylin.engine.mr.steps.HiveToBaseCuboidMapper.map(HiveToBaseCuboidMapper.java:52)
>   at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
>   at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
>   at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
>   at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at javax.security.auth.Subject.doAs(Subject.java:415)
>   at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
>   at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (KYLIN-2316) Build Base Cuboid Data ERROR

2017-02-07 Thread kangkaisen (JIRA) 

[ 
https://issues.apache.org/jira/browse/KYLIN-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15857574#comment-15857574
 ] 

kangkaisen commented on KYLIN-2316:
---

Hi, konglei, It looks like you use Global Dictionary for a dimension column? 

>  Build Base Cuboid Data ERROR
> -
>
> Key: KYLIN-2316
> URL: https://issues.apache.org/jira/browse/KYLIN-2316
> Project: Kylin
>  Issue Type: Test
>  Components: General
>Affects Versions: v1.6.0
> Environment: hadoop:cdh 5.7.0
> kylin:apache-kylin-1.6.0-cdh.5.7.0
> system:centos 6.8
>Reporter: konglei
>Assignee: kangkaisen
> Fix For: v2.0.0
>
>
> Dec 23, 2016 3:24:40 PM com.google.common.cache.LocalCache 
> processPendingNotifications
> WARNING: Exception thrown by removal listener
> java.lang.RuntimeException: unexpected evict reason COLLECTED
>   at 
> org.apache.kylin.dict.CachedTreeMap$1.onRemoval(CachedTreeMap.java:155)
>   at 
> com.google.common.cache.LocalCache.processPendingNotifications(LocalCache.java:2004)
>   at 
> com.google.common.cache.LocalCache$Segment.runUnlockedCleanup(LocalCache.java:3490)
>   at 
> com.google.common.cache.LocalCache$Segment.postWriteCleanup(LocalCache.java:3466)
>   at 
> com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2304)
>   at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2228)
>   at com.google.common.cache.LocalCache.get(LocalCache.java:3965)
>   at com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:3969)
>   at 
> com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4829)
>   at org.apache.kylin.dict.CachedTreeMap.get(CachedTreeMap.java:292)
>   at org.apache.kylin.dict.CachedTreeMap.get(CachedTreeMap.java:52)
>   at 
> org.apache.kylin.dict.AppendTrieDictionary.getIdFromValueBytesImpl(AppendTrieDictionary.java:971)
>   at 
> org.apache.kylin.common.util.Dictionary.getIdFromValueBytes(Dictionary.java:160)
>   at 
> org.apache.kylin.dimension.DictionaryDimEnc.encode(DictionaryDimEnc.java:91)
>   at 
> org.apache.kylin.cube.kv.RowKeyColumnIO.writeColumn(RowKeyColumnIO.java:55)
>   at 
> org.apache.kylin.cube.kv.RowKeyEncoder.fillColumnValue(RowKeyEncoder.java:195)
>   at org.apache.kylin.cube.kv.RowKeyEncoder.encode(RowKeyEncoder.java:163)
>   at 
> org.apache.kylin.engine.mr.steps.BaseCuboidMapperBase.buildKey(BaseCuboidMapperBase.java:151)
>   at 
> org.apache.kylin.engine.mr.steps.BaseCuboidMapperBase.outputKV(BaseCuboidMapperBase.java:198)
>   at 
> org.apache.kylin.engine.mr.steps.HiveToBaseCuboidMapper.map(HiveToBaseCuboidMapper.java:52)
>   at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
>   at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
>   at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
>   at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at javax.security.auth.Subject.doAs(Subject.java:415)
>   at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
>   at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (KYLIN-2316) Build Base Cuboid Data ERROR

2017-02-07 Thread liyang (JIRA) 

[ 
https://issues.apache.org/jira/browse/KYLIN-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15857550#comment-15857550
 ] 

liyang commented on KYLIN-2316:
---

Looks like about Global Dictionary.

>  Build Base Cuboid Data ERROR
> -
>
> Key: KYLIN-2316
> URL: https://issues.apache.org/jira/browse/KYLIN-2316
> Project: Kylin
>  Issue Type: Test
>  Components: General
>Affects Versions: v1.6.0
> Environment: hadoop:cdh 5.7.0
> kylin:apache-kylin-1.6.0-cdh.5.7.0
> system:centos 6.8
>Reporter: konglei
>Assignee: kangkaisen
> Fix For: v2.0.0
>
>
> Dec 23, 2016 3:24:40 PM com.google.common.cache.LocalCache 
> processPendingNotifications
> WARNING: Exception thrown by removal listener
> java.lang.RuntimeException: unexpected evict reason COLLECTED
>   at 
> org.apache.kylin.dict.CachedTreeMap$1.onRemoval(CachedTreeMap.java:155)
>   at 
> com.google.common.cache.LocalCache.processPendingNotifications(LocalCache.java:2004)
>   at 
> com.google.common.cache.LocalCache$Segment.runUnlockedCleanup(LocalCache.java:3490)
>   at 
> com.google.common.cache.LocalCache$Segment.postWriteCleanup(LocalCache.java:3466)
>   at 
> com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2304)
>   at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2228)
>   at com.google.common.cache.LocalCache.get(LocalCache.java:3965)
>   at com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:3969)
>   at 
> com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4829)
>   at org.apache.kylin.dict.CachedTreeMap.get(CachedTreeMap.java:292)
>   at org.apache.kylin.dict.CachedTreeMap.get(CachedTreeMap.java:52)
>   at 
> org.apache.kylin.dict.AppendTrieDictionary.getIdFromValueBytesImpl(AppendTrieDictionary.java:971)
>   at 
> org.apache.kylin.common.util.Dictionary.getIdFromValueBytes(Dictionary.java:160)
>   at 
> org.apache.kylin.dimension.DictionaryDimEnc.encode(DictionaryDimEnc.java:91)
>   at 
> org.apache.kylin.cube.kv.RowKeyColumnIO.writeColumn(RowKeyColumnIO.java:55)
>   at 
> org.apache.kylin.cube.kv.RowKeyEncoder.fillColumnValue(RowKeyEncoder.java:195)
>   at org.apache.kylin.cube.kv.RowKeyEncoder.encode(RowKeyEncoder.java:163)
>   at 
> org.apache.kylin.engine.mr.steps.BaseCuboidMapperBase.buildKey(BaseCuboidMapperBase.java:151)
>   at 
> org.apache.kylin.engine.mr.steps.BaseCuboidMapperBase.outputKV(BaseCuboidMapperBase.java:198)
>   at 
> org.apache.kylin.engine.mr.steps.HiveToBaseCuboidMapper.map(HiveToBaseCuboidMapper.java:52)
>   at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
>   at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
>   at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
>   at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at javax.security.auth.Subject.doAs(Subject.java:415)
>   at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
>   at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)