[jira] [Commented] (KYLIN-2986) Segments overlap issue may happen when concurrent merge or build

2018-02-12 Thread Zhong Yanghong (JIRA)

[ 
https://issues.apache.org/jira/browse/KYLIN-2986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16361691#comment-16361691
 ] 

Zhong Yanghong commented on KYLIN-2986:
---

Hi [~liyang.g...@gmail.com] & [~yimingliu], after checking the patch from 
[KYLIN-3085], I found {{AutoReadWriteLock}} is introduced for {{CubeManager}} 
to update cube instance data and the bugs of the copy-on-write design are 
almost fixed. I agree not to merge this patch and this JIRA can be closed. 

Will add one more unit test later.

> Segments overlap issue may happen when concurrent merge or build
> 
>
> Key: KYLIN-2986
> URL: https://issues.apache.org/jira/browse/KYLIN-2986
> Project: Kylin
>  Issue Type: Bug
>Reporter: Zhong Yanghong
>Assignee: Zhong Yanghong
>Priority: Trivial
>  Labels: scope
> Attachments: APACHE-KYLIN-2986.patch, screenshot-1.png
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KYLIN-2986) Segments overlap issue may happen when concurrent merge or build

2018-01-24 Thread Billy Liu (JIRA)

[ 
https://issues.apache.org/jira/browse/KYLIN-2986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337310#comment-16337310
 ] 

Billy Liu commented on KYLIN-2986:
--

Hi [~liyang.g...@gmail.com], do you think KYLIN-2986 still valid? 

> Segments overlap issue may happen when concurrent merge or build
> 
>
> Key: KYLIN-2986
> URL: https://issues.apache.org/jira/browse/KYLIN-2986
> Project: Kylin
>  Issue Type: Bug
>Reporter: Zhong Yanghong
>Assignee: Zhong Yanghong
>Priority: Trivial
>  Labels: scope
> Attachments: APACHE-KYLIN-2986.patch, screenshot-1.png
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KYLIN-2986) Segments overlap issue may happen when concurrent merge or build

2017-12-31 Thread liyang (JIRA)

[ 
https://issues.apache.org/jira/browse/KYLIN-2986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16307327#comment-16307327
 ] 

liyang commented on KYLIN-2986:
---

Yes [~yaho], I just merged https://issues.apache.org/jira/browse/KYLIN-3085

Many issues (if not all) in KYLIN-3022 has been resolved by KYLIN-3085, which 
requires a clone at cube level before update. Sorry, but KYLIN-3022 may need a 
rework.

> Segments overlap issue may happen when concurrent merge or build
> 
>
> Key: KYLIN-2986
> URL: https://issues.apache.org/jira/browse/KYLIN-2986
> Project: Kylin
>  Issue Type: Bug
>Reporter: Zhong Yanghong
>Assignee: Zhong Yanghong
>Priority: Trivial
>  Labels: scope
> Attachments: APACHE-KYLIN-2986.patch, screenshot-1.png
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (KYLIN-2986) Segments overlap issue may happen when concurrent merge or build

2017-12-12 Thread liyang (JIRA)

[ 
https://issues.apache.org/jira/browse/KYLIN-2986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16287255#comment-16287255
 ] 

liyang commented on KYLIN-2986:
---

I'm fixing https://issues.apache.org/jira/browse/KYLIN-3085 to address the root 
cause of concurrent modification of cube/segment.

> Segments overlap issue may happen when concurrent merge or build
> 
>
> Key: KYLIN-2986
> URL: https://issues.apache.org/jira/browse/KYLIN-2986
> Project: Kylin
>  Issue Type: Bug
>Reporter: Zhong Yanghong
>Assignee: Zhong Yanghong
>Priority: Trivial
>  Labels: scope
> Attachments: APACHE-KYLIN-2986.patch, screenshot-1.png
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (KYLIN-2986) Segments overlap issue may happen when concurrent merge or build

2017-12-10 Thread Zhong Yanghong (JIRA)

[ 
https://issues.apache.org/jira/browse/KYLIN-2986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16285453#comment-16285453
 ] 

Zhong Yanghong commented on KYLIN-2986:
---

There're two issues.
# One is related to JIRA [KYLIN-3022 | 
https://issues.apache.org/jira/browse/KYLIN-3022], we shouldn't change the 
memory state until the data is updated to database.

> Segments overlap issue may happen when concurrent merge or build
> 
>
> Key: KYLIN-2986
> URL: https://issues.apache.org/jira/browse/KYLIN-2986
> Project: Kylin
>  Issue Type: Bug
>Reporter: Zhong Yanghong
>Assignee: Zhong Yanghong
>Priority: Trivial
>  Labels: scope
> Attachments: APACHE-KYLIN-2986.patch, screenshot-1.png
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (KYLIN-2986) Segments overlap issue may happen when concurrent merge or build

2017-11-30 Thread liyang (JIRA)

[ 
https://issues.apache.org/jira/browse/KYLIN-2986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16273833#comment-16273833
 ] 

liyang commented on KYLIN-2986:
---

Why discarding a job didn't delete the related segment, have any one trace down 
the root cause?

> Segments overlap issue may happen when concurrent merge or build
> 
>
> Key: KYLIN-2986
> URL: https://issues.apache.org/jira/browse/KYLIN-2986
> Project: Kylin
>  Issue Type: Bug
>Reporter: Zhong Yanghong
>Assignee: Zhong Yanghong
>Priority: Trivial
>  Labels: scope
> Attachments: screenshot-1.png
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (KYLIN-2986) Segments overlap issue may happen when concurrent merge or build

2017-11-28 Thread Zhong Yanghong (JIRA)

[ 
https://issues.apache.org/jira/browse/KYLIN-2986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16268581#comment-16268581
 ] 

Zhong Yanghong commented on KYLIN-2986:
---

[~yanghaogn], I'll prepare a patch for this issue in recent days.

> Segments overlap issue may happen when concurrent merge or build
> 
>
> Key: KYLIN-2986
> URL: https://issues.apache.org/jira/browse/KYLIN-2986
> Project: Kylin
>  Issue Type: Bug
>Reporter: Zhong Yanghong
>Assignee: Zhong Yanghong
>Priority: Trivial
>  Labels: scope
> Attachments: screenshot-1.png
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (KYLIN-2986) Segments overlap issue may happen when concurrent merge or build

2017-11-28 Thread Yang Hao (JIRA)

[ 
https://issues.apache.org/jira/browse/KYLIN-2986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16268577#comment-16268577
 ] 

Yang Hao commented on KYLIN-2986:
-

[~liyang.g...@gmail.com] If a segment builing is failed or paused, and it will 
not be able to be refreshed. Then if the job is dropped by some one, the 
segment will not be able to be deleted. We can supply a rest api to delete the 
not ready segment.

> Segments overlap issue may happen when concurrent merge or build
> 
>
> Key: KYLIN-2986
> URL: https://issues.apache.org/jira/browse/KYLIN-2986
> Project: Kylin
>  Issue Type: Bug
>Reporter: Zhong Yanghong
>Assignee: Zhong Yanghong
>Priority: Trivial
>  Labels: scope
> Attachments: screenshot-1.png
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (KYLIN-2986) Segments overlap issue may happen when concurrent merge or build

2017-11-28 Thread Yang Hao (JIRA)

[ 
https://issues.apache.org/jira/browse/KYLIN-2986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16268382#comment-16268382
 ] 

Yang Hao commented on KYLIN-2986:
-

!screenshot-1.png|thumbnail! 
Same problem has happend in our env, and the seg cannot be refreshed

> Segments overlap issue may happen when concurrent merge or build
> 
>
> Key: KYLIN-2986
> URL: https://issues.apache.org/jira/browse/KYLIN-2986
> Project: Kylin
>  Issue Type: Bug
>Reporter: Zhong Yanghong
>Assignee: Zhong Yanghong
>Priority: Trivial
>  Labels: scope
> Attachments: screenshot-1.png
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (KYLIN-2986) Segments overlap issue may happen when concurrent merge or build

2017-11-19 Thread liyang (JIRA)

[ 
https://issues.apache.org/jira/browse/KYLIN-2986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16258716#comment-16258716
 ] 

liyang commented on KYLIN-2986:
---

How it happens? Can you give an example?

> Segments overlap issue may happen when concurrent merge or build
> 
>
> Key: KYLIN-2986
> URL: https://issues.apache.org/jira/browse/KYLIN-2986
> Project: Kylin
>  Issue Type: Bug
>Reporter: Zhong Yanghong
>Assignee: Zhong Yanghong
>Priority: Trivial
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)