[jira] [Commented] (KYLIN-4028) Speed up startup progress using cached dependency
[ https://issues.apache.org/jira/browse/KYLIN-4028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16867533#comment-16867533 ] ASF GitHub Bot commented on KYLIN-4028: --- nichunen commented on pull request #672: KYLIN-4028 Speed up startup progress using cached dependency URL: https://github.com/apache/kylin/pull/672 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Speed up startup progress using cached dependency > - > > Key: KYLIN-4028 > URL: https://issues.apache.org/jira/browse/KYLIN-4028 > Project: Kylin > Issue Type: Improvement > Components: Others >Affects Versions: all >Reporter: Temple Zhou >Assignee: Temple Zhou >Priority: Minor > > The hive/hadoop/hbase dependencies are not volatile, and finding the > dependencies every time I start the Kylin server will slow down the startup > speed. > So, if there are dependencies generated by previous running, we can use it to > start the server without finding the dependencies again. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-4028) Speed up startup progress using cached dependency
[ https://issues.apache.org/jira/browse/KYLIN-4028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16867534#comment-16867534 ] ASF subversion and git services commented on KYLIN-4028: Commit 807a5712efc0752da47e5962bab1fdfdb3482dca in kylin's branch refs/heads/master from Temple Zhou [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=807a571 ] KYLIN-4028 Speed up startup progress using cached dependency > Speed up startup progress using cached dependency > - > > Key: KYLIN-4028 > URL: https://issues.apache.org/jira/browse/KYLIN-4028 > Project: Kylin > Issue Type: Improvement > Components: Others >Affects Versions: all >Reporter: Temple Zhou >Assignee: Temple Zhou >Priority: Minor > > The hive/hadoop/hbase dependencies are not volatile, and finding the > dependencies every time I start the Kylin server will slow down the startup > speed. > So, if there are dependencies generated by previous running, we can use it to > start the server without finding the dependencies again. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-4028) Speed up startup progress using cached dependency
[ https://issues.apache.org/jira/browse/KYLIN-4028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16856713#comment-16856713 ] Shaofeng SHI commented on KYLIN-4028: - awsome！thank you Temple! > Speed up startup progress using cached dependency > - > > Key: KYLIN-4028 > URL: https://issues.apache.org/jira/browse/KYLIN-4028 > Project: Kylin > Issue Type: Improvement > Components: Others >Affects Versions: all >Reporter: Temple Zhou >Assignee: Temple Zhou >Priority: Minor > > The hive/hadoop/hbase dependencies are not volatile, and finding the > dependencies every time I start the Kylin server will slow down the startup > speed. > So, if there are dependencies generated by previous running, we can use it to > start the server without finding the dependencies again. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-4028) Speed up startup progress using cached dependency
[
https://issues.apache.org/jira/browse/KYLIN-4028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16854349#comment-16854349
]
Temple Zhou commented on KYLIN-4028:
{code:bash}
..
if [[ -z $reload_dependency && `ls -1 ${dir}/cached-* 2>/dev/null | wc -l`
-eq 5 ]]
then
echo "Using cached dependency..."
source ${dir}/cached-hive-dependency.sh
source ${dir}/cached-hbase-dependency.sh
source ${dir}/cached-hadoop-conf-dir.sh
source ${dir}/cached-kafka-dependency.sh
source ${dir}/cached-spark-dependency.sh
else
source ${dir}/find-hive-dependency.sh
source ${dir}/find-hbase-dependency.sh
source ${dir}/find-hadoop-conf-dir.sh
source ${dir}/find-kafka-dependency.sh
source ${dir}/find-spark-dependency.sh
fi
..
{code}
Just set the second parameter to "--reload-dependency", which will reload the
dependency.
> Speed up startup progress using cached dependency
> -
>
> Key: KYLIN-4028
> URL: https://issues.apache.org/jira/browse/KYLIN-4028
> Project: Kylin
> Issue Type: Improvement
> Components: Others
>Affects Versions: all
>Reporter: Temple Zhou
>Assignee: Temple Zhou
>Priority: Minor
>
> The hive/hadoop/hbase dependencies are not volatile, and finding the
> dependencies every time I start the Kylin server will slow down the startup
> speed.
> So, if there are dependencies generated by previous running, we can use it to
> start the server without finding the dependencies again.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KYLIN-4028) Speed up startup progress using cached dependency
[ https://issues.apache.org/jira/browse/KYLIN-4028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16854322#comment-16854322 ] Shaofeng SHI commented on KYLIN-4028: - This is a good idea! It will accelerate the startup, and also minimal the impace when some services like Hive/HBase are inactive. Temple, is there a way to clear the cache easily? In case some times the classpath or path got changed in the client side. > Speed up startup progress using cached dependency > - > > Key: KYLIN-4028 > URL: https://issues.apache.org/jira/browse/KYLIN-4028 > Project: Kylin > Issue Type: Improvement > Components: Others >Affects Versions: all >Reporter: Temple Zhou >Assignee: Temple Zhou >Priority: Minor > > The hive/hadoop/hbase dependencies are not volatile, and finding the > dependencies every time I start the Kylin server will slow down the startup > speed. > So, if there are dependencies generated by previous running, we can use it to > start the server without finding the dependencies again. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-4028) Speed up startup progress using cached dependency
[ https://issues.apache.org/jira/browse/KYLIN-4028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16854308#comment-16854308 ] ASF GitHub Bot commented on KYLIN-4028: --- TempleZhou commented on pull request #672: KYLIN-4028 Speed up startup progress using cached dependency URL: https://github.com/apache/kylin/pull/672 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Speed up startup progress using cached dependency > - > > Key: KYLIN-4028 > URL: https://issues.apache.org/jira/browse/KYLIN-4028 > Project: Kylin > Issue Type: Improvement > Components: Others >Affects Versions: all >Reporter: Temple Zhou >Assignee: Temple Zhou >Priority: Minor > > The hive/hadoop/hbase dependencies are not volatile, and finding the > dependencies every time I start the Kylin server will slow down the startup > speed. > So, if there are dependencies generated by previous running, we can use it to > start the server without finding the dependencies again. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
