Author: lidong
Date: Sat Sep 22 14:08:04 2018
New Revision: 1841682
URL: http://svn.apache.org/viewvc?rev=1841682&view=rev
Log:
update Yonghong new PMC role
Modified:
kylin/site/blog/2018/09/20/release-v2.5.0/index.html
kylin/site/cn/community/index.html
kylin/site/community/index.html
kylin/site/community/poweredby.html
kylin/site/docs/gettingstarted/faq.html
kylin/site/docs/gettingstarted/terminology.html
kylin/site/docs/howto/howto_upgrade.html
kylin/site/docs/howto/howto_use_beeline.html
kylin/site/docs/install/configuration.html
kylin/site/docs/install/index.html
kylin/site/docs/tutorial/create_cube.html
kylin/site/docs/tutorial/cube_build_performance.html
kylin/site/docs/tutorial/cube_spark.html
kylin/site/docs/tutorial/cube_streaming.html
kylin/site/docs/tutorial/flink.html
kylin/site/docs/tutorial/hybrid.html
kylin/site/docs/tutorial/kylin_client_tool.html
kylin/site/docs/tutorial/kylin_sample.html
kylin/site/docs/tutorial/odbc.html
kylin/site/docs/tutorial/query_pushdown.html
kylin/site/docs/tutorial/setup_jdbc_datasource.html
kylin/site/docs/tutorial/setup_systemcube.html
kylin/site/docs/tutorial/squirrel.html
kylin/site/docs/tutorial/tableau_91.html
kylin/site/docs/tutorial/use_dashboard.html
kylin/site/docs/tutorial/web.html
kylin/site/feed.xml
kylin/site/index.html
Modified: kylin/site/blog/2018/09/20/release-v2.5.0/index.html
URL:
http://svn.apache.org/viewvc/kylin/site/blog/2018/09/20/release-v2.5.0/index.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/blog/2018/09/20/release-v2.5.0/index.html (original)
+++ kylin/site/blog/2018/09/20/release-v2.5.0/index.html Sat Sep 22 14:08:04
2018
@@ -5848,9 +5848,10 @@ var _hmt = _hmt || [];
<h3 id="the-all-in-spark-cubing-engine">The all-in-Spark cubing engine</h3>
<p>Now Kylinâs Spark engine will run all distributed jobs in Spark,
including fetch distinct dimension values, converting cuboid files to HBase
HFile, merging segments, merging dictionaries, etc. The default configurations
are tuned so the user can get an out-of-box experience. The overall performance
with the previous version is close, but we assume Spark has more room to
improve. The related tasks are KYLIN-3427, KYLIN-3441, KYLIN-3442.</p>
-<p>There are also improvements in the job management. Now you can get the job
link on the web console once Spark starts to run. If you discard the job, Kylin
will kill the Spark job to release the resource in time. If Kylin is restarted,
it can resume from the previous job instead of resubmitting a new job. <br />
-### MySQL as Kylin metastore<br />
-In the past, HBase is the only option for Kylin metadata. In some cases, this
is not applicable, for example using replicated HBase cluster for Kylinâs HA
(the replicated HBase is read only). Now we introduce the MySQL metastore to
fulfill such need. This function is in beta now. Check KYLIN-3488 for more.</p>
+<p>There are also improvements in the job management. Now you can get the job
link on the web console once Spark starts to run. If you discard the job, Kylin
will kill the Spark job to release the resource in time. If Kylin is restarted,
it can resume from the previous job instead of resubmitting a new job.</p>
+
+<h3 id="mysql-as-kylin-metastore">MySQL as Kylin metastore</h3>
+<p>In the past, HBase is the only option for Kylin metadata. In some cases,
this is not applicable, for example using replicated HBase cluster for
Kylinâs HA (the replicated HBase is read only). Now we introduce the MySQL
metastore to fulfill such need. This function is in beta now. Check KYLIN-3488
for more.</p>
<h3 id="hybrid-model-web-gui">Hybrid model web GUI</h3>
<p>Hybrid is an advanced model for compositing multiple Cubes. It can be used
for the Cube schema change issue. This function had no GUI in the past so only
a small portion of Kylin users know it. Now we added the web GUI for it so
everyone can try it.</p>
Modified: kylin/site/cn/community/index.html
URL:
http://svn.apache.org/viewvc/kylin/site/cn/community/index.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/cn/community/index.html (original)
+++ kylin/site/cn/community/index.html Sat Sep 22 14:08:04 2018
@@ -539,7 +539,7 @@ var _hmt = _hmt || [];
</a>
<p class="members-name"> Yanghong Zhong
(éé³çº¢) </p>
<p class="member-role">Org: eBay </p>
- <p class="members-role">Role : committer</p>
+ <p class="members-role">Role : PMC</p>
<p>Apache ID : <a
href="http://home.apache.org/phonebook.html?uid=nju_yaho";
class="apache-id">nju_yaho</a> </p>
</div>
</div>
Modified: kylin/site/community/index.html
URL:
http://svn.apache.org/viewvc/kylin/site/community/index.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/community/index.html (original)
+++ kylin/site/community/index.html Sat Sep 22 14:08:04 2018
@@ -6176,7 +6176,7 @@ var _hmt = _hmt || [];
</a>
<p class="members-name"> Yanghong Zhong
(éé³çº¢) </p>
<p class="member-role">Org: eBay </p>
- <p class="members-role">Role : committer</p>
+ <p class="members-role">Role : PMC</p>
<p>Apache ID : <a
href="http://home.apache.org/phonebook.html?uid=nju_yaho";
class="apache-id">nju_yaho</a> </p>
</div>
</div>
Modified: kylin/site/community/poweredby.html
URL:
http://svn.apache.org/viewvc/kylin/site/community/poweredby.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/community/poweredby.html (original)
+++ kylin/site/community/poweredby.html Sat Sep 22 14:08:04 2018
@@ -5880,7 +5880,7 @@ Send a quick description of your organiz
</li>
<li><a href="https://www.gome.com.cn/";>Gome</a>, 2017-04-14
<ul>
- <li>Apache Kylin provides a perfect solution for Gomeâs online
Operation Advisor. It improved not only the analysis performance, but also the
productivity. We adopted Kylin in both T+1 batch procesing and real time
analysis. It is the best OLAP solution in our scenario.</li>
+ <li>Apache Kylin provides a perfect solution for Gomeâs online
Operation Advisor. It improved not only the analysis performance, but also the
productivity. We adopted Kylin in both T+1 batch processing and real time
analysis. It is the best OLAP solution in our scenario.</li>
</ul>
</li>
<li><a href="https://www.sohu.com";>Sohu</a> (<em>NASDAQ: SOHU</em>),
2017-04-13
Modified: kylin/site/docs/gettingstarted/faq.html
URL:
http://svn.apache.org/viewvc/kylin/site/docs/gettingstarted/faq.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/gettingstarted/faq.html (original)
+++ kylin/site/docs/gettingstarted/faq.html Sat Sep 22 14:08:04 2018
@@ -6087,9 +6087,9 @@ kylin.engine.spark-conf.spark.yarn.queue
<hive.version>0.13.1</hive.version>
My Cluster is running on Cloudera Distribution CDH 5.2.0.</code></pre></div>
-<h4
id="sumfield-returns-a-negtive-result-while-all-the-numbers-in-this-field-are--0">SUM(field)
returns a negtive result while all the numbers in this field are > 0</h4>
+<h4
id="sumfield-returns-a-negative-result-while-all-the-numbers-in-this-field-are--0">SUM(field)
returns a negative result while all the numbers in this field are > 0</h4>
<ul>
- <li>If a column is declared as integer in Hive, the SQL engine (calcite)
will use columnâs type (integer) as the data type for âSUM(field)â, while
the aggregated value on this field may exceed the scope of integer; in that
case the cast will cause a negtive value be returned; The workround is, alter
that columnâs type to BIGINT in hive, and then sync the table schema to Kylin
(the cube doesnât need rebuild); Keep in mind that, always declare as BIGINT
in hive for an integer column which would be used as a measure in Kylin; See
hive number types: <a
href="https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Types#LanguageManualTypes-NumericTypes";>https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Types#LanguageManualTypes-NumericTypes</a></li>
+ <li>If a column is declared as integer in Hive, the SQL engine (calcite)
will use columnâs type (integer) as the data type for âSUM(field)â, while
the aggregated value on this field may exceed the scope of integer; in that
case the cast will cause a negtive value be returned; The workaround is, alter
that columnâs type to BIGINT in hive, and then sync the table schema to Kylin
(the cube doesnât need rebuild); Keep in mind that, always declare as BIGINT
in hive for an integer column which would be used as a measure in Kylin; See
hive number types: <a
href="https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Types#LanguageManualTypes-NumericTypes";>https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Types#LanguageManualTypes-NumericTypes</a></li>
</ul>
<h4
id="why-kylin-need-extract-the-distinct-columns-from-fact-table-before-building-cube">Why
Kylin need extract the distinct columns from Fact Table before building
cube?</h4>
Modified: kylin/site/docs/gettingstarted/terminology.html
URL:
http://svn.apache.org/viewvc/kylin/site/docs/gettingstarted/terminology.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/gettingstarted/terminology.html (original)
+++ kylin/site/docs/gettingstarted/terminology.html Sat Sep 22 14:08:04 2018
@@ -5810,7 +5810,7 @@ var _hmt = _hmt || [];
<article
class="post-content" >
<p>Here are some domain
terms we are using in Apache Kylin, please check them for your reference. <br
/>
-They are basic knowledge of Apache Kylin which also will help to well
understand such concept, term, knowledge, theory and others about Data
Warehouse, Business Intelligence for analycits.</p>
+They are basic knowledge of Apache Kylin which also will help to well
understand such concept, term, knowledge, theory and others about Data
Warehouse, Business Intelligence for analytics.</p>
<ul>
<li><strong>Data Warehouse</strong>: a data warehouse (DW or DWH), also
known as an enterprise data warehouse (EDW), is a system used for reporting and
data analysis, <a
href="https://en.wikipedia.org/wiki/Data_warehouse";>wikipedia</a></li>
Modified: kylin/site/docs/howto/howto_upgrade.html
URL:
http://svn.apache.org/viewvc/kylin/site/docs/howto/howto_upgrade.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/howto/howto_upgrade.html (original)
+++ kylin/site/docs/howto/howto_upgrade.html Sat Sep 22 14:08:04 2018
@@ -5828,7 +5828,7 @@ var _hmt = _hmt || [];
<ul>
<li>Kylin 2.5 need Java 8; Please upgrade Java if youâre running with Java
7.</li>
- <li>Kylin metadata is compitable between 2.4 and 2.5. No migration is
needed.</li>
+ <li>Kylin metadata is compatible between 2.4 and 2.5. No migration is
needed.</li>
<li>Spark engine will move more steps from MR to Spark, you may see
performance difference for the same cube after the upgrade.</li>
<li>Property <code
class="highlighter-rouge">kylin.source.jdbc.sqoop-home</code> need be the
location of sqoop installation, not its âbinâ subfolder, please modify it
if youâre using RDBMS as the data source.</li>
<li>The Cube planner is enabled by default now; New cubes will be optimized
by it on first build. System cube and dashboard still need manual
enablement.</li>
@@ -5879,7 +5879,7 @@ var _hmt = _hmt || [];
<p>Kylin v1.5.3 and v1.5.4 are compatible in metadata. Please follow the
common upgrade steps above.</p>
<h2 id="upgrade-from-152-to-v153">Upgrade from 1.5.2 to v1.5.3</h2>
-<p>Kylin v1.5.3 metadata is compitible with v1.5.2, your cubes donât need
rebuilt, as usual, some actions need to be performed:</p>
+<p>Kylin v1.5.3 metadata is compatible with v1.5.2, your cubes donât need
rebuilt, as usual, some actions need to be performed:</p>
<h4 id="update-hbase-coprocessor">1. Update HBase coprocessor</h4>
<p>The HBase tables for existing cubes need be updated to the latest
coprocessor; Follow <a href="howto_update_coprocessor.html">this guide</a> to
update;</p>
@@ -5888,7 +5888,7 @@ var _hmt = _hmt || [];
<p>From 1.5.3, Kylin doesnât need Hive to merge small files anymore; For
users who copy the conf/ from previous version, please remove the âmergeâ
related properties in kylin_hive_conf.xml, including âhive.merge.mapfilesâ,
âhive.merge.mapredfilesâ, and âhive.merge.size.per.taskâ; this will
save the time on extracting data from Hive.</p>
<h2 id="upgrade-from-151-to-v152">Upgrade from 1.5.1 to v1.5.2</h2>
-<p>Kylin v1.5.2 metadata is compitible with v1.5.1, your cubes donât need
upgrade, while some actions need to be performed:</p>
+<p>Kylin v1.5.2 metadata is compatible with v1.5.1, your cubes donât need
upgrade, while some actions need to be performed:</p>
<h4 id="update-hbase-coprocessor-1">1. Update HBase coprocessor</h4>
<p>The HBase tables for existing cubes need be updated to the latest
coprocessor; Follow <a href="howto_update_coprocessor.html">this guide</a> to
update;</p>
Modified: kylin/site/docs/howto/howto_use_beeline.html
URL:
http://svn.apache.org/viewvc/kylin/site/docs/howto/howto_use_beeline.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/howto/howto_use_beeline.html (original)
+++ kylin/site/docs/howto/howto_use_beeline.html Sat Sep 22 14:08:04 2018
@@ -5815,7 +5815,7 @@ var _hmt = _hmt || [];
<ol>
<li>change kylin.hive.client=cli to kylin.hive.client=beeline</li>
- <li>add âkylin.hive.beeline.paramsâ, this is where you can specifiy
beeline commmand parameters. Like username(-n), JDBC URL(-u),etc. Thereâs a
sample kylin.hive.beeline.params included in default kylin.properties, however
itâs commented. You can modify the sample based on your real environment.</li>
+ <li>add âkylin.hive.beeline.paramsâ, this is where you can specify
beeline command parameters. Like username(-n), JDBC URL(-u),etc. Thereâs a
sample kylin.hive.beeline.params included in default kylin.properties, however
itâs commented. You can modify the sample based on your real environment.</li>
</ol>
Modified: kylin/site/docs/install/configuration.html
URL:
http://svn.apache.org/viewvc/kylin/site/docs/install/configuration.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/install/configuration.html (original)
+++ kylin/site/docs/install/configuration.html Sat Sep 22 14:08:04 2018
@@ -6029,7 +6029,7 @@ setenv.sh</code></pre></div>
<td>No</td>
</tr>
<tr>
- <td>kylin.dictionary.resuable</td>
+ <td>kylin.dictionary.reusable</td>
<td>false</td>
<td>Whether reuse dict</td>
<td>Yes</td>
@@ -6853,7 +6853,7 @@ setenv.sh</code></pre></div>
<tr>
<td>kylin.query.timeout-seconds-coefficient</td>
<td>0.5</td>
- <td>the coefficient to controll query timeout seconds</td>
+ <td>the coefficient to control query timeout seconds</td>
<td>Yes</td>
</tr>
<tr>
Modified: kylin/site/docs/install/index.html
URL:
http://svn.apache.org/viewvc/kylin/site/docs/install/index.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/install/index.html (original)
+++ kylin/site/docs/install/index.html Sat Sep 22 14:08:04 2018
@@ -5832,7 +5832,7 @@ var _hmt = _hmt || [];
<p>Kylin depends on Hadoop cluster to process the massive data set. You need
prepare a well configured Hadoop cluster for Kylin to run, with the common
services includes HDFS, YARN, MapReduce, Hive, HBase, Zookeeper and other
services. It is most common to install Kylin on a Hadoop client machine, from
which Kylin can talk with the Hadoop cluster via command lines including <code
class="highlighter-rouge">hive</code>, <code
class="highlighter-rouge">hbase</code>, <code
class="highlighter-rouge">hadoop</code>, etc.</p>
-<p>Kylin itself can be started in any node of the Hadoop cluster. For
simplity, you can run it in the master node. But to get better stability, we
suggest you to deploy it a pure Hadoop client node, on which the command lines
like <code class="highlighter-rouge">hive</code>, <code
class="highlighter-rouge">hbase</code>, <code
class="highlighter-rouge">hadoop</code>, <code
class="highlighter-rouge">hdfs</code> already be installed and the client
congfigurations (core-site.xml, hive-site.xml, hbase-site.xml, etc) are
properly configured and will be automatically syned with other nodes. The Linux
account that running Kylin has the permission to access the Hadoop cluster,
including create/write HDFS folders, hive tables, hbase tables and submit MR
jobs.</p>
+<p>Kylin itself can be started in any node of the Hadoop cluster. For
simplity, you can run it in the master node. But to get better stability, we
suggest you to deploy it a pure Hadoop client node, on which the command lines
like <code class="highlighter-rouge">hive</code>, <code
class="highlighter-rouge">hbase</code>, <code
class="highlighter-rouge">hadoop</code>, <code
class="highlighter-rouge">hdfs</code> already be installed and the client
congfigurations (core-site.xml, hive-site.xml, hbase-site.xml, etc) are
properly configured and will be automatically synced with other nodes. The
Linux account that running Kylin has the permission to access the Hadoop
cluster, including create/write HDFS folders, hive tables, hbase tables and
submit MR jobs.</p>
<h2 id="installation-kylin">Installation Kylin</h2>
Modified: kylin/site/docs/tutorial/create_cube.html
URL:
http://svn.apache.org/viewvc/kylin/site/docs/tutorial/create_cube.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/tutorial/create_cube.html (original)
+++ kylin/site/docs/tutorial/create_cube.html Sat Sep 22 14:08:04 2018
@@ -5841,7 +5841,7 @@ var _hmt = _hmt || [];
<p><img src="/images/tutorial/1.5/Kylin-Cube-Creation-Tutorial/4
+table.png" alt="" /></p>
</li>
<li>
- <p>Enter the hive table names, separated with commad, and then click <code
class="highlighter-rouge">Sync</code> .</p>
+ <p>Enter the hive table names, separated with comma, and then click <code
class="highlighter-rouge">Sync</code> .</p>
<p><img src="/images/tutorial/1.5/Kylin-Cube-Creation-Tutorial/5
hive-table.png" alt="" /></p>
</li>
@@ -6045,7 +6045,7 @@ Approximate TopN measure pre-calculates
<p><code class="highlighter-rouge">Rowkeys</code>: the rowkeys are composed by
the dimension encoded values. âDictionaryâ is the default encoding method;
If a dimension is not fit with dictionary (e.g., cardinality > 10 million),
select âfalseâ and then enter the fixed length for that dimension, usually
that is the max length of that column; if a value is longer than that size it
will be truncated. Please note, without dictionary encoding, the cube size
might be much bigger.</p>
-<p>You can drag & drop a dimension column to adjust its position in
rowkey; Put the mandantory dimension at the begining, then followed the
dimensions that heavily involved in filters (where condition). Put high
cardinality dimensions ahead of low cardinality dimensions.</p>
+<p>You can drag & drop a dimension column to adjust its position in
rowkey; Put the mandatory dimension at the beginning, then followed the
dimensions that heavily involved in filters (where condition). Put high
cardinality dimensions ahead of low cardinality dimensions.</p>
<p><code class="highlighter-rouge">Mandatory Cuboids</code>: Whitelist of the
cuboids that you want to build.</p>
Modified: kylin/site/docs/tutorial/cube_build_performance.html
URL:
http://svn.apache.org/viewvc/kylin/site/docs/tutorial/cube_build_performance.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/tutorial/cube_build_performance.html (original)
+++ kylin/site/docs/tutorial/cube_build_performance.html Sat Sep 22 14:08:04
2018
@@ -5987,8 +5987,8 @@ SELECT *
* Personalize Dim encoder for each Dim and choose the best order of Dim in Row
Key</p>
<p>Now, there are three types of cubes:<br />
-* Cubes with low cardinality in their dimensions (Like cube 4, most of time is
usend in flat table steps)<br />
-* Cubes with high cardinality in their dimensions (Like cube 6,most of time is
usend on Build cube, the flat table steps are lower than 10%)<br />
+* Cubes with low cardinality in their dimensions (Like cube 4, most of time is
used in flat table steps)<br />
+* Cubes with high cardinality in their dimensions (Like cube 6,most of time is
used on Build cube, the flat table steps are lower than 10%)<br />
* The third type, ultra high cardinality (UHC) which is outside the scope of
this article</p>
<h3 id="cube-6-cube-with-high-cardinality-dimensions">Cube 6: Cube with high
cardinality Dimensions</h3>
Modified: kylin/site/docs/tutorial/cube_spark.html
URL:
http://svn.apache.org/viewvc/kylin/site/docs/tutorial/cube_spark.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/tutorial/cube_spark.html (original)
+++ kylin/site/docs/tutorial/cube_spark.html Sat Sep 22 14:08:04 2018
@@ -5830,7 +5830,7 @@ export KYLIN_HOME=/usr/local/apache-kyli
<h2 id="check-spark-configuration">Check Spark configuration</h2>
-<p>Kylin embedes a Spark binary (v2.1.0) in $KYLIN_HOME/spark, all the Spark
configurations can be managed in $KYLIN_HOME/conf/kylin.properties with prefix
<em>âkylin.engine.spark-conf.â</em>. These properties will be extracted and
applied when runs submit Spark job; E.g, if you configure
âkylin.engine.spark-conf.spark.executor.memory=4Gâ, Kylin will use
ââconf spark.executor.memory=4Gâ as parameter when execute
âspark-submitâ.</p>
+<p>Kylin embeds a Spark binary (v2.1.0) in $KYLIN_HOME/spark, all the Spark
configurations can be managed in $KYLIN_HOME/conf/kylin.properties with prefix
<em>âkylin.engine.spark-conf.â</em>. These properties will be extracted and
applied when runs submit Spark job; E.g, if you configure
âkylin.engine.spark-conf.spark.executor.memory=4Gâ, Kylin will use
ââconf spark.executor.memory=4Gâ as parameter when execute
âspark-submitâ.</p>
<p>Before you run Spark cubing, suggest take a look on these configurations
and do customization according to your cluster. Below is the recommended
configurations:</p>
@@ -5861,7 +5861,7 @@ kylin.engine.spark-conf.spark.history.fs
#kylin.engine.spark-conf.spark.yarn.am.extraJavaOptions=-Dhdp.version=current
#kylin.engine.spark-conf.spark.executor.extraJavaOptions=-Dhdp.version=current</code></pre></div>
-<p>For running on Hortonworks platform, need specify âhdp.versionâ as Java
options for Yarn containers, so please uncommment the last three lines in
kylin.properties.</p>
+<p>For running on Hortonworks platform, need specify âhdp.versionâ as Java
options for Yarn containers, so please uncomment the last three lines in
kylin.properties.</p>
<p>Besides, in order to avoid repeatedly uploading Spark jars to Yarn, you can
manually do that once, and then configure the jarâs HDFS location; Please
note, the HDFS location need be full qualified name.</p>
@@ -5893,7 +5893,7 @@ $KYLIN_HOME/bin/kylin.sh start</code></p
<p><img
src="/images/tutorial/2.0/Spark-Cubing-Tutorial/2_overwrite_partition.png"
alt="" /></p>
-<p>The sample cube has two memory hungry measures: a âCOUNT DISTINCTâ and
a âTOPN(100)â; Their size estimation can be inaccurate when the source data
is small: the estimized size is much larger than the real size, that causes
much more RDD partitions be splitted, which slows down the build. Here 100 is a
more reasonable number for it. Click âNextâ and âSaveâ to save the
cube.</p>
+<p>The sample cube has two memory hungry measures: a âCOUNT DISTINCTâ and
a âTOPN(100)â; Their size estimation can be inaccurate when the source data
is small: the estimated size is much larger than the real size, that causes
much more RDD partitions be splitted, which slows down the build. Here 100 is a
more reasonable number for it. Click âNextâ and âSaveâ to save the
cube.</p>
<h2 id="build-cube-with-spark">Build Cube with Spark</h2>
Modified: kylin/site/docs/tutorial/cube_streaming.html
URL:
http://svn.apache.org/viewvc/kylin/site/docs/tutorial/cube_streaming.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/tutorial/cube_streaming.html (original)
+++ kylin/site/docs/tutorial/cube_streaming.html Sat Sep 22 14:08:04 2018
@@ -5904,9 +5904,9 @@ Save the data model.</p>
<ul>
<li>The partition time column should be a dimension of the Cube. In
Streaming OLAP the time is always a query condition, and Kylin will leverage
this to narrow down the scanned partitions.</li>
- <li>Donât use âorder_timeâ as dimension as that is pretty
fine-grained; suggest to use âmintue_startâ, âhour_startâ or other,
depends on how you will inspect the data.</li>
+ <li>Donât use âorder_timeâ as dimension as that is pretty
fine-grained; suggest to use âminute_startâ, âhour_startâ or other,
depends on how you will inspect the data.</li>
<li>Define âyear_startâ, âquarter_startâ, âmonth_startâ,
âday_startâ, âhour_startâ, âminute_startâ as a hierarchy to reduce
the combinations to calculate.</li>
- <li>In the ârefersh settingâ step, create more merge ranges, like 0.5
hour, 4 hours, 1 day, and then 7 days; This will help to control the cube
segment number.</li>
+ <li>In the ârefresh settingâ step, create more merge ranges, like 0.5
hour, 4 hours, 1 day, and then 7 days; This will help to control the cube
segment number.</li>
<li>
<p>In the ârowkeysâ section, drag&drop the âminute_startâ to
the head position, as for streaming queries, the time condition is always
appeared; putting it to head will help to narrow down the scan range.</p>
Modified: kylin/site/docs/tutorial/flink.html
URL:
http://svn.apache.org/viewvc/kylin/site/docs/tutorial/flink.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/tutorial/flink.html (original)
+++ kylin/site/docs/tutorial/flink.html Sat Sep 22 14:08:04 2018
@@ -6046,7 +6046,7 @@ order by part_dt</code></pre></div>
<p><a
href="https://github.com/albertoRamon/Flink/tree/master/ReadKylinFromFlink/flink-scala-project";>Full
Code Example</a></p>
-<p>Solved all integration problems, and tested with different types of data
(Long, BigDecimal and Dates). The patch has been comited at 15 Oct, then, will
be part of Flink 1.2.</p>
+<p>Solved all integration problems, and tested with different types of data
(Long, BigDecimal and Dates). The patch has been committed at 15 Oct, then,
will be part of Flink 1.2.</p>
</article>
</div>
Modified: kylin/site/docs/tutorial/hybrid.html
URL:
http://svn.apache.org/viewvc/kylin/site/docs/tutorial/hybrid.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/tutorial/hybrid.html (original)
+++ kylin/site/docs/tutorial/hybrid.html Sat Sep 22 14:08:04 2018
@@ -5809,7 +5809,7 @@ var _hmt = _hmt || [];
<article
class="post-content" >
- <p>This tutorial will
guide you to create a hybrid model. Regarding the concept of hybri, please
refer to <a href="http://kylin.apache.org/blog/2015/09/25/hybrid-model/";>this
blog</a>.</p>
+ <p>This tutorial will
guide you to create a hybrid model. Regarding the concept of hybrid, please
refer to <a href="http://kylin.apache.org/blog/2015/09/25/hybrid-model/";>this
blog</a>.</p>
<h3 id="i-create-a-hybrid-model">I. Create a hybrid model</h3>
<p>One Hybrid model can refer to multiple cubes.</p>
@@ -5837,7 +5837,7 @@ var _hmt = _hmt || [];
<h3 id="ii-update-a-hybrid-model">II. Update a hybrid model</h3>
<ol>
<li>
- <p>Place the mouse over the hybrid name, then click <code
class="highlighter-rouge">Action</code> button, in the drop-down list select
<code class="highlighter-rouge">Edit</code>. You can update the ybrid by
adding(> button) or deleting(< button) cubes to/from it. <br />
+ <p>Place the mouse over the hybrid name, then click <code
class="highlighter-rouge">Action</code> button, in the drop-down list select
<code class="highlighter-rouge">Edit</code>. You can update the hybrid by
adding(> button) or deleting(< button) cubes to/from it. <br />
<img src="/images/tutorial/2.5/Kylin-Hybrid-Creation-Tutorial/4
edit-hybrid.png" alt="" /></p>
</li>
<li>
Modified: kylin/site/docs/tutorial/kylin_client_tool.html
URL:
http://svn.apache.org/viewvc/kylin/site/docs/tutorial/kylin_client_tool.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/tutorial/kylin_client_tool.html (original)
+++ kylin/site/docs/tutorial/kylin_client_tool.html Sat Sep 22 14:08:04 2018
@@ -5838,7 +5838,7 @@ Options:
-p, --password TEXT Kylin password [required]
--project TEXT Kylin project [required]
--prefix TEXT Kylin RESTful prefix of url, default: "/kylin/api"
- --debug / --no-debug show debug infomation
+ --debug / --no-debug show debug information
--help Show this message and exit.
Commands:
Modified: kylin/site/docs/tutorial/kylin_sample.html
URL:
http://svn.apache.org/viewvc/kylin/site/docs/tutorial/kylin_sample.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/tutorial/kylin_sample.html (original)
+++ kylin/site/docs/tutorial/kylin_sample.html Sat Sep 22 14:08:04 2018
@@ -5817,7 +5817,7 @@ var _hmt = _hmt || [];
<li>Select the sample cube âkylin_sales_cubeâ, click âActionsâ ->
âBuildâ, pick up a date later than 2014-01-01 (to cover all 10000 sample
records);</li>
<li>Check the build progress in âMonitorâ tab, until 100%;</li>
<li>Execute SQLs in the âInsightâ tab, for example:<br />
- select part_dt, sum(price) as total_selled, count(distinct seller_id) as
sellers from kylin_sales group by part_dt order by part_dt</li>
+ select part_dt, sum(price) as total_sold, count(distinct seller_id) as
sellers from kylin_sales group by part_dt order by part_dt</li>
<li>You can verify the query result and compare the response time with
hive;</li>
</ol>
Modified: kylin/site/docs/tutorial/odbc.html
URL:
http://svn.apache.org/viewvc/kylin/site/docs/tutorial/odbc.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/tutorial/odbc.html (original)
+++ kylin/site/docs/tutorial/odbc.html Sat Sep 22 14:08:04 2018
@@ -5832,7 +5832,7 @@ var _hmt = _hmt || [];
<h2 id="installation">Installation</h2>
<ol>
- <li>Uninstall existing Kylin ODBC first, if you already installled it
before</li>
+ <li>Uninstall existing Kylin ODBC first, if you already installed it
before</li>
<li>Download ODBC Driver from <a href="../../download/">download</a>.
<ul>
<li>For 32 bit Tableau Desktop: Please install KylinODBCDriver
(x86).exe</li>
Modified: kylin/site/docs/tutorial/query_pushdown.html
URL:
http://svn.apache.org/viewvc/kylin/site/docs/tutorial/query_pushdown.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/tutorial/query_pushdown.html (original)
+++ kylin/site/docs/tutorial/query_pushdown.html Sat Sep 22 14:08:04 2018
@@ -5865,7 +5865,7 @@ kylin.query.pushdown.jdbc.pool-min-idle=
<h3 id="do-query-pushdown">Do Query Pushdown</h3>
-<p>After Query Pushdown is configured, user is allowed to do flexible queries
to the imported tables without avaible cubes.</p>
+<p>After Query Pushdown is configured, user is allowed to do flexible queries
to the imported tables without available cubes.</p>
<p><img src="/images/tutorial/2.1/push_down/push_down_1.png" alt="" /></p>
Modified: kylin/site/docs/tutorial/setup_jdbc_datasource.html
URL:
http://svn.apache.org/viewvc/kylin/site/docs/tutorial/setup_jdbc_datasource.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/tutorial/setup_jdbc_datasource.html (original)
+++ kylin/site/docs/tutorial/setup_jdbc_datasource.html Sat Sep 22 14:08:04 2018
@@ -5877,7 +5877,7 @@ kylin.source.jdbc.filed-delimiter=|
</code></pre>
</div>
-<p>There is another parameter specifing how many splits should be divided.
Sqoop would run a mapper for each split.</p>
+<p>There is another parameter specifying how many splits should be divided.
Sqoop would run a mapper for each split.</p>
<div class="highlighter-rouge"><pre
class="highlight"><code>kylin.source.jdbc.sqoop-mapper-num=4
</code></pre>
Modified: kylin/site/docs/tutorial/setup_systemcube.html
URL:
http://svn.apache.org/viewvc/kylin/site/docs/tutorial/setup_systemcube.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/tutorial/setup_systemcube.html (original)
+++ kylin/site/docs/tutorial/setup_systemcube.html Sat Sep 22 14:08:04 2018
@@ -5847,18 +5847,18 @@ var _hmt = _hmt || [];
<div class="highlighter-rouge"><pre class="highlight"><code>./bin/kylin.sh
org.apache.kylin.tool.metrics.systemcube.SCCreator \
-inputConfig SCSinkTools.json \
--output <output_forder>
+-output <output_folder>
</code></pre>
</div>
-<p>By this command, the related metadata will be generated and its location is
under the directory <code
class="highlighter-rouge"><output_forder></code>. The details are as
follows, system_cube is our <code
class="highlighter-rouge"><output_forder></code>:</p>
+<p>By this command, the related metadata will be generated and its location is
under the directory <code
class="highlighter-rouge"><output_folder></code>. The details are as
follows, system_cube is our <code
class="highlighter-rouge"><output_folder></code>:</p>
<p><img src="/images/SystemCube/metadata.png" alt="metadata" /></p>
<h3 id="set-up-datasource">2. Set Up Datasource</h3>
<p>Running the following command to create source hive tables:</p>
-<div class="highlighter-rouge"><pre class="highlight"><code>hive -f
<output_forder>/create_hive_tables_for_system_cubes.sql
+<div class="highlighter-rouge"><pre class="highlight"><code>hive -f
<output_folder>/create_hive_tables_for_system_cubes.sql
</code></pre>
</div>
@@ -5869,7 +5869,7 @@ var _hmt = _hmt || [];
<h3 id="upload-metadata-for-system-cubes">3. Upload Metadata for System
Cubes</h3>
<p>Then we need to upload metadata to hbase by the following command:</p>
-<div class="highlighter-rouge"><pre class="highlight"><code>./bin/metastore.sh
restore <output_forder>
+<div class="highlighter-rouge"><pre class="highlight"><code>./bin/metastore.sh
restore <output_folder>
</code></pre>
</div>
@@ -6054,7 +6054,7 @@ sh ${KYLIN_HOME}/bin/kylin.sh org.apache
</tr>
<tr>
<td>MAX, SUM of COUNT_SKIP</td>
- <td>based on fuzzy filters or else, a few rows will be skiped. This
indicates the skipped row count</td>
+ <td>based on fuzzy filters or else, a few rows will be skipped. This
indicates the skipped row count</td>
</tr>
<tr>
<td>MAX, SUM of SIZE_SCAN</td>
@@ -6091,7 +6091,7 @@ sh ${KYLIN_HOME}/bin/kylin.sh org.apache
</tr>
<tr>
<td>CUBOID_TARGET</td>
- <td>target cuboid already precalculated and served for source cuboid</td>
+ <td>target cuboid already pre-calculated and served for source cuboid</td>
</tr>
<tr>
<td>IF_MATCH</td>
@@ -6201,7 +6201,7 @@ sh ${KYLIN_HOME}/bin/kylin.sh org.apache
</tr>
<tr>
<td>MIN, MAX, SUM of WAIT_RESOURCE_TIME</td>
- <td>a job may includes serveral MR(map reduce) jobs. Those MR jobs may
wait because of lack of Hadoop resources.</td>
+ <td>a job may includes several MR(map reduce) jobs. Those MR jobs may wait
because of lack of Hadoop resources.</td>
</tr>
</table>
Modified: kylin/site/docs/tutorial/squirrel.html
URL:
http://svn.apache.org/viewvc/kylin/site/docs/tutorial/squirrel.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/tutorial/squirrel.html (original)
+++ kylin/site/docs/tutorial/squirrel.html Sat Sep 22 14:08:04 2018
@@ -5866,7 +5866,7 @@ From Kylin Download, Choose Binary and t
<p><img src="/images/SQuirreL-Tutorial/14.png" alt="" /></p>
-<p>And automatically launch conection:</p>
+<p>And automatically launch connection:</p>
<p><img src="/images/SQuirreL-Tutorial/15.png" alt="" /></p>
@@ -5880,7 +5880,7 @@ From Kylin Download, Choose Binary and t
<p><img src="/images/SQuirreL-Tutorial/17.png" alt="" /></p>
-<div class="highlighter-rouge"><pre class="highlight"><code>select part_dt,
sum(price) as total_selled, count(distinct seller_id) as sellers
+<div class="highlighter-rouge"><pre class="highlight"><code>select part_dt,
sum(price) as total_sold, count(distinct seller_id) as sellers
from kylin_sales group by part_dt
order by part_dt
</code></pre>
Modified: kylin/site/docs/tutorial/tableau_91.html
URL:
http://svn.apache.org/viewvc/kylin/site/docs/tutorial/tableau_91.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/tutorial/tableau_91.html (original)
+++ kylin/site/docs/tutorial/tableau_91.html Sat Sep 22 14:08:04 2018
@@ -5835,7 +5835,7 @@ Please make sure to download and install
<img src="/images/tutorial/odbc/tableau_91/5.png" alt="" /></p>
<h3 id="visualization">Visualization</h3>
-<p>Now you can start to enjou analyzing with Tableau 9.1.<br />
+<p>Now you can start to enjoy analyzing with Tableau 9.1.<br />
<img src="/images/tutorial/odbc/tableau_91/6.png" alt="" /></p>
<h3 id="publish-to-tableau-server">Publish to Tableau Server</h3>
Modified: kylin/site/docs/tutorial/use_dashboard.html
URL:
http://svn.apache.org/viewvc/kylin/site/docs/tutorial/use_dashboard.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/tutorial/use_dashboard.html (original)
+++ kylin/site/docs/tutorial/use_dashboard.html Sat Sep 22 14:08:04 2018
@@ -5823,7 +5823,7 @@ var _hmt = _hmt || [];
<p>To enable Dashboard on WebUI, you need to ensure these are all set:<br />
* Set <strong>kylin.web.dashboard-enabled=true</strong> in
<strong>kylin.properties</strong>.<br />
-* Setup system Cubes according to <a
href="setup_systemcube.html">toturial</a>.</p>
+* Setup system Cubes according to <a
href="setup_systemcube.html">tutorial</a>.</p>
<h2 id="how-to-use-it">How to use it</h2>
@@ -5845,7 +5845,7 @@ var _hmt = _hmt || [];
<ul>
<li>
- <p>â<strong>Time period</strong>â is set deafult to <strong>âLast 7
Days</strong>â.</p>
+ <p>â<strong>Time period</strong>â is set default to <strong>âLast 7
Days</strong>â.</p>
</li>
<li>
<p>There are <strong>2</strong> ways to modify the time period, one is
<em>using standard time period</em>s and the other is <em>customizing your time
period</em>.</p>
@@ -5873,7 +5873,7 @@ var _hmt = _hmt || [];
<h4 id="step-3">Step 3:</h4>
-<p>Now the data analysis will be changed and shown on the same page.
(Important information has been pixilated.)</p>
+<p>Now the data analysis will be changed and shown on the same page.
(Important information has been pixelated.)</p>
<ul>
<li>
@@ -5884,7 +5884,7 @@ var _hmt = _hmt || [];
<li>
<p>Numbers in â<strong>Query Count</strong>â, â<strong>Average Query
Latency</strong>â, â<strong>Job Count</strong>â and â<strong>Average
Build Time per MB</strong>â are in <strong>Green</strong>.</p>
- <p>You can click on these four rectangles to get detail infomation about
the data you selected. The detail information will then be shown as diagrams
and displayed in â<strong>Data grouped by Project</strong>â and
â<strong>Data grouped by Time</strong>â boxes.</p>
+ <p>You can click on these four rectangles to get detail information about
the data you selected. The detail information will then be shown as diagrams
and displayed in â<strong>Data grouped by Project</strong>â and
â<strong>Data grouped by Time</strong>â boxes.</p>
<ol>
<li>
Modified: kylin/site/docs/tutorial/web.html
URL:
http://svn.apache.org/viewvc/kylin/site/docs/tutorial/web.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/tutorial/web.html (original)
+++ kylin/site/docs/tutorial/web.html Sat Sep 22 14:08:04 2018
@@ -5906,7 +5906,7 @@ Login with passwordï¼KYLIN</p>
<li>
<p>General Information:</p>
- <p>When the query execute success, it will present a success indictor and
also a cubeâs name which be hit. <br />
+ <p>When the query execute success, it will present a success indicator and
also a cubeâs name which be hit. <br />
Also it will present how long this query be executed in backend engine (not
cover network traffic from Kylin server to browser).</p>
<p><img src="/images/tutorial/1.5/Kylin-Web-Tutorial/12 general.png"
alt="" /></p>
Modified: kylin/site/feed.xml
URL:
http://svn.apache.org/viewvc/kylin/site/feed.xml?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/feed.xml (original)
+++ kylin/site/feed.xml Sat Sep 22 14:08:04 2018
@@ -19,8 +19,8 @@
<description>Apache Kylin Home</description>
<link>http://kylin.apache.org/</link>
<atom:link href="http://kylin.apache.org/feed.xml"; rel="self"
type="application/rss+xml"/>
- <pubDate>Thu, 20 Sep 2018 20:21:48 -0700</pubDate>
- <lastBuildDate>Thu, 20 Sep 2018 20:21:48 -0700</lastBuildDate>
+ <pubDate>Sat, 22 Sep 2018 06:59:19 -0700</pubDate>
+ <lastBuildDate>Sat, 22 Sep 2018 06:59:19 -0700</lastBuildDate>
<generator>Jekyll v2.5.3</generator>
<item>
@@ -98,9 +98,10 @@
<h3 id="the-all-in-spark-cubing-engine">The all-in-Spark
cubing engine</h3>
<p>Now Kylinâs Spark engine will run all distributed jobs in Spark,
including fetch distinct dimension values, converting cuboid files to HBase
HFile, merging segments, merging dictionaries, etc. The default configurations
are tuned so the user can get an out-of-box experience. The overall performance
with the previous version is close, but we assume Spark has more room to
improve. The related tasks are KYLIN-3427, KYLIN-3441, KYLIN-3442.</p>
-<p>There are also improvements in the job management. Now you can get
the job link on the web console once Spark starts to run. If you discard the
job, Kylin will kill the Spark job to release the resource in time. If Kylin is
restarted, it can resume from the previous job instead of resubmitting a new
job. <br />
-### MySQL as Kylin metastore<br />
-In the past, HBase is the only option for Kylin metadata. In some cases, this
is not applicable, for example using replicated HBase cluster for Kylinâs HA
(the replicated HBase is read only). Now we introduce the MySQL metastore to
fulfill such need. This function is in beta now. Check KYLIN-3488 for
more.</p>
+<p>There are also improvements in the job management. Now you can get
the job link on the web console once Spark starts to run. If you discard the
job, Kylin will kill the Spark job to release the resource in time. If Kylin is
restarted, it can resume from the previous job instead of resubmitting a new
job.</p>
+
+<h3 id="mysql-as-kylin-metastore">MySQL as Kylin
metastore</h3>
+<p>In the past, HBase is the only option for Kylin metadata. In some
cases, this is not applicable, for example using replicated HBase cluster for
Kylinâs HA (the replicated HBase is read only). Now we introduce the MySQL
metastore to fulfill such need. This function is in beta now. Check KYLIN-3488
for more.</p>
<h3 id="hybrid-model-web-gui">Hybrid model web GUI</h3>
<p>Hybrid is an advanced model for compositing multiple Cubes. It can be
used for the Cube schema change issue. This function had no GUI in the past so
only a small portion of Kylin users know it. Now we added the web GUI for it so
everyone can try it.</p>
Modified: kylin/site/index.html
URL:
http://svn.apache.org/viewvc/kylin/site/index.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/index.html (original)
+++ kylin/site/index.html Sat Sep 22 14:08:04 2018
@@ -5820,7 +5820,7 @@ var _hmt = _hmt || [];
<ol class="none-icon">
<li>
<span class="li-circle">1</span>
- Identify a Star/Snowfalke Schema on Hadoop.
+ Identify a Star/Snowflake Schema on Hadoop.
</li>
<li>
<span class="li-circle">2</span>
