Author: lidong Date: Thu May 14 14:14:16 2020 New Revision: 1877742 URL: http://svn.apache.org/viewvc?rev=1877742&view=rev Log: Remove unnecessary extra characters
Modified: kylin/site/cn/docs/tutorial/cube_spark.html kylin/site/cn/docs/tutorial/sql_reference.html kylin/site/cn/docs30/tutorial/cube_spark.html kylin/site/cn/docs30/tutorial/sql_reference.html kylin/site/cn/docs31/tutorial/cube_spark.html kylin/site/cn/docs31/tutorial/sql_reference.html kylin/site/feed.xml Modified: kylin/site/cn/docs/tutorial/cube_spark.html URL: http://svn.apache.org/viewvc/kylin/site/cn/docs/tutorial/cube_spark.html?rev=1877742&r1=1877741&r2=1877742&view=diff ============================================================================== --- kylin/site/cn/docs/tutorial/cube_spark.html (original) +++ kylin/site/cn/docs/tutorial/cube_spark.html Thu May 14 14:14:16 2020 @@ -284,7 +284,24 @@ $KYLIN_HOME/bin/kylin.sh start</code></p <p>æææ¥éª¤æåæ§è¡åï¼Cube çç¶æå为 âReadyâ ä¸æ¨å¯ä»¥åå¾å¸¸é£æ ·è¿è¡æ¥è¯¢ã</p> -<h2 id="section-1">çé¾è§£ç</h2> +<h2 id="apache-livyspark">éè¿Apache Livy使ç¨Spark</h2> +<p>å¼å¯ä½¿ç¨Livyéè¦ä¿®æ¹å¦ä¸é ç½®ï¼</p> + +<div class="highlight"><pre><code class="language-groff" data-lang="groff">kylin.engine.livy-conf.livy-enabled=true +kylin.engine.livy-conf.livy-url=http://ip:8998 +kylin.engine.livy-conf.livy-key.file=hdfs:///path/kylin-job-3.0.0-SNAPSHOT.jar +kylin.engine.livy-conf.livy-arr.jars=hdfs:///path/hbase-client-1.2.0-{$env.version}.jar,hdfs:///path/hbase-common-1.2.0-{$env.version}.jar,hdfs:///path/hbase-hadoop-compat-1.2.0-{$env.version}.jar,hdfs:///path/hbase-hadoop2-compat-1.2.0-{$env.version}.jar,hdfs:///path/hbase-server-1.2.0-{$env.version}.jar,hdfs:///path/htrace-core-3.2.0-incubating.jar,hdfs:///path/metrics-core-2.2.0.jar</code></pre></div> + +<p>éè¦æ³¨æçæ¯jarå è·¯å¾ä¹é´ä¸è½åå¨ç©ºæ ¼ã</p> + +<h2 id="section-1">å¯éåè½</h2> + +<p>ç°å¨æ建æ¥éª¤ä¸çâextract fact table distinct valueâ å âbuild dimension dictionaryâ 两个æ¥éª¤ä¹å¯ä»¥ä½¿ç¨Sparkè¿è¡æ建äºãç¸å ³çé ç½®å¦ä¸ï¼</p> + +<div class="highlight"><pre><code class="language-groff" data-lang="groff">kylin.engine.spark-fact-distinct=true +kylin.engine.spark-dimension-dictionary=true</code></pre></div> + +<h2 id="section-2">çé¾è§£ç</h2> <p>å½åºç° errorï¼æ¨å¯ä»¥é¦å æ¥ç âlogs/kylin.logâ. å ¶ä¸å å« Kylin æ§è¡çææ Spark å½ä»¤ï¼ä¾å¦:</p> @@ -320,7 +337,7 @@ Caused by: java.util.NoSuchElementExcept <p>解å³åæ³æ¯: å° <code class="highlighter-rouge">hbase-hadoop2-compat-*.jar</code> å <code class="highlighter-rouge">hbase-hadoop-compat-*.jar</code> æ·è´å° <code class="highlighter-rouge">$KYLIN_HOME/spark/jars</code> ç®å½ä¸ (è¿ä¸¤ä¸ª jar æ件å¯ä»¥ä» HBase ç lib ç®å½æ¾å°); å¦æä½ å·²ç»çæäº Spark assembly jar 并ä¸ä¼ å°äº HDFS, é£ä¹ä½ éè¦éæ°æå ä¸ä¼ ãå¨è¿ä¹åï¼éè¯å¤±è´¥ç cube ä»»å¡ï¼åºè¯¥å°±å¯ä»¥æåäºãç¸å ³ç JIRA issue æ¯ KYLIN-3607ï¼ä¼å¨æªæ¥çæ¬ä¿®å¤.</p> -<h2 id="section-2">è¿ä¸æ¥</h2> +<h2 id="section-3">è¿ä¸æ¥</h2> <p>å¦ææ¨æ¯ Kylin ç管çåä½æ¯å¯¹äº Spark æ¯æ°æï¼å»ºè®®æ¨æµè§ <a href="https://spark.apache.org/docs/2.1.2/">Spark ææ¡£</a>ï¼å«å¿è®°ç¸åºå°å»æ´æ°é ç½®ãæ¨å¯ä»¥å¼å¯ Spark ç <a href="https://spark.apache.org/docs/2.1.2/job-scheduling.html#dynamic-resource-allocation">Dynamic Resource Allocation</a> ï¼ä»¥ä¾¿å ¶å¯¹äºä¸åçå·¥ä½è´è½½è½èªå¨ä¼¸ç¼©ãSpark æ§è½ä¾èµäºé群çå åå CPU èµæºï¼å½æå¤ææ°æ®æ¨¡åå巨大çæ°æ®éä¸æ¬¡æå»ºæ¶ Kylin ç Cube æ建å°ä¼æ¯ä¸é¡¹ç¹éçä»»å¡ãå¦ææ¨çé群èµæºä¸è½å¤æ§è¡ï¼Spark executors å°±ä¼ æåºå¦ âOutOfMemorryâ è¿æ ·çé误ï¼å æ¤è¯·åçç使ç¨ã对äºæ UHC dimensionï¼è¿å¤ç»å (ä¾å¦ï¼ä¸ä¸ª cube è¶ è¿ 12 dimensions)ï¼æèå°½å åç度é (Count Distinctï¼Top-N) ç Cubeï¼å»ºè®®æ¨ä½¿ç¨ MapReduce engineãå¦ææ¨ç Cube 模åè¾ä¸ºç®åï¼ææ度éé½æ¯ SUM/MIN/MAX/COUNTï¼æºæ°æ®è§æ¨¡å°è³ä¸çï¼Spark engine å°ä¼æ¯ä¸ªå¥½çéæ©ã</p> Modified: kylin/site/cn/docs/tutorial/sql_reference.html URL: http://svn.apache.org/viewvc/kylin/site/cn/docs/tutorial/sql_reference.html?rev=1877742&r1=1877741&r2=1877742&view=diff ============================================================================== --- kylin/site/cn/docs/tutorial/sql_reference.html (original) +++ kylin/site/cn/docs/tutorial/sql_reference.html Thu May 14 14:14:16 2020 @@ -354,7 +354,7 @@ SELECT lstg_format_name, SUM(price) AS g <p>å¨è¡¨ä¸åå¨è³å°ä¸ä¸ªå¹é æ¶ï¼<code class="highlighter-rouge">INNER JOIN</code> å ³é®åè¿åè¡ã<br /> ä¾åï¼</p> -<div class="highlight"><pre><code class="language-groff" data-lang="groff">SELECT kylin_cal_dt.cal_dt, kylin_sales.price FROM kylin_sales INNER JOIN kylin_cal_dt AS kylin_cal_dt ON kylin_sales.part_dt**** = kylin_cal_dt.cal_dt;</code></pre></div> +<div class="highlight"><pre><code class="language-groff" data-lang="groff">SELECT kylin_cal_dt.cal_dt, kylin_sales.price FROM kylin_sales INNER JOIN kylin_cal_dt AS kylin_cal_dt ON kylin_sales.part_dt = kylin_cal_dt.cal_dt;</code></pre></div> <h3 id="LEFTJOIN">LEFT JOIN</h3> <p>ä½¿ç¨ <code class="highlighter-rouge">LEFT JOIN</code> å ³é®åä¼ä»å·¦è¡¨ (kylin_sales) é£éè¿åææçè¡ï¼å³ä½¿å¨å³è¡¨ (kylin_category_groupings) ä¸æ²¡æå¹é çè¡ã<br /> Modified: kylin/site/cn/docs30/tutorial/cube_spark.html URL: http://svn.apache.org/viewvc/kylin/site/cn/docs30/tutorial/cube_spark.html?rev=1877742&r1=1877741&r2=1877742&view=diff ============================================================================== --- kylin/site/cn/docs30/tutorial/cube_spark.html (original) +++ kylin/site/cn/docs30/tutorial/cube_spark.html Thu May 14 14:14:16 2020 @@ -284,7 +284,24 @@ $KYLIN_HOME/bin/kylin.sh start</code></p <p>æææ¥éª¤æåæ§è¡åï¼Cube çç¶æå为 âReadyâ ä¸æ¨å¯ä»¥åå¾å¸¸é£æ ·è¿è¡æ¥è¯¢ã</p> -<h2 id="section-1">çé¾è§£ç</h2> +<h2 id="apache-livyspark">éè¿Apache Livy使ç¨Spark</h2> +<p>å¼å¯ä½¿ç¨Livyéè¦ä¿®æ¹å¦ä¸é ç½®ï¼</p> + +<div class="highlight"><pre><code class="language-groff" data-lang="groff">kylin.engine.livy-conf.livy-enabled=true +kylin.engine.livy-conf.livy-url=http://ip:8998 +kylin.engine.livy-conf.livy-key.file=hdfs:///path/kylin-job-3.0.0-SNAPSHOT.jar +kylin.engine.livy-conf.livy-arr.jars=hdfs:///path/hbase-client-1.2.0-{$env.version}.jar,hdfs:///path/hbase-common-1.2.0-{$env.version}.jar,hdfs:///path/hbase-hadoop-compat-1.2.0-{$env.version}.jar,hdfs:///path/hbase-hadoop2-compat-1.2.0-{$env.version}.jar,hdfs:///path/hbase-server-1.2.0-{$env.version}.jar,hdfs:///path/htrace-core-3.2.0-incubating.jar,hdfs:///path/metrics-core-2.2.0.jar</code></pre></div> + +<p>éè¦æ³¨æçæ¯jarå è·¯å¾ä¹é´ä¸è½åå¨ç©ºæ ¼ã</p> + +<h2 id="section-1">å¯éåè½</h2> + +<p>ç°å¨æ建æ¥éª¤ä¸çâextract fact table distinct valueâ å âbuild dimension dictionaryâ 两个æ¥éª¤ä¹å¯ä»¥ä½¿ç¨Sparkè¿è¡æ建äºãç¸å ³çé ç½®å¦ä¸ï¼</p> + +<div class="highlight"><pre><code class="language-groff" data-lang="groff">kylin.engine.spark-fact-distinct=true +kylin.engine.spark-dimension-dictionary=true</code></pre></div> + +<h2 id="section-2">çé¾è§£ç</h2> <p>å½åºç° errorï¼æ¨å¯ä»¥é¦å æ¥ç âlogs/kylin.logâ. å ¶ä¸å å« Kylin æ§è¡çææ Spark å½ä»¤ï¼ä¾å¦:</p> @@ -320,7 +337,7 @@ Caused by: java.util.NoSuchElementExcept <p>解å³åæ³æ¯: å° <code class="highlighter-rouge">hbase-hadoop2-compat-*.jar</code> å <code class="highlighter-rouge">hbase-hadoop-compat-*.jar</code> æ·è´å° <code class="highlighter-rouge">$KYLIN_HOME/spark/jars</code> ç®å½ä¸ (è¿ä¸¤ä¸ª jar æ件å¯ä»¥ä» HBase ç lib ç®å½æ¾å°); å¦æä½ å·²ç»çæäº Spark assembly jar 并ä¸ä¼ å°äº HDFS, é£ä¹ä½ éè¦éæ°æå ä¸ä¼ ãå¨è¿ä¹åï¼éè¯å¤±è´¥ç cube ä»»å¡ï¼åºè¯¥å°±å¯ä»¥æåäºãç¸å ³ç JIRA issue æ¯ KYLIN-3607ï¼ä¼å¨æªæ¥çæ¬ä¿®å¤.</p> -<h2 id="section-2">è¿ä¸æ¥</h2> +<h2 id="section-3">è¿ä¸æ¥</h2> <p>å¦ææ¨æ¯ Kylin ç管çåä½æ¯å¯¹äº Spark æ¯æ°æï¼å»ºè®®æ¨æµè§ <a href="https://spark.apache.org/docs/2.1.2/">Spark ææ¡£</a>ï¼å«å¿è®°ç¸åºå°å»æ´æ°é ç½®ãæ¨å¯ä»¥å¼å¯ Spark ç <a href="https://spark.apache.org/docs/2.1.2/job-scheduling.html#dynamic-resource-allocation">Dynamic Resource Allocation</a> ï¼ä»¥ä¾¿å ¶å¯¹äºä¸åçå·¥ä½è´è½½è½èªå¨ä¼¸ç¼©ãSpark æ§è½ä¾èµäºé群çå åå CPU èµæºï¼å½æå¤ææ°æ®æ¨¡åå巨大çæ°æ®éä¸æ¬¡æå»ºæ¶ Kylin ç Cube æ建å°ä¼æ¯ä¸é¡¹ç¹éçä»»å¡ãå¦ææ¨çé群èµæºä¸è½å¤æ§è¡ï¼Spark executors å°±ä¼ æåºå¦ âOutOfMemorryâ è¿æ ·çé误ï¼å æ¤è¯·åçç使ç¨ã对äºæ UHC dimensionï¼è¿å¤ç»å (ä¾å¦ï¼ä¸ä¸ª cube è¶ è¿ 12 dimensions)ï¼æèå°½å åç度é (Count Distinctï¼Top-N) ç Cubeï¼å»ºè®®æ¨ä½¿ç¨ MapReduce engineãå¦ææ¨ç Cube 模åè¾ä¸ºç®åï¼ææ度éé½æ¯ SUM/MIN/MAX/COUNTï¼æºæ°æ®è§æ¨¡å°è³ä¸çï¼Spark engine å°ä¼æ¯ä¸ªå¥½çéæ©ã</p> Modified: kylin/site/cn/docs30/tutorial/sql_reference.html URL: http://svn.apache.org/viewvc/kylin/site/cn/docs30/tutorial/sql_reference.html?rev=1877742&r1=1877741&r2=1877742&view=diff ============================================================================== --- kylin/site/cn/docs30/tutorial/sql_reference.html (original) +++ kylin/site/cn/docs30/tutorial/sql_reference.html Thu May 14 14:14:16 2020 @@ -354,7 +354,7 @@ SELECT lstg_format_name, SUM(price) AS g <p>å¨è¡¨ä¸åå¨è³å°ä¸ä¸ªå¹é æ¶ï¼<code class="highlighter-rouge">INNER JOIN</code> å ³é®åè¿åè¡ã<br /> ä¾åï¼</p> -<div class="highlight"><pre><code class="language-groff" data-lang="groff">SELECT kylin_cal_dt.cal_dt, kylin_sales.price FROM kylin_sales INNER JOIN kylin_cal_dt AS kylin_cal_dt ON kylin_sales.part_dt**** = kylin_cal_dt.cal_dt;</code></pre></div> +<div class="highlight"><pre><code class="language-groff" data-lang="groff">SELECT kylin_cal_dt.cal_dt, kylin_sales.price FROM kylin_sales INNER JOIN kylin_cal_dt AS kylin_cal_dt ON kylin_sales.part_dt = kylin_cal_dt.cal_dt;</code></pre></div> <h3 id="LEFTJOIN">LEFT JOIN</h3> <p>ä½¿ç¨ <code class="highlighter-rouge">LEFT JOIN</code> å ³é®åä¼ä»å·¦è¡¨ (kylin_sales) é£éè¿åææçè¡ï¼å³ä½¿å¨å³è¡¨ (kylin_category_groupings) ä¸æ²¡æå¹é çè¡ã<br /> Modified: kylin/site/cn/docs31/tutorial/cube_spark.html URL: http://svn.apache.org/viewvc/kylin/site/cn/docs31/tutorial/cube_spark.html?rev=1877742&r1=1877741&r2=1877742&view=diff ============================================================================== --- kylin/site/cn/docs31/tutorial/cube_spark.html (original) +++ kylin/site/cn/docs31/tutorial/cube_spark.html Thu May 14 14:14:16 2020 @@ -284,7 +284,24 @@ $KYLIN_HOME/bin/kylin.sh start</code></p <p>æææ¥éª¤æåæ§è¡åï¼Cube çç¶æå为 âReadyâ ä¸æ¨å¯ä»¥åå¾å¸¸é£æ ·è¿è¡æ¥è¯¢ã</p> -<h2 id="section-1">çé¾è§£ç</h2> +<h2 id="apache-livyspark">éè¿Apache Livy使ç¨Spark</h2> +<p>å¼å¯ä½¿ç¨Livyéè¦ä¿®æ¹å¦ä¸é ç½®ï¼</p> + +<div class="highlight"><pre><code class="language-groff" data-lang="groff">kylin.engine.livy-conf.livy-enabled=true +kylin.engine.livy-conf.livy-url=http://ip:8998 +kylin.engine.livy-conf.livy-key.file=hdfs:///path/kylin-job-3.0.0-SNAPSHOT.jar +kylin.engine.livy-conf.livy-arr.jars=hdfs:///path/hbase-client-1.2.0-{$env.version}.jar,hdfs:///path/hbase-common-1.2.0-{$env.version}.jar,hdfs:///path/hbase-hadoop-compat-1.2.0-{$env.version}.jar,hdfs:///path/hbase-hadoop2-compat-1.2.0-{$env.version}.jar,hdfs:///path/hbase-server-1.2.0-{$env.version}.jar,hdfs:///path/htrace-core-3.2.0-incubating.jar,hdfs:///path/metrics-core-2.2.0.jar</code></pre></div> + +<p>éè¦æ³¨æçæ¯jarå è·¯å¾ä¹é´ä¸è½åå¨ç©ºæ ¼ã</p> + +<h2 id="section-1">å¯éåè½</h2> + +<p>ç°å¨æ建æ¥éª¤ä¸çâextract fact table distinct valueâ å âbuild dimension dictionaryâ 两个æ¥éª¤ä¹å¯ä»¥ä½¿ç¨Sparkè¿è¡æ建äºãç¸å ³çé ç½®å¦ä¸ï¼</p> + +<div class="highlight"><pre><code class="language-groff" data-lang="groff">kylin.engine.spark-fact-distinct=true +kylin.engine.spark-dimension-dictionary=true</code></pre></div> + +<h2 id="section-2">çé¾è§£ç</h2> <p>å½åºç° errorï¼æ¨å¯ä»¥é¦å æ¥ç âlogs/kylin.logâ. å ¶ä¸å å« Kylin æ§è¡çææ Spark å½ä»¤ï¼ä¾å¦:</p> @@ -320,7 +337,7 @@ Caused by: java.util.NoSuchElementExcept <p>解å³åæ³æ¯: å° <code class="highlighter-rouge">hbase-hadoop2-compat-*.jar</code> å <code class="highlighter-rouge">hbase-hadoop-compat-*.jar</code> æ·è´å° <code class="highlighter-rouge">$KYLIN_HOME/spark/jars</code> ç®å½ä¸ (è¿ä¸¤ä¸ª jar æ件å¯ä»¥ä» HBase ç lib ç®å½æ¾å°); å¦æä½ å·²ç»çæäº Spark assembly jar 并ä¸ä¼ å°äº HDFS, é£ä¹ä½ éè¦éæ°æå ä¸ä¼ ãå¨è¿ä¹åï¼éè¯å¤±è´¥ç cube ä»»å¡ï¼åºè¯¥å°±å¯ä»¥æåäºãç¸å ³ç JIRA issue æ¯ KYLIN-3607ï¼ä¼å¨æªæ¥çæ¬ä¿®å¤.</p> -<h2 id="section-2">è¿ä¸æ¥</h2> +<h2 id="section-3">è¿ä¸æ¥</h2> <p>å¦ææ¨æ¯ Kylin ç管çåä½æ¯å¯¹äº Spark æ¯æ°æï¼å»ºè®®æ¨æµè§ <a href="https://spark.apache.org/docs/2.1.2/">Spark ææ¡£</a>ï¼å«å¿è®°ç¸åºå°å»æ´æ°é ç½®ãæ¨å¯ä»¥å¼å¯ Spark ç <a href="https://spark.apache.org/docs/2.1.2/job-scheduling.html#dynamic-resource-allocation">Dynamic Resource Allocation</a> ï¼ä»¥ä¾¿å ¶å¯¹äºä¸åçå·¥ä½è´è½½è½èªå¨ä¼¸ç¼©ãSpark æ§è½ä¾èµäºé群çå åå CPU èµæºï¼å½æå¤ææ°æ®æ¨¡åå巨大çæ°æ®éä¸æ¬¡æå»ºæ¶ Kylin ç Cube æ建å°ä¼æ¯ä¸é¡¹ç¹éçä»»å¡ãå¦ææ¨çé群èµæºä¸è½å¤æ§è¡ï¼Spark executors å°±ä¼ æåºå¦ âOutOfMemorryâ è¿æ ·çé误ï¼å æ¤è¯·åçç使ç¨ã对äºæ UHC dimensionï¼è¿å¤ç»å (ä¾å¦ï¼ä¸ä¸ª cube è¶ è¿ 12 dimensions)ï¼æèå°½å åç度é (Count Distinctï¼Top-N) ç Cubeï¼å»ºè®®æ¨ä½¿ç¨ MapReduce engineãå¦ææ¨ç Cube 模åè¾ä¸ºç®åï¼ææ度éé½æ¯ SUM/MIN/MAX/COUNTï¼æºæ°æ®è§æ¨¡å°è³ä¸çï¼Spark engine å°ä¼æ¯ä¸ªå¥½çéæ©ã</p> Modified: kylin/site/cn/docs31/tutorial/sql_reference.html URL: http://svn.apache.org/viewvc/kylin/site/cn/docs31/tutorial/sql_reference.html?rev=1877742&r1=1877741&r2=1877742&view=diff ============================================================================== --- kylin/site/cn/docs31/tutorial/sql_reference.html (original) +++ kylin/site/cn/docs31/tutorial/sql_reference.html Thu May 14 14:14:16 2020 @@ -354,7 +354,7 @@ SELECT lstg_format_name, SUM(price) AS g <p>å¨è¡¨ä¸åå¨è³å°ä¸ä¸ªå¹é æ¶ï¼<code class="highlighter-rouge">INNER JOIN</code> å ³é®åè¿åè¡ã<br /> ä¾åï¼</p> -<div class="highlight"><pre><code class="language-groff" data-lang="groff">SELECT kylin_cal_dt.cal_dt, kylin_sales.price FROM kylin_sales INNER JOIN kylin_cal_dt AS kylin_cal_dt ON kylin_sales.part_dt**** = kylin_cal_dt.cal_dt;</code></pre></div> +<div class="highlight"><pre><code class="language-groff" data-lang="groff">SELECT kylin_cal_dt.cal_dt, kylin_sales.price FROM kylin_sales INNER JOIN kylin_cal_dt AS kylin_cal_dt ON kylin_sales.part_dt = kylin_cal_dt.cal_dt;</code></pre></div> <h3 id="LEFTJOIN">LEFT JOIN</h3> <p>ä½¿ç¨ <code class="highlighter-rouge">LEFT JOIN</code> å ³é®åä¼ä»å·¦è¡¨ (kylin_sales) é£éè¿åææçè¡ï¼å³ä½¿å¨å³è¡¨ (kylin_category_groupings) ä¸æ²¡æå¹é çè¡ã<br /> Modified: kylin/site/feed.xml URL: http://svn.apache.org/viewvc/kylin/site/feed.xml?rev=1877742&r1=1877741&r2=1877742&view=diff ============================================================================== --- kylin/site/feed.xml (original) +++ kylin/site/feed.xml Thu May 14 14:14:16 2020 @@ -19,8 +19,8 @@ <description>Apache Kylin Home</description> <link>http://kylin.apache.org/</link> <atom:link href="http://kylin.apache.org/feed.xml" rel="self" type="application/rss+xml"/> - <pubDate>Tue, 05 May 2020 18:57:01 -0700</pubDate> - <lastBuildDate>Tue, 05 May 2020 18:57:01 -0700</lastBuildDate> + <pubDate>Thu, 14 May 2020 06:59:11 -0700</pubDate> + <lastBuildDate>Thu, 14 May 2020 06:59:11 -0700</lastBuildDate> <generator>Jekyll v2.5.3</generator> <item>