Re: INTERSECT_VALUE函数支持问题

2020-04-16 Thread Yaqian Zhang 
Hi Ben:

As far as I know, the UDAF of intersect_value is not supported in kylin-3.0.1, 
this feature has not been released in the latest kylin version.

You can refer to this lira issue: 
https://issues.apache.org/jira/browse/KYLIN-4314 
. The commit of this issue 
has been merged to master branch.

If you want to use intersect_value, you can cherry-pick this commit and 
repackage.


> 在 2020年4月16日，15:12，Ben  写道：
> 
> Hi:
>   
> 首先非常感谢Kylin开发团队,向你们致以崇高敬意,感谢你们的辛苦和付出。本人也是kylin用户,最近在做用户画像相关的调研,准备用kylin来搞,现在遇到个问题,请教下:
> 
> kylin版本：apache-kylin-3.0.1-bin-cdh57
> 原由: 我们的user_tag是一张竖表,mid表示用户的唯一标识ID,tag_type表示标签,tag_value表示对应的value, 
> 可以通过INTERSECT_COUNT很方便的查出符合条件的用户数,现在我们想提取出符合条件的用户ID,用INTERSECT_VALUE函数好像不好使,我下载了最新的kylin源码,在master分支上看到BitmapIntersectValueAggFunc相关实现,不知道是不是INTERSECT_VALUE函数的支持,所以有点疑惑.还请解答下该版本是否支持INTERSECT_VALUE函数,如不支持,自定义UDAF函数的话有没有相关的参考资料.谢谢,非常期待您的回复.
> 
> 
>

Re: [Online Event] Introduction and Quick Start of Kylin on Parquet, April 18, 2020

2020-04-16 Thread ShaoFeng Shi 
Thank you Chunen! The new parquet storage is coming! This time it will be
introduced in Chinese for the local users. I hope soon we can hold another
session in English for global users. It won't be far!

Best regards,

Shaofeng Shi 史少锋
Apache Kylin PMC
Email: shaofeng...@apache.org

Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
Join Kylin user mail group: user-subscr...@kylin.apache.org
Join Kylin dev mail group: dev-subscr...@kylin.apache.org




Yaqian Zhang  于2020年4月16日周四 下午3:37写道：

> Long-awaited！
>
> > 在 2020年4月16日，15:01，George Ni  写道：
> >
> > Kylin users & developers,
> >
> >
> >
> > There will be an online Kylin event this Saturday (April 18). Kylin on
> > HBase has been mature for a long time, but there are still some
> > limitations. Engineers from Kyligence will share their new storage
> > solution, Kylin On Parquet.
> >
> >
> >
> > Date: April 18
> >
> > Time: 8:00 PM - 9:00 PM  (UTC+08:00)
> >
> > Language: Chinese (PPT will be in English)
> >
> > Activity form: live video streaming
> >
> > Fee: Free!
> >
> > Link for Registration:
> >
> https://mp.weixin.qq.com/s?__biz=MzAwODE3ODU5MA===2653079753=1=27986486a96aaa90af12b9469a63c2d6=80a4b638b7d33f2e40ea676f2aeda188712a06bb4ef7d3b9ec07a5f706c7429d307afedbd160=2112674860=zh_CN#rd
> >
> >
> >
> > -
> >
> > Best regards,
> >
> >
> >
> > Ni Chunen / George
>
>

INTERSECT_VALUE????????????

2020-04-16 Thread Ben 
Hi:
 
Kylin,??,??kylin,??,??kylin,??,??:


kylin??apache-kylin-3.0.1-bin-cdh57
: 
??user_tag??,mid??ID,tag_type,tag_value??value,
 
INTERSECT_COUNT,??ID,??INTERSECT_VALUE??,??kylin,??master??BitmapIntersectValueAggFunc,INTERSECT_VALUE??,.INTERSECT_VALUE,,??UDAF.,.

Error: java.io.IOException: SQLException in nextKeyValue

2020-04-16 Thread echosmh 
mapreduce.Job: Task Id : attempt_1586936546503_0011_m_01_2, Status :
FAILED
Error: java.io.IOException: SQLException in nextKeyValue
at
org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader.java:275)
at
org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:568)
at
org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContextImpl.java:80)
at
org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.nextKeyValue(WrappedMapper.java:91)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
at
org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:799)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:347)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:174)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1730)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:168)
Caused by: org.postgresql.util.PSQLException: ERROR: syntax error at or near
"".""
  Position: 377
at
org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2578)
at
org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2313)
at
org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:331)
at
org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:448)
at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:369)
at
org.postgresql.jdbc.PgPreparedStatement.executeWithFlags(PgPreparedStatement.java:159)
at
org.postgresql.jdbc.PgPreparedStatement.executeQuery(PgPreparedStatement.java:109)
at
org.apache.sqoop.mapreduce.db.DBRecordReader.executeQuery(DBRecordReader.java:109)
at
org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader.java:233)
... 12 more

--
Sent from: http://apache-kylin.74782.x6.nabble.com/

Kylin hybrid model only available in single node but rather than all nodes in cluster

2020-04-16 Thread yx91490 
Hi all:
   kylin version: 2.6.1~3.0.0
   I created an hybrid model in a node, but I can only query it in that node 
rather than all node in kylin cluster. any one can help me?

Re: [Online Event] Introduction and Quick Start of Kylin on Parquet, April 18, 2020

2020-04-16 Thread Yaqian Zhang 
Long-awaited！

> 在 2020年4月16日，15:01，George Ni  写道：
> 
> Kylin users & developers,
> 
> 
> 
> There will be an online Kylin event this Saturday (April 18). Kylin on
> HBase has been mature for a long time, but there are still some
> limitations. Engineers from Kyligence will share their new storage
> solution, Kylin On Parquet.
> 
> 
> 
> Date: April 18
> 
> Time: 8:00 PM - 9:00 PM  (UTC+08:00)
> 
> Language: Chinese (PPT will be in English)
> 
> Activity form: live video streaming
> 
> Fee: Free!
> 
> Link for Registration:
> https://mp.weixin.qq.com/s?__biz=MzAwODE3ODU5MA===2653079753=1=27986486a96aaa90af12b9469a63c2d6=80a4b638b7d33f2e40ea676f2aeda188712a06bb4ef7d3b9ec07a5f706c7429d307afedbd160=2112674860=zh_CN#rd
> 
> 
> 
> -
> 
> Best regards,
> 
> 
> 
> Ni Chunen / George

[Online Event] Introduction and Quick Start of Kylin on Parquet, April 18, 2020

2020-04-16 Thread George Ni 
Kylin users & developers,



There will be an online Kylin event this Saturday (April 18). Kylin on
HBase has been mature for a long time, but there are still some
limitations. Engineers from Kyligence will share their new storage
solution, Kylin On Parquet.



Date: April 18

Time: 8:00 PM - 9:00 PM  (UTC+08:00)

Language: Chinese (PPT will be in English)

Activity form: live video streaming

Fee: Free!

Link for Registration:
https://mp.weixin.qq.com/s?__biz=MzAwODE3ODU5MA===2653079753=1=27986486a96aaa90af12b9469a63c2d6=80a4b638b7d33f2e40ea676f2aeda188712a06bb4ef7d3b9ec07a5f706c7429d307afedbd160=2112674860=zh_CN#rd



 -

Best regards,



Ni Chunen / George

RE: Kylin 3.0 - Need some help - Can't open the Kylin UI

2020-04-16 Thread Xiaoxiang Yu 
Hi friend,
I can felt your pain, but please be patient. 
In my opinion, to make good use of Apache Kylin, or any other complex 
system, some prerequisites should be met. Firstly, I think understanding 
Kylin's overall architecture, some knowledge of analysing 
logs(kylin.log/kylin.out) of Kylin are very important, only in this way you can 
narrow down the problem you faced.  After problem was identified, if you have 
some knowledge of how to manipulate Hadoop components: such as Apache HBase, 
Apache HDFS and Apache Hive, I think you can fix problem yourself or ask for 
assistance from community. Hortonworks have provided some documentation which 
looks good to 
me(https://docs.cloudera.com/HDPDocuments/HDP3/HDP-3.1.0/starting-hive/content/hive_start_a_command_line_query_locally.html),
 maybe you can have a try.


Besides, did you ever try to use docker image to start kylin in one 
command? It will give you a learning env without any Hadoop cluster.  I think 
it works well in my laptop(Macbook Pro,15 inch with the latest Docker Desktop 
installed), here is the link, 
https://hub.docker.com/r/apachekylin/apache-kylin-standalone













--

Best wishes to you ! 
From ：Xiaoxiang Yu





At 2020-04-15 21:46:49, "Phillip Poirier"  wrote:
>Not that misery always loves company, but I had the previous Kylin version
>and was trying to use it with the Hortonworks 2.0 distro, and even though I
>could eventually get the service to start, the UI would never launch.  The
>few people that responded to me told me to try things I already tried (like
>try a different URL or try using different browsers) and it never worked.
>As someone who's spent decades working in BI and OLAP (especially in SSAS,
>Essbase and TM1) I too was very interested in trying Kylin as a big data
>OLAP option and even took the Udemy course on it.  Unfortunately, I just had
>to sit and watch as the course instructor performed cube-building tasks as I
>was never able to get the UI to launch.
>
> 
>
>If you get a real answer to this issue, I'd like to try again.  I have the
>Hortonworks 3.0 distro now, and would like to try the new version of Kylin,
>if possible.  If not, I'll take a look at Druid.
>
> 
>
>Good luck.
>
> 
>
>-Phil
>
> 
>
>From: Rubio Piqueras, David [mailto:david.ru...@gft.com] 
>Sent: Tuesday, April 14, 2020 11:58 AM
>To: dev@kylin.apache.org
>Subject: Kylin 3.0 - Need some help - Can't open the Kylin UI
>
> 
>
>Hi guys,
>
> 
>
>Just starting using Kylin too which looks so interesting.
>
>We downloaded your Kylin 3.0 image version:
>
> 
>
>
>
>However, I can't open the Kylin UI anytime I try to open it. Checking the
>logs, this is what we are seeing:
>
> 
>
>2020-04-14 13:58:23,853 INFO  [main-SendThread(localhost:2181)]
>zookeeper.ClientCnxn:1235 : Session establishment complete on server
>localhost/127.0.0.1:2181, sessionid = 0x17178f6fbd6000a, negotiated timeout
>= 4
>
>Exception in thread "main" java.lang.IllegalArgumentException: Failed to
>find metadata store by url: kylin_metadata@hbase
>
>at
>org.apache.kylin.common.persistence.ResourceStore.createResourceStore(Resour
>ceStore.java:101)
>
>at
>org.apache.kylin.common.persistence.ResourceStore.getStore(ResourceStore.jav
>a:113)
>
>at
>org.apache.kylin.rest.service.AclTableMigrationTool.checkIfNeedMigrate(AclTa
>bleMigrationTool.java:99)
>
>at
>org.apache.kylin.tool.AclTableMigrationCLI.main(AclTableMigrationCLI.java:43
>)
>
>Caused by: java.lang.reflect.InvocationTargetException
>
>at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
>Method)
>
>at
>sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAcces
>sorImpl.java:62)
>
>at
>sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstruc
>torAccessorImpl.java:45)
>
>at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
>
>at
>org.apache.kylin.common.persistence.ResourceStore.createResourceStore(Resour
>ceStore.java:94)
>
>... 3 more
>
>Caused by: org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed
>after attempts=1, exceptions:
>
>Tue Apr 14 13:58:24 UTC 2020,
>RpcRetryingCaller{globalStartTime=1586872703980, pause=100, retries=1},
>java.net.ConnectException: Connection refused
>
> 
>
>at
>org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetrying
>Caller.java:147)
>
>at
>org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture
>.run(ResultBoundedCompletionService.java:64)
>
>at
>java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:11
>49)
>
>at
>java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:6
>24)
>
>at java.lang.Thread.run(Thread.java:748)
>
>Caused by: java.net.ConnectException: Connection refused
>
>at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>
>at