[GitHub] asfgit commented on issue #193: Minor, fix rat check failed
asfgit commented on issue #193: Minor, fix rat check failed URL: https://github.com/apache/kylin/pull/193#issuecomment-411652725 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] Wayne1c opened a new pull request #193: Minor, fix rat check failed
Wayne1c opened a new pull request #193: Minor, fix rat check failed URL: https://github.com/apache/kylin/pull/193 This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
Re: 求助：kylin 返回 localhost:18032 failed错误
Can you disable kylin.storage.hbase.compression-codec in kylin.properties and check once. If this doesn't help you, please check and share the error logs from kylin log file. Regards, Ashsih On Wed, Aug 8, 2018 at 1:48 PM, Zhixiong Chen wrote: > Hi: > 非常非常感谢您的回复，我按您的方式，把这些都做了配置，包括环境变量，配置如下： > > > yarn.app.mapreduce.am.env > HADOOP_MAPRED_HOME=/bigdata/tools/hadoop-2.7.3 > > > > mapreduce.map.env > HADOOP_MAPRED_HOME=/bigdata/tools/hadoop-2.7.3 > > > > mapreduce.reduce.env > HADOOP_MAPRED_HOME=/bigdata/tools/hadoop-2.7.3 > > > yarn.app.mapreduce.am.admin.user.env > LD_LIBRARY_PATH=$HADOOP_COMMON_HOME/lib/native: > $JAVA_LIBRARY_PATH > > > 另外，还将yarn.resourcemanager.address信息添加到了kylin_job_conf. > xml这个文件中，原来Cube创建只能执行到第三步就报错，此时可以执行到第十步， 但此问题还是依然存在，只是之前在第三步#3 Step Name: > Extract Fact Table Distinct Columns时报错，现在第十步又报同样的错误#10 Step Name: Build > Cube In-Mem Duration: 20.19 mins Waiting: 0 seconds：， 请协助一下，我们万分感激！#10 Step > Name: Build Cube In-Mem Duration: 20.19 mins Waiting: 0 seconds的错误信息如下： > > > java.net.ConnectException: Call From hsmaster/10.9.0.86 to > localhost:18032 failed on connection exception: java.net.ConnectException: > Connection refused; For more details see: http://wiki.apache.org/hadoop/ > ConnectionRefused > at sun.reflect.GeneratedConstructorAccessor76.newInstance(Unknown > Source) > at sun.reflect.DelegatingConstructorAccessorImpl.newInstance( > DelegatingConstructorAccessorImpl.java:45) > at java.lang.reflect.Constructor.newInstance(Constructor.java:423) > at org.apache.hadoop.net.NetUtils.wrapWithMessage( > NetUtils.java:792) > at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:732) > at org.apache.hadoop.ipc.Client.call(Client.java:1479) > at org.apache.hadoop.ipc.Client.call(Client.java:1412) > at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker. > invoke(ProtobufRpcEngine.java:229) > at com.sun.proxy.$Proxy66.getNewApplication(Unknown Source) > at org.apache.hadoop.yarn.api.impl.pb.client. > ApplicationClientProtocolPBClientImpl.getNewApplication( > ApplicationClientProtocolPBClientImpl.java:221) > at sun.reflect.GeneratedMethodAccessor108.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke( > DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod( > RetryInvocationHandler.java:191) > at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke( > RetryInvocationHandler.java:102) > at com.sun.proxy.$Proxy67.getNewApplication(Unknown Source) > at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl. > getNewApplication(YarnClientImpl.java:219) > at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl. > createApplication(YarnClientImpl.java:227) > at org.apache.hadoop.mapred.ResourceMgrDelegate.getNewJobID( > ResourceMgrDelegate.java:187) > at org.apache.hadoop.mapred.YARNRunner.getNewJobID( > YARNRunner.java:231) > at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal( > JobSubmitter.java:153) > at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290) > at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at org.apache.hadoop.security.UserGroupInformation.doAs( > UserGroupInformation.java:1698) > at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287) > at org.apache.kylin.engine.mr.common.AbstractHadoopJob. > waitForCompletion(AbstractHadoopJob.java:175) > at org.apache.kylin.engine.mr.steps.InMemCuboidJob.run( > InMemCuboidJob.java:121) > at org.apache.kylin.engine.mr.common.MapReduceExecutable. > doWork(MapReduceExecutable.java:130) > at org.apache.kylin.job.execution.AbstractExecutable. > execute(AbstractExecutable.java:162) > at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork( > DefaultChainedExecutable.java:67) > at org.apache.kylin.job.execution.AbstractExecutable. > execute(AbstractExecutable.java:162) > at org.apache.kylin.job.impl.threadpool.DefaultScheduler$ > JobRunner.run(DefaultScheduler.java:300) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1142) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:748) > Caused by: java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) > at sun.nio.ch.SocketChannelImpl.finishConnect( > SocketChannelImpl.java:717) > at org.apache.hadoop.net.SocketIOWithTimeout.connect( > SocketIOWithTimeout.java:206) > at org.apache.hadoop.net.NetUtils.connect(
Re: 求助：kylin 返回 localhost:18032 failed错误
Hi: 非常非常感谢您的回复，我按您的方式，把这些都做了配置，包括环境变量，配置如下： yarn.app.mapreduce.am.env HADOOP_MAPRED_HOME=/bigdata/tools/hadoop-2.7.3 mapreduce.map.env HADOOP_MAPRED_HOME=/bigdata/tools/hadoop-2.7.3 mapreduce.reduce.env HADOOP_MAPRED_HOME=/bigdata/tools/hadoop-2.7.3 yarn.app.mapreduce.am.admin.user.env LD_LIBRARY_PATH=$HADOOP_COMMON_HOME/lib/native:$JAVA_LIBRARY_PATH 另外，还将yarn.resourcemanager.address信息添加到了kylin_job_conf.xml这个文件中，原来Cube创建只能执行到第三步就报错，此时可以执行到第十步， 但此问题还是依然存在，只是之前在第三步#3 Step Name: Extract Fact Table Distinct Columns时报错，现在第十步又报同样的错误#10 Step Name: Build Cube In-Mem Duration: 20.19 mins Waiting: 0 seconds：， 请协助一下，我们万分感激！#10 Step Name: Build Cube In-Mem Duration: 20.19 mins Waiting: 0 seconds的错误信息如下： java.net.ConnectException: Call From hsmaster/10.9.0.86 to localhost:18032 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused at sun.reflect.GeneratedConstructorAccessor76.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:792) at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:732) at org.apache.hadoop.ipc.Client.call(Client.java:1479) at org.apache.hadoop.ipc.Client.call(Client.java:1412) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229) at com.sun.proxy.$Proxy66.getNewApplication(Unknown Source) at org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClientImpl.getNewApplication(ApplicationClientProtocolPBClientImpl.java:221) at sun.reflect.GeneratedMethodAccessor108.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:191) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102) at com.sun.proxy.$Proxy67.getNewApplication(Unknown Source) at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getNewApplication(YarnClientImpl.java:219) at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.createApplication(YarnClientImpl.java:227) at org.apache.hadoop.mapred.ResourceMgrDelegate.getNewJobID(ResourceMgrDelegate.java:187) at org.apache.hadoop.mapred.YARNRunner.getNewJobID(YARNRunner.java:231) at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:153) at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290) at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698) at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287) at org.apache.kylin.engine.mr.common.AbstractHadoopJob.waitForCompletion(AbstractHadoopJob.java:175) at org.apache.kylin.engine.mr.steps.InMemCuboidJob.run(InMemCuboidJob.java:121) at org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:130) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:162) at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:67) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:162) at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:300) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) Caused by: java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206) at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:531) at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:495) at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:614) at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:712) at org.apache.hadoop.ipc.Client$Connection.access$2900(Client.java:375) at org.apache.hadoop.ipc.Client.getConnection(Client.java:1528) at org.apache.hadoop.ipc.Cli
[GitHub] coveralls edited a comment on issue #192: KYLIN-3471 Minor, remove duplicate code
coveralls edited a comment on issue #192: KYLIN-3471 Minor, remove duplicate code URL: https://github.com/apache/kylin/pull/192#issuecomment-411304397 ## Pull Request Test Coverage Report for [Build 3422](https://coveralls.io/builds/18379450) * **0** of **16** **(0.0%)** changed or added relevant lines in **3** files are covered. * No unchanged relevant lines lost coverage. * Overall coverage increased (+**0.006%**) to **23.092%** --- | Changes Missing Coverage | Covered Lines | Changed/Added Lines | % | | :-|--||---: | | [engine-mr/src/main/java/org/apache/kylin/engine/mr/common/AbstractHadoopJob.java](https://coveralls.io/builds/18379450/source?filename=engine-mr%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fengine%2Fmr%2Fcommon%2FAbstractHadoopJob.java#L562) | 0 | 1 | 0.0% | [engine-spark/src/main/java/org/apache/kylin/engine/spark/SparkExecutable.java](https://coveralls.io/builds/18379450/source?filename=engine-spark%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fengine%2Fspark%2FSparkExecutable.java#L379) | 0 | 2 | 0.0% | [engine-mr/src/main/java/org/apache/kylin/engine/mr/common/JobRelatedMetaUtil.java](https://coveralls.io/builds/18379450/source?filename=engine-mr%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fengine%2Fmr%2Fcommon%2FJobRelatedMetaUtil.java#L80) | 0 | 13 | 0.0% | Totals | [](https://coveralls.io/builds/18379450) | | :-- | --: | | Change from base [Build 3420](https://coveralls.io/builds/18366675): | 0.006% | | Covered Lines: | 15662 | | Relevant Lines: | 67823 | --- # 💛 - [Coveralls](https://coveralls.io) This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
