?????? ??????????????downloads/setup-pyflink-virtual-env.sh????

2021-11-22 文章 Asahi Lee
p;amp;amp;nbsp; 
   
> at
> > >
> >
> 
org.apache.flink.table.api.internal.TableEnvironmentImpl.sqlQuery(TableEnvironmentImpl.java:704)
> > > ~[flink-table-blink_2.11-1.13.1.jar:1.13.1]
> > >     
   
> at
> > test.PyUDFTest.main(PyUDFTest.java:22)
> > > ~[flink-python-test-1.0-SNAPSHOT.jar:?]
> > >     
   
> at
> > > sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
Method)
> > ~[?:1.8.0_111]
> > >     
   
> at
> > >
> >
> 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> > > ~[?:1.8.0_111]
> > >     
   
> at
> > >
> >
> 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > > ~[?:1.8.0_111]
> > >     
   
> at
> > > java.lang.reflect.Method.invoke(Method.java:498)
> ~[?:1.8.0_111]
> > >     
   
> at
> > >
> >
> 
org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355)
> > > ~[flink-dist_2.11-1.13.1.jar:1.13.1]
> > >     
   
> at
> > >
> >
> 
org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222)
> > > ~[flink-dist_2.11-1.13.1.jar:1.13.1]
> > >     
   
> at
> > >
> >
> org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114)
> > > ~[flink-dist_2.11-1.13.1.jar:1.13.1]
> > >     
   
> at
> > >
> >
> 
org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:242)
> > > ~[flink-dist_2.11-1.13.1.jar:1.13.1]
> > >     
   
> ... 10 more
> > > 2021-11-18 20:48:44,458 INFO 
> > > 
org.apache.flink.runtime.blob.BlobServer 
>  
> >      
> > >     
   
>    [] -
> > Stopped BLOB server at
> > > 0.0.0.0:45070
> > > 2021-11-18 20:48:44,458 INFO 
> > >
> org.apache.flink.runtime.entrypoint.ClusterEntrypoint 
> >    
> > >   [] - Shutting
> YarnApplicationClusterEntryPoint down with
> > application
> > > status UNKNOWN. Diagnostics Cluster entrypoint has 
been
> closed
> > externally..
> > > 2021-11-18 20:48:44,458 INFO 
> > >
> org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] -
> > Shutting
> > > down rest endpoint.
> > > 2021-11-18 20:48:44,474 INFO 
> > >
> org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] -
> > Removing
> > > cache directory
> > >
> /tmp/flink-web-dd82c3c0-f457-492d-8e64-5ae74fe9abbd/flink-web-ui
> > > 2021-11-18 20:48:44,474 INFO 
> > >
> org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] -
> > > http://cdh5node3:40216 lost leadership
> > > 2021-11-18 20:48:44,474 INFO 
> > >
> org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] -
> > Shut
> > > down complete.
> > > 2021-11-18 20:48:44,474 INFO 
> > >
> >
> 
org.apache.flink.runtime.entrypoint.component.DispatcherResourceManagerComponent
> > > [] - Closing components.
> > > 2021-11-18 20:48:44,475 INFO 
> > >
> >
> org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess
> > > [] - Stopping SessionDispatcherLeaderProcess.
> > > 2021-11-18 20:48:44,475 INFO 
> > >
> org.apache.flink.runtime.dispatcher.StandaloneDispatcher 
> >  
> > >  [] - Stopping dispatcher
> akka.tcp://flink@cdh5node3
> > > :34697/user/rpc/dispatcher_1.
> > > 2021-11-18 20:48:44,476 INFO 
> > >
> org.apache.flink.runtime.dispatcher.StandaloneDispatcher 
> >  
> > >  [] - Stopping all currently 
running jobs of
> dispatcher
> > > 
akka.tcp://flink@cdh5node3:34697/user/rpc/dispatcher_1.
> > >
> > >
> > > LogType:jobmanager.out
> > > Log Upload Time:?? ?? 18 20:48:45 +0800 2021
> > > LogLength:37
> > > Log Contents:
> > > /bin/python: No module named pyflink
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> 
--  --
> > > ??:
> >
> 
>                                                  
> > "user-zh"
> >
> 
>                                                                    
> &gt; <
> &gt; &amp;gt; xyzhong...@163.com&amp;amp;gt;;
> &gt; &amp;gt; :&amp;amp;nbsp;2021??11??18??(??) 
3:34
> &gt; &amp;gt; 
??:&amp;amp;nbsp;"user-zh"https://nightlies.apache.org/flink/flink-docs-release-1.12/downloads/setup-pyflink-virtual-env.sh
> &gt
> 
<https://nightlies.apache.org/flink/flink-docs-release-1.12/downloads/setup-pyflink-virtual-env.sh&gt>;;
> &amp;gt
> &gt; <
> 
https://nightlies.apache.org/flink/flink-docs-release-1.12/downloads/setup-pyflink-virtual-env.sh&amp;gt&gt
> ;;
> &gt; ?? 2021-11-18 15:05:03??"Asahi Lee" 
<978466...@qq.com.INVALID&amp;amp;gt;
> ??
> &gt; &amp;gt; &amp;amp;gt;Hi!
> &gt; &amp;gt; &amp;amp;gt;&amp;amp;amp;nbsp; 
&amp;amp;amp;nbsp;
> &gt; &amp;gt;
> &gt;
> 
flink??&amp;amp;amp;nbsp;&amp;amp;amp;nbsp;setup-pyflink-virtual-env.sh
> &gt; &amp;gt; 
python??
> &gt; &amp;gt; &amp;amp;gt;
> &gt; &amp;gt;
> &gt;
> 
https://nightlies.apache.org/flink/flink-docs-release-1.14/zh/docs/dev/python/faq/

Re: 哪里可以下载到downloads/setup-pyflink-virtual-env.sh脚本

2021-11-21 文章 Dian Fu
quot;R\n\rCDH_YARN_HOME\022A/opt/cloudera/parcels/CDH-5.16.2-1.cdh5.16.2.p0.8/lib/hadoop-yarn\"K\n\vSEARCH_HOME\022
>
> 2021-11-19 14:02:24,050 INFO 
> org.apache.beam.runners.fnexecution.logging.GrpcLoggingService [] - 1 Beam
> Fn Logging clients still connected during shutdown.
> 2021-11-19 14:02:25,332 WARN 
> org.apache.flink.runtime.taskmanager.Task         
>           [] - Source: Values(tuples=[[{
> _UTF-16LE'1' }, { _UTF-16LE'2' }, { _UTF-16LE'3' }]], values=[f0]) ->
> Calc(select=[f0]) -> PythonCalc(select=[func1(f0) AS a]) -> Sink:
> Collect table sink (1/1)#0 (bef195197949f0a6c3716ff2e6e8b17d) switched from
> RUNNING to FAILED with failure cause: java.lang.RuntimeException: Failed to
> start remote bundle
> at
> org.apache.flink.streaming.api.runners.python.beam.BeamPythonFunctionRunner.startBundle(BeamPythonFunctionRunner.java:333)
> at
> org.apache.flink.streaming.api.runners.python.beam.BeamPythonFunctionRunner.checkInvokeStartBundle(BeamPythonFunctionRunner.java:314)
> at
> org.apache.flink.streaming.api.runners.python.beam.BeamPythonFunctionRunner.process(BeamPythonFunctionRunner.java:293)
> at
> org.apache.flink.table.runtime.operators.python.scalar.PythonScalarFunctionOperator.processElementInternal(PythonScalarFunctionOperator.java:89)
> at
> org.apache.flink.table.runtime.operators.python.scalar.PythonScalarFunctionOperator.processElementInternal(PythonScalarFunctionOperator.java:38)
> at
> org.apache.flink.table.runtime.operators.python.AbstractStatelessFunctionOperator.processElement(AbstractStatelessFunctionOperator.java:117)
> at
> org.apache.flink.streaming.runtime.tasks.ChainingOutput.pushToOperator(ChainingOutput.java:99)
> at
> org.apache.flink.streaming.runtime.tasks.ChainingOutput.collect(ChainingOutput.java:80)
> at
> org.apache.flink.streaming.runtime.tasks.ChainingOutput.collect(ChainingOutput.java:39)
> at
> org.apache.flink.streaming.api.operators.CountingOutput.collect(CountingOutput.java:56)
> at
> org.apache.flink.streaming.api.operators.CountingOutput.collect(CountingOutput.java:29)
> at BatchExecCalc$8.processElement(Unknown Source)
> at
> org.apache.flink.streaming.runtime.tasks.ChainingOutput.pushToOperator(ChainingOutput.java:99)
> at
> org.apache.flink.streaming.runtime.tasks.ChainingOutput.collect(ChainingOutput.java:80)
> at
> org.apache.flink.streaming.runtime.tasks.ChainingOutput.collect(ChainingOutput.java:39)
> at
> org.apache.flink.streaming.api.operators.CountingOutput.collect(CountingOutput.java:56)
> at
> org.apache.flink.streaming.api.operators.CountingOutput.collect(CountingOutput.java:29)
> at
> org.apache.flink.streaming.api.operators.StreamSourceContexts$ManualWatermarkContext.processAndCollect(StreamSourceContexts.java:418)
> at
> org.apache.flink.streaming.api.operators.StreamSourceContexts$WatermarkContext.collect(StreamSourceContexts.java:513)
> at
> org.apache.flink.streaming.api.operators.StreamSourceContexts$SwitchingOnClose.collect(StreamSourceContexts.java:103)
> at
> org.apache.flink.streaming.api.functions.source.InputFormatSourceFunction.run(InputFormatSourceFunction.java:92)
> at
> org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:116)
> at
> org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:73)
> at
> org.apache.flink.streaming.runtime.tasks.SourceStreamTask$LegacySourceFunctionThread.run(SourceStreamTask.java:323)
> Caused by: java.lang.RuntimeException: No client connected within timeout
>     at
> org.apache.beam.runners.fnexecution.data.GrpcDataService.send(GrpcDataService.java:192)
> at
> org.apache.beam.runners.fnexecution.control.SdkHarnessClient$BundleProcessor.newBundle(SdkHarnessClient.java:287)
> at
> org.apache.beam.runners.fnexecution.control.SdkHarnessClient$BundleProcessor.newBundle(SdkHarnessClient.java:197)
> at
> org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory.getBundle(DefaultJobBundleFactory.java:519)
> at
> org.apache.beam.runners.fnexecution.control.StageBundleFactory.getBundle(StageBundleFactory.java:87)
> at
> org.apache.beam.runners.fnexecution.control.StageBundleFactory.getBundle(StageBundleFactory.java:76)
> at
> org.apache.flink.streaming.api.runners.python.beam.BeamPythonFunctionRunner.startBundle(BeamPythonFunctionRunner.java:323)
> ... 23 more
> Caused by: java.util.concurrent.TimeoutException: Waited 3 minutes for
> org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent

?????? ??????????????downloads/setup-pyflink-virtual-env.sh????

2021-11-21 文章 Asahi Lee
-11-18 20:48:44,474 INFO&amp;nbsp;
> &gt; org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] -
> Removing
> &gt; cache directory
> &gt; /tmp/flink-web-dd82c3c0-f457-492d-8e64-5ae74fe9abbd/flink-web-ui
> &gt; 2021-11-18 20:48:44,474 INFO&amp;nbsp;
> &gt; org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] -
> &gt; http://cdh5node3:40216 lost leadership
> &gt; 2021-11-18 20:48:44,474 INFO&amp;nbsp;
> &gt; org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] -
> Shut
> &gt; down complete.
> &gt; 2021-11-18 20:48:44,474 INFO&amp;nbsp;
> &gt;
> 
org.apache.flink.runtime.entrypoint.component.DispatcherResourceManagerComponent
> &gt; [] - Closing components.
> &gt; 2021-11-18 20:48:44,475 INFO&amp;nbsp;
> &gt;
> org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess
> &gt; [] - Stopping SessionDispatcherLeaderProcess.
> &gt; 2021-11-18 20:48:44,475 INFO&amp;nbsp;
> &gt; 
org.apache.flink.runtime.dispatcher.StandaloneDispatcher&amp;nbsp;
> &amp;nbsp;
> &gt; &amp;nbsp;[] - Stopping dispatcher akka.tcp://flink@cdh5node3
> &gt; :34697/user/rpc/dispatcher_1.
> &gt; 2021-11-18 20:48:44,476 INFO&amp;nbsp;
> &gt; 
org.apache.flink.runtime.dispatcher.StandaloneDispatcher&amp;nbsp;
> &amp;nbsp;
> &gt; &amp;nbsp;[] - Stopping all currently running jobs of 
dispatcher
> &gt; akka.tcp://flink@cdh5node3:34697/user/rpc/dispatcher_1.
> &gt;
> &gt;
> &gt; LogType:jobmanager.out
> &gt; Log Upload Time:?? ?? 18 20:48:45 +0800 2021
> &gt; LogLength:37
> &gt; Log Contents:
> &gt; /bin/python: No module named pyflink
> &gt;
> &gt;
> &gt;
> &gt;
> &gt;
> &gt;
> &gt;
> &gt;
> &gt;
> &gt;
> &gt;
> &gt;
> &gt;
> &gt; 
--&amp;nbsp;&amp;nbsp;--
> &gt; ??:
> 
&gt;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
> "user-zh"
> 
&gt;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
> <
> &gt; xyzhong...@163.com&amp;gt;;
> &gt; :&amp;nbsp;2021??11??18??(??) 3:34
> &gt; 
??:&amp;nbsp;"user-zh"https://nightlies.apache.org/flink/flink-docs-release-1.12/downloads/setup-pyflink-virtual-env.sh
> &gt
> 
<https://nightlies.apache.org/flink/flink-docs-release-1.12/downloads/setup-pyflink-virtual-env.sh&gt>;;
> ?? 2021-11-18 15:05:03??"Asahi Lee" <978466...@qq.com.INVALID&amp;gt; 
??
> &gt; &amp;gt;Hi!
> &gt; &amp;gt;&amp;amp;nbsp; &amp;amp;nbsp;
> &gt;
> 
flink??&amp;amp;nbsp;&amp;amp;nbsp;setup-pyflink-virtual-env.sh
> &gt; python??
> &gt; &amp;gt;
> &gt;
> 
https://nightlies.apache.org/flink/flink-docs-release-1.14/zh/docs/dev/python/faq/

Re: 哪里可以下载到downloads/setup-pyflink-virtual-env.sh脚本

2021-11-18 文章 Dian Fu
刚注意到你用的YARN application模式,PyFlink 1.14.0才支持YARN application模式,主要是新增了命令行选项“
-pyclientexec” 和配置“python.client.executable”:
https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/dev/python/python_config/#python-client-executable

对于你这个作业来说,你需要通过使用1.14.0版本,同时添加命令行选项:-pyclientexec venv.zip/venv/bin/python


On Fri, Nov 19, 2021 at 10:48 AM Asahi Lee <978466...@qq.com.invalid> wrote:

> 我通过source my_env/bin/activate和指定环境变量PYFLINK_CLIENT_EXECUTABLE均未提交成功,错误未变化;
> 我的错误中,jobmanager的日志中显示No module named pyflink,而jobmanager是运行在yarn集群上;
> 请问,还有还有什么未配置?
>
>
> > LogType:jobmanager.out
> > Log Upload Time:星期四 十一月 18 20:48:45 +0800 2021
> > LogLength:37
> > Log Contents:
> > /bin/python: No module named pyflink
>
>
>
>
> -- 原始邮件 --
> 发件人:
>   "user-zh"
> <
> dian0511...@gmail.com>;
> 发送时间: 2021年11月19日(星期五) 上午9:38
> 收件人: "user-zh"
> 主题: Re: 哪里可以下载到downloads/setup-pyflink-virtual-env.sh脚本
>
>
>
> -pyexec 指定的是集群端所用的Python环境,客户端需要编译Flink作业,也会依赖Python环境。可以看一下这个文档:
>
> https://nightlies.apache.org/flink/flink-docs-release-1.13/docs/dev/python/dependency_management/#python-interpreter-of-client
>
> On Thu, Nov 18, 2021 at 9:00 PM Asahi Lee <978466...@qq.com.invalid>
> wrote:
>
> > Hi !
> > &nbsp; &nbsp;我在java Table api中使用python udf
> > 函数,通过下面的命令提交应用,报无法启动python服务错误,请问我的提交方式对吗?jm日志为/bin/python: No module
> named
> > pyflink。
> >
> >
> > ./flink-1.13.2/bin/flink&nbsp;
> > run-application -t yarn-application&nbsp;
> >
> -Dyarn.provided.lib.dirs="hdfs://nameservice1/user/flink/flinklib"&nbsp;
> > -Dyarn.application.queue=d
> > -p 1&nbsp;
> > -pyarch /opt/venv.zip
> > -pyexec venv.zip/venv/bin/python&nbsp;
> > -pyfs /opt/test.py&nbsp;
> > -c test.PyUDFTest&nbsp;
> > /opt/flink-python-test-1.0-SNAPSHOT.jar
> >
> >
> >
> > 错误:
> > Caused by: java.lang.RuntimeException: Python callback server start
> failed!
> > &nbsp; &nbsp; &nbsp; &nbsp; at
> >
> org.apache.flink.client.python.PythonFunctionFactory.createPythonFunctionFactory(PythonFunctionFactory.java:167)
> > ~[flink-python_2.11-1.13.2.jar:1.13.2]
> > &nbsp; &nbsp; &nbsp; &nbsp; at
> >
> org.apache.flink.client.python.PythonFunctionFactory$1.load(PythonFunctionFactory.java:88)
> > ~[flink-python_2.11-1.13.2.jar:1.13.2]
> > &nbsp; &nbsp; &nbsp; &nbsp; at
> >
> org.apache.flink.client.python.PythonFunctionFactory$1.load(PythonFunctionFactory.java:84)
> > ~[flink-python_2.11-1.13.2.jar:1.13.2]
> > &nbsp; &nbsp; &nbsp; &nbsp; at
> >
> org.apache.flink.shaded.guava18.com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3527)
> > ~[flink-dist_2.11-1.13.1.jar:1.13.1]
> > &nbsp; &nbsp; &nbsp; &nbsp; at
> >
> org.apache.flink.shaded.guava18.com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2319)
> > ~[flink-dist_2.11-1.13.1.jar:1.13.1]
> > &nbsp; &nbsp; &nbsp; &nbsp; at
> >
> org.apache.flink.shaded.guava18.com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2282)
> > ~[flink-dist_2.11-1.13.1.jar:1.13.1]
> > &nbsp; &nbsp; &nbsp; &nbsp; at
> >
> org.apache.flink.shaded.guava18.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2197)
> > ~[flink-dist_2.11-1.13.1.jar:1.13.1]
> > &nbsp; &nbsp; &nbsp; &nbsp; at
> >
> org.apache.flink.shaded.guava18.com.google.common.cache.LocalCache.get(LocalCache.java:3937)
> > ~[flink-dist_2.11-1.13.1.jar:1.13.1]
> > &nbsp; &nbsp; &nbsp; &nbsp; at
> >
> org.apache.flink.shaded.guava18.com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:3941)
> > ~[flink-dist_2.11-1.13.1.jar:1.13.1]
> > &nbsp; &nbsp; &nbsp; &nbsp; at
> >
> org.apache.flink.shaded.guava18.com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4824)
> > ~[flink-dist_2.11-1.13.1.jar:1.13.1]
> > &nbsp; &nbsp; &nbsp; &nbsp; at
> >
> org.apache.flink.client.python.PythonFunctionFactory.getPythonFunction(PythonFunctionFactory.java:129)
> > ~[flink-python_2.11-1.13.2.jar:1.13.2]
> > &nbsp; &nbsp; &nbsp; &nbsp; at
> > sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> ~[?:1.8.0_111]
> > &nbsp; &nbsp; &nbsp; &nbsp; at
&g

?????? ??????????????downloads/setup-pyflink-virtual-env.sh????

2021-11-18 文章 Asahi Lee
lob.BlobServer&nbsp; &nbsp; &nbsp; 
&nbsp; &nbsp;
> &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;[] - 
Stopped BLOB server at
> 0.0.0.0:45070
> 2021-11-18 20:48:44,458 INFO&nbsp;
> org.apache.flink.runtime.entrypoint.ClusterEntrypoint&nbsp; &nbsp; 
&nbsp;
> &nbsp; [] - Shutting YarnApplicationClusterEntryPoint down with 
application
> status UNKNOWN. Diagnostics Cluster entrypoint has been closed externally..
> 2021-11-18 20:48:44,458 INFO&nbsp;
> org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Shutting
> down rest endpoint.
> 2021-11-18 20:48:44,474 INFO&nbsp;
> org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Removing
> cache directory
> /tmp/flink-web-dd82c3c0-f457-492d-8e64-5ae74fe9abbd/flink-web-ui
> 2021-11-18 20:48:44,474 INFO&nbsp;
> org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] -
> http://cdh5node3:40216 lost leadership
> 2021-11-18 20:48:44,474 INFO&nbsp;
> org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Shut
> down complete.
> 2021-11-18 20:48:44,474 INFO&nbsp;
> 
org.apache.flink.runtime.entrypoint.component.DispatcherResourceManagerComponent
> [] - Closing components.
> 2021-11-18 20:48:44,475 INFO&nbsp;
> org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess
> [] - Stopping SessionDispatcherLeaderProcess.
> 2021-11-18 20:48:44,475 INFO&nbsp;
> org.apache.flink.runtime.dispatcher.StandaloneDispatcher&nbsp; 
&nbsp;
> &nbsp;[] - Stopping dispatcher akka.tcp://flink@cdh5node3
> :34697/user/rpc/dispatcher_1.
> 2021-11-18 20:48:44,476 INFO&nbsp;
> org.apache.flink.runtime.dispatcher.StandaloneDispatcher&nbsp; 
&nbsp;
> &nbsp;[] - Stopping all currently running jobs of dispatcher
> akka.tcp://flink@cdh5node3:34697/user/rpc/dispatcher_1.
>
>
> LogType:jobmanager.out
> Log Upload Time:?? ?? 18 20:48:45 +0800 2021
> LogLength:37
> Log Contents:
> /bin/python: No module named pyflink
>
>
>
>
>
>
>
>
>
>
>
>
>
> --&nbsp;&nbsp;--
> ??:
>  
 "user-zh"
>
 <
> xyzhong...@163.com&gt;;
> :&nbsp;2021??11??18??(??) 3:34
> ??:&nbsp;"user-zh"https://nightlies.apache.org/flink/flink-docs-release-1.12/downloads/setup-pyflink-virtual-env.sh
> ?? 2021-11-18 15:05:03??"Asahi Lee" <978466...@qq.com.INVALID&gt; 
??
> &gt;Hi!
> &gt;&amp;nbsp; &amp;nbsp;
> 
flink??&amp;nbsp;&amp;nbsp;setup-pyflink-virtual-env.sh
> python??
> &gt;
> 
https://nightlies.apache.org/flink/flink-docs-release-1.14/zh/docs/dev/python/faq/

Re: 哪里可以下载到downloads/setup-pyflink-virtual-env.sh脚本

2021-11-18 文章 Dian Fu
.validate.SqlValidatorImpl.performUnconditionalRewrites(SqlValidatorImpl.java:1169)
> ~[flink-table-blink_2.11-1.13.1.jar:1.13.1]
>         at
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateScopedExpression(SqlValidatorImpl.java:945)
> ~[flink-table-blink_2.11-1.13.1.jar:1.13.1]
>         at
> org.apache.calcite.sql.validate.SqlValidatorImpl.validate(SqlValidatorImpl.java:704)
> ~[flink-table-blink_2.11-1.13.1.jar:1.13.1]
>         at
> org.apache.flink.table.planner.calcite.FlinkPlannerImpl.org$apache$flink$table$planner$calcite$FlinkPlannerImpl$$validate(FlinkPlannerImpl.scala:152)
> ~[flink-table-blink_2.11-1.13.1.jar:1.13.1]
>         at
> org.apache.flink.table.planner.calcite.FlinkPlannerImpl.validate(FlinkPlannerImpl.scala:110)
> ~[flink-table-blink_2.11-1.13.1.jar:1.13.1]
>         at
> org.apache.flink.table.planner.operations.SqlToOperationConverter.convert(SqlToOperationConverter.java:201)
> ~[flink-table-blink_2.11-1.13.1.jar:1.13.1]
>         at
> org.apache.flink.table.planner.delegation.ParserImpl.parse(ParserImpl.java:101)
> ~[flink-table-blink_2.11-1.13.1.jar:1.13.1]
>         at
> org.apache.flink.table.api.internal.TableEnvironmentImpl.sqlQuery(TableEnvironmentImpl.java:704)
> ~[flink-table-blink_2.11-1.13.1.jar:1.13.1]
>         at test.PyUDFTest.main(PyUDFTest.java:22)
> ~[flink-python-test-1.0-SNAPSHOT.jar:?]
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_111]
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> ~[?:1.8.0_111]
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> ~[?:1.8.0_111]
>         at
> java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_111]
>         at
> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355)
> ~[flink-dist_2.11-1.13.1.jar:1.13.1]
>         at
> org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222)
> ~[flink-dist_2.11-1.13.1.jar:1.13.1]
>         at
> org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114)
> ~[flink-dist_2.11-1.13.1.jar:1.13.1]
>         at
> org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:242)
> ~[flink-dist_2.11-1.13.1.jar:1.13.1]
>         ... 10 more
> 2021-11-18 20:48:44,458 INFO 
> org.apache.flink.runtime.blob.BlobServer         
>            [] - Stopped BLOB server at
> 0.0.0.0:45070
> 2021-11-18 20:48:44,458 INFO 
> org.apache.flink.runtime.entrypoint.ClusterEntrypoint     
>   [] - Shutting YarnApplicationClusterEntryPoint down with application
> status UNKNOWN. Diagnostics Cluster entrypoint has been closed externally..
> 2021-11-18 20:48:44,458 INFO 
> org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Shutting
> down rest endpoint.
> 2021-11-18 20:48:44,474 INFO 
> org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Removing
> cache directory
> /tmp/flink-web-dd82c3c0-f457-492d-8e64-5ae74fe9abbd/flink-web-ui
> 2021-11-18 20:48:44,474 INFO 
> org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] -
> http://cdh5node3:40216 lost leadership
> 2021-11-18 20:48:44,474 INFO 
> org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Shut
> down complete.
> 2021-11-18 20:48:44,474 INFO 
> org.apache.flink.runtime.entrypoint.component.DispatcherResourceManagerComponent
> [] - Closing components.
> 2021-11-18 20:48:44,475 INFO 
> org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess
> [] - Stopping SessionDispatcherLeaderProcess.
> 2021-11-18 20:48:44,475 INFO 
> org.apache.flink.runtime.dispatcher.StandaloneDispatcher   
>  [] - Stopping dispatcher akka.tcp://flink@cdh5node3
> :34697/user/rpc/dispatcher_1.
> 2021-11-18 20:48:44,476 INFO 
> org.apache.flink.runtime.dispatcher.StandaloneDispatcher   
>  [] - Stopping all currently running jobs of dispatcher
> akka.tcp://flink@cdh5node3:34697/user/rpc/dispatcher_1.
>
>
> LogType:jobmanager.out
> Log Upload Time:星期四 十一月 18 20:48:45 +0800 2021
> LogLength:37
> Log Contents:
> /bin/python: No module named pyflink
>
>
>
>
>
>
>
>
>
>
>
>
>
> -- 原始邮件 --
> 发件人:
>   "user-zh"
> <
> xyzhong...@163.com>;
> 发送时间: 2021年11月18日(星期四) 下午3:34
> 收件人: "user-zh"
> 主题: Re:哪里可以下载到downloads/setup-pyflink-virtual-env.sh脚本
>
>
>
> Hi! https://nightlies.apache.org/flink/flink-docs-release-1.12/downloads/setup-pyflink-virtual-env.sh
> 在 2021-11-18 15:05:03,"Asahi Lee" <978466...@qq.com.INVALID> 写道:
> >Hi!
> >&nbsp; &nbsp;
> 我在flink官方文档中看到通过&nbsp;&nbsp;setup-pyflink-virtual-env.sh
> 脚本制作python虚拟环境,请问再哪里可以下载到?文档地址如下:
> >
> https://nightlies.apache.org/flink/flink-docs-release-1.14/zh/docs/dev/python/faq/


????????????????????downloads/setup-pyflink-virtual-env.sh????

2021-11-18 文章 Asahi Lee
        at 
org.apache.flink.table.planner.calcite.FlinkPlannerImpl.validate(FlinkPlannerImpl.scala:110)
 ~[flink-table-blink_2.11-1.13.1.jar:1.13.1]
        at 
org.apache.flink.table.planner.operations.SqlToOperationConverter.convert(SqlToOperationConverter.java:201)
 ~[flink-table-blink_2.11-1.13.1.jar:1.13.1]
        at 
org.apache.flink.table.planner.delegation.ParserImpl.parse(ParserImpl.java:101) 
~[flink-table-blink_2.11-1.13.1.jar:1.13.1]
        at 
org.apache.flink.table.api.internal.TableEnvironmentImpl.sqlQuery(TableEnvironmentImpl.java:704)
 ~[flink-table-blink_2.11-1.13.1.jar:1.13.1]
        at test.PyUDFTest.main(PyUDFTest.java:22) 
~[flink-python-test-1.0-SNAPSHOT.jar:?]
        at 
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_111]
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 
~[?:1.8.0_111]
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 ~[?:1.8.0_111]
        at java.lang.reflect.Method.invoke(Method.java:498) 
~[?:1.8.0_111]
        at 
org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355)
 ~[flink-dist_2.11-1.13.1.jar:1.13.1]
        at 
org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222)
 ~[flink-dist_2.11-1.13.1.jar:1.13.1]
        at 
org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114) 
~[flink-dist_2.11-1.13.1.jar:1.13.1]
        at 
org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:242)
 ~[flink-dist_2.11-1.13.1.jar:1.13.1]
        ... 10 more
2021-11-18 20:48:44,458 INFO  
org.apache.flink.runtime.blob.BlobServer          
           [] - Stopped BLOB server at 
0.0.0.0:45070
2021-11-18 20:48:44,458 INFO  
org.apache.flink.runtime.entrypoint.ClusterEntrypoint      
  [] - Shutting YarnApplicationClusterEntryPoint down with application 
status UNKNOWN. Diagnostics Cluster entrypoint has been closed externally..
2021-11-18 20:48:44,458 INFO  
org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Shutting 
down rest endpoint.
2021-11-18 20:48:44,474 INFO  
org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Removing 
cache directory /tmp/flink-web-dd82c3c0-f457-492d-8e64-5ae74fe9abbd/flink-web-ui
2021-11-18 20:48:44,474 INFO  
org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - 
http://cdh5node3:40216 lost leadership
2021-11-18 20:48:44,474 INFO  
org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Shut down 
complete.
2021-11-18 20:48:44,474 INFO  
org.apache.flink.runtime.entrypoint.component.DispatcherResourceManagerComponent
 [] - Closing components.
2021-11-18 20:48:44,475 INFO  
org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] - 
Stopping SessionDispatcherLeaderProcess.
2021-11-18 20:48:44,475 INFO  
org.apache.flink.runtime.dispatcher.StandaloneDispatcher     [] 
- Stopping dispatcher akka.tcp://flink@cdh5node3:34697/user/rpc/dispatcher_1.
2021-11-18 20:48:44,476 INFO  
org.apache.flink.runtime.dispatcher.StandaloneDispatcher     [] 
- Stopping all currently running jobs of dispatcher 
akka.tcp://flink@cdh5node3:34697/user/rpc/dispatcher_1.


LogType:jobmanager.out
Log Upload Time:?? ?? 18 20:48:45 +0800 2021
LogLength:37
Log Contents:
/bin/python: No module named pyflink













--  --
??: 
   "user-zh"

https://nightlies.apache.org/flink/flink-docs-release-1.12/downloads/setup-pyflink-virtual-env.sh
?? 2021-11-18 15:05:03??"Asahi Lee" <978466...@qq.com.INVALID> ??
>Hi!
>&nbsp; &nbsp; 
flink??&nbsp;&nbsp;setup-pyflink-virtual-env.sh 
python??
>https://nightlies.apache.org/flink/flink-docs-release-1.14/zh/docs/dev/python/faq/

Re:??????????????downloads/setup-pyflink-virtual-env.sh????

2021-11-17 文章 zxyoung
Hi!??https://nightlies.apache.org/flink/flink-docs-release-1.12/downloads/setup-pyflink-virtual-env.sh
?? 2021-11-18 15:05:03??"Asahi Lee" <978466...@qq.com.INVALID> ??
>Hi!
>    
>flink??  setup-pyflink-virtual-env.sh 
>python??
>https://nightlies.apache.org/flink/flink-docs-release-1.14/zh/docs/dev/python/faq/


??????????????downloads/setup-pyflink-virtual-env.sh????

2021-11-17 文章 Asahi Lee
Hi!
    
flink??  setup-pyflink-virtual-env.sh 
python??
https://nightlies.apache.org/flink/flink-docs-release-1.14/zh/docs/dev/python/faq/