[ https://issues.apache.org/jira/browse/FLINK-22953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17367836#comment-17367836 ]
Dian Fu commented on FLINK-22953: --------------------------------- [~awayne] Thanks for the confirmation. Then I will close this issue as duplicate as there is already a PR in FLINK-23033. Regarding to the documentation, I agree with you that the documentation is not complete. I have already updated the documentation about the data types supported in Python DataStream API in FLINK-23033. > Using Types.LIST(Types.STRING()) in datastream result in crash > -------------------------------------------------------------- > > Key: FLINK-22953 > URL: https://issues.apache.org/jira/browse/FLINK-22953 > Project: Flink > Issue Type: Bug > Components: API / Python > Affects Versions: 1.13.1 > Environment: python==3.7.5 > flink==1.13.1 > Reporter: awayne > Priority: Critical > Labels: stale-critical > > In our business, we need to deserialize JSON like this: > {code:java} > { > ..., > "texts": ["a", "b", "c"], > ... > }{code} > number of strings in list isn't fixed. > After define Row type using Types.LIST(Types.STRING()), job will crash: > {code:java} > File > "/home/ubuntu/pyflenv/lib/python3.7/site-packages/pyflink/datastream/stream_execution_environment.py", > line 645, in execute File > "/home/ubuntu/pyflenv/lib/python3.7/site-packages/pyflink/datastream/stream_execution_environment.py", > line 645, in execute return > JobExecutionResult(self._j_stream_execution_environment.execute(j_stream_graph)) > File > "/home/ubuntu/pyflenv/lib/python3.7/site-packages/py4j/java_gateway.py", line > 1286, in __call__ answer, self.gateway_client, self.target_id, self.name) > File > "/home/ubuntu/pyflenv/lib/python3.7/site-packages/pyflink/util/exceptions.py", > line 146, in deco return f(*a, **kw) File > "/home/ubuntu/pyflenv/lib/python3.7/site-packages/py4j/protocol.py", line > 328, in get_return_value format(target_id, ".", name), > value)py4j.protocol.Py4JJavaError: An error occurred while calling > o31.execute.: org.apache.flink.runtime.client.JobExecutionException: Job > execution failed. at > org.apache.flink.runtime.jobmaster.JobResult.toJobExecutionResult(JobResult.java:144) > at > org.apache.flink.runtime.minicluster.MiniClusterJobClient.lambda$getJobExecutionResult$3(MiniClusterJobClient.java:137) > at > java.base/java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:642) > at > java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506) > at > java.base/java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:2073) > at > org.apache.flink.runtime.rpc.akka.AkkaInvocationHandler.lambda$invokeRpc$0(AkkaInvocationHandler.java:237) > at > java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:859) > at > java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:837) > at > java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506) > at > java.base/java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:2073) > at > org.apache.flink.runtime.concurrent.FutureUtils$1.onComplete(FutureUtils.java:1081) > at akka.dispatch.OnComplete.internal(Future.scala:264) at > akka.dispatch.OnComplete.internal(Future.scala:261) at > akka.dispatch.japi$CallbackBridge.apply(Future.scala:191) at > akka.dispatch.japi$CallbackBridge.apply(Future.scala:188) at > scala.concurrent.impl.CallbackRunnable.run(Promise.scala:36) at > org.apache.flink.runtime.concurrent.Executors$DirectExecutionContext.execute(Executors.java:73) > at scala.concurrent.impl.CallbackRunnable.executeWithValue(Promise.scala:44) > at > scala.concurrent.impl.Promise$DefaultPromise.tryComplete(Promise.scala:252) > at akka.pattern.PromiseActorRef.$bang(AskSupport.scala:572) at > akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:22) > at > akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:21) > at scala.concurrent.Future$$anonfun$andThen$1.apply(Future.scala:436) at > scala.concurrent.Future$$anonfun$andThen$1.apply(Future.scala:435) at > scala.concurrent.impl.CallbackRunnable.run(Promise.scala:36) at > akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:55) > at > akka.dispatch.BatchingExecutor$BlockableBatch$$anonfun$run$1.apply$mcV$sp(BatchingExecutor.scala:91) > at > akka.dispatch.BatchingExecutor$BlockableBatch$$anonfun$run$1.apply(BatchingExecutor.scala:91) > at > akka.dispatch.BatchingExecutor$BlockableBatch$$anonfun$run$1.apply(BatchingExecutor.scala:91) > at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:72) at > akka.dispatch.BatchingExecutor$BlockableBatch.run(BatchingExecutor.scala:90) > at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:40) at > akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:44) > at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) at > akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) > at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) at > akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)