[ https://issues.apache.org/jira/browse/SPARK-30242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16996046#comment-16996046 ]
Jelther Oliveira Gonçalves commented on SPARK-30242: ---------------------------------------------------- Hi [~dongjoon], thanks for the update. I've seen you have changed already. Thanks. > Support reading Parquet files from Stream Buffer > ------------------------------------------------ > > Key: SPARK-30242 > URL: https://issues.apache.org/jira/browse/SPARK-30242 > Project: Spark > Issue Type: Wish > Components: PySpark > Affects Versions: 3.0.0 > Reporter: Jelther Oliveira Gonçalves > Priority: Trivial > > Reading from a Python BufferIO a parquet is not possible using Pyspark. > Using: > > {code:java} > from io import BytesIO > parquetbytes : Bytes = b'PAR...' > df = spark.read.format("parquet").load(BytesIO(parquetbytes)) > {code} > Raises : > {code:java} > java.lang.ClassCastException: java.util.ArrayList cannot be cast to > java.lang.String{code} > > Is there any chance this will be available in the future? > -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org