[ 
https://issues.apache.org/jira/browse/SPARK-43167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17713787#comment-17713787
 ] 

Wei Liu commented on SPARK-43167:
---------------------------------

Should be:

```

Welcome to

      ____              __

     / __/__  ___ _____/ /__

    _\ \/ _ \/ _ `/ __/  '_/

   /__ / .__/\_,_/_/ /_/\_\   version 3.5.0-SNAPSHOT

      /_/

 

Using Python version 3.10.8 (main, Oct 13 2022 09:48:40)

Spark context Web UI available at http://10.10.105.160:4040

Spark context available as 'sc' (master = local[*], app id = 
local-1681856185012).

SparkSession available as 'spark'.

>>> spark

<pyspark.sql.session.SparkSession object at 0x1186f15d0>

>>> q = 
>>> spark.readStream.format("rate").load().writeStream.format("console").start()

23/04/18 15:17:12 WARN ResolveWriteToStream: Temporary checkpoint location 
created which is deleted normally when the query didn't fail: 
/private/var/folders/9k/pbxb4_690wv4smwhwbzwmqkw0000gp/T/temporary-64d68668-bc6f-46aa-8ea5-b66ddae09f91.
 If it's required to delete it under any circumstances, please set 
spark.sql.streaming.forceDeleteTempCheckpointLocation to true. Important to 
know deleting temp checkpoint folder is best effort.

23/04/18 15:17:12 WARN ResolveWriteToStream: spark.sql.adaptive.enabled is not 
supported in streaming DataFrames/Datasets and will be disabled.

-------------------------------------------                                     

Batch: 0

-------------------------------------------

l+---------+-----+

|timestamp|value|

+---------+-----+

+---------+-----+

 

-------------------------------------------                                     

Batch: 1

-------------------------------------------

+--------------------+-----+

|           timestamp|value|

+--------------------+-----+

|2023-04-18 15:17:...|    0|

|2023-04-18 15:17:...|    1|

+--------------------+-----+

 

-------------------------------------------

Batch: 2

-------------------------------------------

+--------------------+-----+

|           timestamp|value|

+--------------------+-----+

|2023-04-18 15:17:...|    2|

|2023-04-18 15:17:...|    3|

+--------------------+-----+

 

-------------------------------------------

Batch: 3

-------------------------------------------

+--------------------+-----+

|           timestamp|value|

+--------------------+-----+

|2023-04-18 15:17:...|    4|

+--------------------+-----+

```

 

> Streaming Connect console output format support
> -----------------------------------------------
>
>                 Key: SPARK-43167
>                 URL: https://issues.apache.org/jira/browse/SPARK-43167
>             Project: Spark
>          Issue Type: Task
>          Components: Connect, Structured Streaming
>    Affects Versions: 3.5.0
>            Reporter: Wei Liu
>            Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to