rhh777 commented on issue #154:
URL:
https://github.com/apache/incubator-uniffle/issues/154#issuecomment-1211531578
> When a shuffle have 0 reduce partition, is it a meaningful shuffle? What's
situation? Is it a map only application?
emmm, Now I don't know what HUDi does, this is my HUDI test code and UI .
The error occurred during the INSERT phase
```
val conf = new SparkConf()
conf.set("spark.sql.extensions","org.apache.spark.sql.hudi.HoodieSparkSessionExtension")
conf.set("spark.serializer","org.apache.spark.serializer.KryoSerializer")
conf.set("spark.shuffle.manager","org.apache.spark.shuffle.RssShuffleManager")
conf.set("spark.rss.coordinator.quorum","xx.xx.xx.xx:19999")
conf.set("spark.rss.storage.type","MEMORY_LOCALFILE")
val session: SparkSession = SparkSession.builder().config(conf)
.master("local").appName("di_hudi").getOrCreate()
session.sql(
"""
|create table if not exists hudi_tb0808_1 (
| id int,
| name string,
| work string
|) using hudi
|tblproperties (
| type = 'cow',
| primaryKey = 'id',
| preCombineField = 'work'
|)
|location '/hudi/tmp/xxx1'
|""".stripMargin)
session.sql(
s"""
|insert into hudi_tb0808_1
values(${random},'tmp1','hudi_tb0508_1')
|""".stripMargin)
```
<img width="2549" alt="image"
src="https://user-images.githubusercontent.com/41908930/184063126-5e029d62-7230-4d2c-82de-2a9c194b010c.png";>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
![https://user-images.githubusercontent.com/41908930/184063126-5e029d62-7230-4d2c-82de-2a9c194b010c.png"](https://user-images.githubusercontent.com/41908930/184063126-5e029d62-7230-4d2c-82de-2a9c194b010c.png"){kind=link}