zhengruifeng commented on PR #36640:
URL: https://github.com/apache/spark/pull/36640#issuecomment-1139270710
> So the PR is adjusted to enable [[],[]] input,
seems that the scala side do not support it:
```
scala> val rdd=sc.parallelize(Seq(Seq(), Seq()))
rdd: org.apache.spark.rdd.RDD[Seq[Nothing]] = ParallelCollectionRDD[4] at
parallelize at <console>:23
scala> val df = spark.createDataFrame(rdd=rdd)
<console>:23: error: inferred type arguments [Seq[Nothing]] do not conform
to method createDataFrame's type parameter bounds [A <: Product]
val df = spark.createDataFrame(rdd=rdd)
^
<console>:23: error: type mismatch;
found : org.apache.spark.rdd.RDD[Seq[Nothing]]
required: org.apache.spark.rdd.RDD[A]
val df = spark.createDataFrame(rdd=rdd)
^
```
BTW, if we are to support ` [[],[]] ` in the python side, I think we need to
update the PR title/descprition and add a test.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
