Hi Spark communities, I just found out that in https://spark.apache.org/docs/latest/api/python/pyspark.html#pyspark.RDD.fullOuterJoin, the documentation is "Perform a right outer join of self and other." It should be a full outer join, not a right outer join, as shown in the example and the method name.
Please check it out. Thanks! Yours sincerely, Hieu Nguyen