That’s so cool! Great work y’all :) On Tue, Sep 12, 2023 at 8:14 PM bo yang <bobyan...@gmail.com> wrote:
> Hi Spark Friends, > > Anyone interested in using Golang to write Spark application? We created a > Spark > Connect Go Client library <https://github.com/apache/spark-connect-go>. > Would love to hear feedback/thoughts from the community. > > Please see the quick start guide > <https://github.com/apache/spark-connect-go/blob/master/quick-start.md> > about how to use it. Following is a very short Spark Connect application in > Go: > > func main() { > spark, _ := > sql.SparkSession.Builder.Remote("sc://localhost:15002").Build() > defer spark.Stop() > > df, _ := spark.Sql("select 'apple' as word, 123 as count union all > select 'orange' as word, 456 as count") > df.Show(100, false) > df.Collect() > > df.Write().Mode("overwrite"). > Format("parquet"). > Save("file:///tmp/spark-connect-write-example-output.parquet") > > df = spark.Read().Format("parquet"). > Load("file:///tmp/spark-connect-write-example-output.parquet") > df.Show(100, false) > > df.CreateTempView("view1", true, false) > df, _ = spark.Sql("select count, word from view1 order by count") > } > > > Many thanks to Martin, Hyukjin, Ruifeng and Denny for creating and working > together on this repo! Welcome more people to contribute :) > > Best, > Bo > >
