Questions for platform to choose

2019-08-20 Thread Eliza
Hello, We have all of spark, flink, storm, kafka installed. For realtime streaming calculation, which one is the best above? Like other big players, the logs in our stack are huge. Thanks. - To unsubscribe e-mail: user-unsubscr

Unsubscribe

2019-08-20 Thread ERIC JOEL BLANCO-HERMIDA SANZ
Unsubscribe Este mensaje y sus adjuntos se dirigen exclusivamente a su destinatario, puede contener información privilegiada o confidencial y es para uso exclusivo de la persona o entidad de destino. Si no es usted. el destinatario indicado, queda notificado de

Re:unresolved operator union in Spark 1.6

2019-08-20 Thread 大啊
You can upgrade your Spark to version 2.x. At 2019-08-20 19:16:50, "马阳阳" wrote: Hi all, We encountered the following problem when using Spark 1.6. The following SQL: ``` SELECT a,b,c FROM A UNION ALL SELECT a,b,c FROM B ``` If A and B are two views created with SQLContext.registerDat

unresolved operator union in Spark 1.6

2019-08-20 Thread 马阳阳
Hi all, We encountered the following problem when using Spark 1.6. The following SQL: ``` SELECT a,b,c FROM A UNION ALL SELECT a,b,c FROM B ``` If A and B are two views created with SQLContext.registerDataFrameAsTable(), Spark will fail with “unresolved operator Union”. But if A and B are s

Re: Unable to write data from Spark into a Hive Managed table

2019-08-20 Thread HARSH TAKKAR
Please refere to the following documentation on how to write data into hive in hdp3.1 https://docs.hortonworks.com/HDPDocuments/HDP3/HDP-3.1.0/integrating-hive/content/hive_hivewarehouseconnector_for_handling_apache_spark_data.html Harsh On Fri, 9 Aug, 2019, 10:21 PM Mich Talebzadeh, wrote:

Unresolved operator Union in Spark 1.6

2019-08-20 Thread 马阳阳
Hi all, We encountered the following problem when using Spark 1.6. The following SQL: ``` SELECT a,b,c FROM A UNION ALL SELECT a,b,c FROM B ``` If A and B are two views created with SQLContext.registerDataFrameAsTable(), Spark will fail with “unresolved operator Union”. But if A and B