回复：Validate spark sql

What about EXPLAIN? https://spark.apache.org/docs/3.5.0/sql-ref-syntax-qry-explain.html#content Fusion Zhu

回复：Spark - ElasticSearch Integration

Hello 1. Maybe you can define and save schema in somewhere before use it in SparkStreaming.Then read it from somewhere when start streaming. 2. What about process events in method foreachBatch Fusion Zhu -- 发件人：Siva Samraj

回复：To monitor the executors of a Spark application

In my opinion, It is 1 Driver Fusion Zhu -- 发件人：Dhiman 发送时间：2020年9月27日(星期日) 23:23 收件人：user 主　题：To monitor the executors of a Spark application Who is responsible to monitor the executors of Spark Application ? 1. Driver Node

回复：Submitting Spark Job thru REST API?

Hello, Eric Maybe you can use Spark JobServer 0.10.0 https://github.com/spark-jobserver/spark-jobserverl We used this with Spark 1.6, and it is awesome. You know the project is still very active. So highly recommend it to you Fusion Zhu

回复：[Spark-Kafka-Streaming] Verifying the approach for multiple queries

Hello, Sir! What about process and group the data first then write grouped data to Kafka topics A and B. Then read topic A or B from another Spark Application and process it more. Like the term ETL's mean. TianlangStudio Some of the biggest lies: I will start tomorrow/Others are better

回复：What is an "analytics engine"?

Hello, Sir Engine means Spark has the feature to process data. But it is musted to be component with other for building data platform. Data Platform likes a car and Spark likes the motor. I am wrong, Maybe. TianlangStudio Some of the biggest lies: I will start tomorrow/Others are better

回复：Apache Spark- Help with email library

I use SimpleJavaEmail http://www.simplejavamail.org/#/features for Send email and parse email file. It is awesome and may help you. TianlangStudio Some of the biggest lies: I will start tomorrow/Others are better than me/I am not good enough/I don't have time/This is the way I am

回复：SPARK Suitable IDE

We use IntelliJ IDEA,Whether it's Java, Scala or Python TianlangStudio Some of the biggest lies: I will start tomorrow/Others are better than me/I am not good enough/I don't have time/This is the way I am -- 发件人：Zahid

回复：How to submit a jar from Remote Server

What about SparkJobServer https://github.com/spark-jobserver/spark-jobserver and Apache livy https://github.com/apache/incubator-livy ? TianlangStudio Some of the biggest lies: I will start tomorrow/Others are better than me/I am not good enough/I don't have time/This is the way I am