RE: RDD functions using GUI

2017-04-18 Thread Ke Yang (Conan)
Ping... wonder why there aren't any such drag-n-drop GUI tool for creating batch query scripts? Thanks From: Ke Yang (Conan) Sent: Monday, April 17, 2017 5:31 PM To: 'dev@spark.apache.org' <dev@spark.apache.org> Subject: RDD functions using GUI Hi, Are there drag and drop GUI (cod

RDD functions using GUI

2017-04-17 Thread Ke Yang (Conan)
Hi, Are there drag and drop GUI (code-free) for RDD functions available? i.e. a GUI that generates code based on drag-n-drops? http://spark.apache.org/docs/latest/programming-guide.html#resilient-distributed-datasets-rdds thanks for brainstorming

OOM by huge header size attack: setResponseHeaderSize won't work

2017-03-23 Thread Ke Yang (Conan)
Folks, We use NiFi which embeds Jetty Server. Our test team found a security bug by intercepting the http request and replacing the header with a huge (say 1GB) text, which sent the response to NCM, which got OOM: 2017-03-07 03:44:03,522 WARN [NiFi Web Server-22]