[jira] [Created] (ZEPPELIN-3079) Flink Interpreter Error
ajinkya mahakalkar created ZEPPELIN-3079:
Summary: Flink Interpreter Error
Key: ZEPPELIN-3079
URL: https://issues.apache.org/jira/browse/ZEPPELIN-3079
Project: Zeppelin
Issue Type: Bug
Reporter: ajinkya mahakalkar
Hi,
I am trying to run flink interpreter but getting error.
I have attached the complete log.
Can somebody tell me what configurations values are required to start a flink
mini local cluster.
Currently, I have the following configurations in my code:
flinkConf = new org.apache.flink.configuration.Configuration();
flinkConf.setInteger(ConfigConstants.LOCAL_NUMBER_TASK_MANAGER, 2);
flinkConf.setInteger(ConfigConstants.TASK_MANAGER_NUM_TASK_SLOTS,
3);
//flinkConf.setString(ConfigConstants.DEFAULT_EXECUTION_RETRY_DELAY_KEY, "0
ms");
flinkConf.setInteger(ConfigConstants.TASK_MANAGER_MEMORY_SIZE_KEY,
12);
flinkConf.setString(ConfigConstants.AKKA_CLIENT_TIMEOUT,"1 min");
flinkConf.setString(ConfigConstants.JOB_MANAGER_IPC_ADDRESS_KEY,"localhost");
flinkConf.setInteger(ConfigConstants.JOB_MANAGER_IPC_PORT_KEY,6123);
flinkConf.setInteger(ConfigConstants.JOB_MANAGER_WEB_PORT_KEY,8081);
flinkConf.setString(JobManagerOptions.ADDRESS,"localhost");
localFlinkCluster = new LocalFlinkMiniCluster(flinkConf,false);
flinkIloop = new
FlinkILoop("10.76.165.32",localFlinkCluster.getLeaderRPCPort(),
flinkConf, Option.empty(),
(BufferedReader) null, new PrintWriter(out));
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Created] (ZEPPELIN-3074) Flink Interpreter Error
ajinkya mahakalkar created ZEPPELIN-3074: Summary: Flink Interpreter Error Key: ZEPPELIN-3074 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3074 Project: Zeppelin Issue Type: Bug Reporter: ajinkya mahakalkar Priority: Blocker Hi, I am trying to pass a flink code through java thrift client. While sending the flink code through client using thrift, the server is throwing the following error: org.apache.flink.client.program.ProgramInvocationException: Could not start the ActorSystem needed to talk to the JobManager. also, imain.interpret() method is throwing error on println() statements. My client code is also in Java and I am passing the flink code as a string. The code i am trying to pass is as follows: String flinkCode3="val data = List(\"hi\",\"how are you\",\"hi\")\n" + "val dataSet = benv.fromCollection(data)\n" + "val words = dataSet.flatMap(value => value.split(\"s+\"))\n" + "val mappedWords = words.map(value => (value,1))\n" + "val grouped = mappedWords.groupBy(0)\n" + "val sum = grouped.sum(1)\n" + "println(sum.collect())\n"; Every line from the above get is returning success code except for the last line. Is there anything i am doing wrong or is there any setting/config that i need to set? As I am not able to post this error in the mailing list, I am posting it here. Request your help in resolving this as soon as possible. appreciate your help. Thank you -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (ZEPPELIN-3055) Zeppelin Spawning a Scala Interpreter
ajinkya mahakalkar created ZEPPELIN-3055: Summary: Zeppelin Spawning a Scala Interpreter Key: ZEPPELIN-3055 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3055 Project: Zeppelin Issue Type: Task Reporter: ajinkya mahakalkar Priority: Critical Hi Team, Can anybody explain to me that how does Zeppelin Spawn a Scala Interpreter without using JSch or any other component to execute the flink code. I am trying to build a flink interpreter in a similar way it is built in Zeppelin. Any guidance will be of great help. Thank you -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (ZEPPELIN-3028) not able to run flink class
ajinkya mahakalkar created ZEPPELIN-3028:
Summary: not able to run flink class
Key: ZEPPELIN-3028
URL: https://issues.apache.org/jira/browse/ZEPPELIN-3028
Project: Zeppelin
Issue Type: Test
Components: build
Reporter: ajinkya mahakalkar
Priority: Blocker
Hi,
I have built a sample main class which calls the flink adapter on Zeppelin and
created a fat jar out of the code.
The modules that I have included while building are:
Zeppelin
interpreter
Zeppelin: Flink
Zeppelin: Flink module has a main class named as SampleMain which calls the
FlinkInterpreter.java and opens a connection with Flink and executes a flink
code.
SampleMain.java
package org.apache.zeppelin.flink;
import org.apache.zeppelin.interpreter.InterpreterContext;
import org.apache.zeppelin.interpreter.InterpreterResult;
import java.util.Properties;
public class SampleMain {
public static void main(String args[]){
FlinkInterpreter flink;
InterpreterContext context;
Properties p = new Properties();
flink = new FlinkInterpreter(p);
flink.open();
context = new InterpreterContext(null, null, null, null, null, null, null,
null,
null, null, null, null);
InterpreterResult result = flink.interpret("val a=1", context);
result = flink.interpret("print(a)", context);
System.out.println(result.message().get(0).getData());
}
}
After building this jar, I am running the jar (using java -cp ) where zeppelin
is installed and running.
Cmd: java -cp zeppelin-flink_2.10-0.8.0-SNAPSHOT-jar-with-dependencies.jar
org.apache.zeppelin.flink.SampleMain
I am getting the following error:
Exception in thread "main" java.lang.RuntimeException: Could not start Flink
mini cluster.
at
org.apache.zeppelin.flink.FlinkInterpreter.startFlinkMiniCluster(FlinkInterpreter.java:399)
at
org.apache.zeppelin.flink.FlinkInterpreter.open(FlinkInterpreter.java:85)
at org.apache.zeppelin.flink.SampleMain.main(SampleMain.java:18)
Caused by: com.typesafe.config.ConfigException$Missing: No configuration
setting found for key 'akka.remote.log-received-messages'
at com.typesafe.config.impl.SimpleConfig.findKey(SimpleConfig.java:124)
at com.typesafe.config.impl.SimpleConfig.find(SimpleConfig.java:145)
at com.typesafe.config.impl.SimpleConfig.find(SimpleConfig.java:151)
Please tell me what else changes do I need to make in the code to make this
work.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Created] (ZEPPELIN-3018) not able to build the project on windows machine
ajinkya mahakalkar created ZEPPELIN-3018: Summary: not able to build the project on windows machine Key: ZEPPELIN-3018 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3018 Project: Zeppelin Issue Type: Bug Components: build Affects Versions: 0.7.3 Reporter: ajinkya mahakalkar Hi, I am trying to build the Zeppelin Jar on a windows machine but the build is getting failed with the following error: [ERROR] Failed to execute goal org.apache.maven.plugins:maven-dependency-plugin: 2.8:copy (copy-artifact) on project zeppelin-interpreter: Error copying artifact from D:\Projects\zeppelin-master\zeppelin-master\zeppelin-interpreter\target\zeppelin-interpreter-0.8.0-SNAPSHOT.jar to D:\Projects\zeppelin-master\zeppelin-master\zeppelin-interpreter\interpreter\Zeppelin: Interpreter\zeppelin-interpreter-0.8.0-SNAPSHOT.jar: The filename, directory name, or volume label syntax is incorrect -> [Help 1] Can we not build this project on a Windows Machine? If yes then what changes do we need to make to build this code? Thank you..!! -- This message was sent by Atlassian JIRA (v6.4.14#64029)
