about spark on hbase problem

2021-08-17 Thread igyu
System.setProperty("java.security.krb5.conf", config.getJSONObject("auth").getString("krb5")) val conf = HBaseConfiguration.create() val zookeeper = config.getString("zookeeper") val port = config.getString("port") conf.set(HConstants.ZOOKEEPER_QUORUM, zookeeper)

Java : Testing RDD aggregateByKey

2021-08-17 Thread Pedro Tuero
Context: spark-core_2.12-3.1.1 Testing with maven and eclipse. I'm modifying a project and a test stops working as expected. The difference is in the parameters passed to the function aggregateByKey of JavaPairRDD. JavaSparkContext is created this way: new JavaSparkContext(new SparkConf()

Re: Databricks notebook - cluster taking a long time to get created, often timing out

2021-08-17 Thread Denny Lee
Hi Karan, You may want to ping Databricks Help or Forums as this is a Databricks specific question. I'm a little surprised that a Databricks cluster would take a long time to create so it may be best to utilize these

Re: Databricks notebook - cluster taking a long time to get created, often timing out

2021-08-17 Thread Jeff Zhang
Maybe you can try the zeppelin notebook. http://zeppelin.apache.org/ karan alang 于2021年8月17日周二 下午2:11写道: > Hello - i've been using the Databricks notebook(for pyspark or scala/spark > development), and recently have had issues wherein the cluster creation > takes a long time to get created,

Databricks notebook - cluster taking a long time to get created, often timing out

2021-08-17 Thread karan alang
Hello - i've been using the Databricks notebook(for pyspark or scala/spark development), and recently have had issues wherein the cluster creation takes a long time to get created, often timing out. Any ideas on how to resolve this ? Any other alternatives to databricks notebook ?