Re: Spark Source Code Configuration

[Deepu Raj]

Thanks Kai,

I am getting the message and its stuck when I run sbt any idea:-

"Set current project to spark-parent (in build file:/home/cloudera/spark/)"

Details attached.

Regards,
Deepu Raj
+61 414 707 319




On Fri, 20 Jan 2017 10:27:16 +1100, Kai Jiang  wrote:


Hi Deepu,

Hope this page can give you some help. 
http://spark.apache.org/developer-tools.html

Best,
Kai

On Thu, Jan 19, 2017, 14:51 Deepu Raj 
mailto:deepuraj_t...@outlook.com>> wrote:
Hi,

Is there any article/Docs/support to set up Apache Spark source code on
Eclipse/InteliJ.

I have tried setting up the source code, by importing into Git & using
maven. I am getting lot of compilation errors.

#suggestions

Regards,
Deepu Raj
+61 414 707 319

-
To unsubscribe e-mail: 
dev-unsubscr...@spark.apache.org




--
Using Opera's mail client: http://www.opera.com/mail/
[cloudera@quickstart spark]$ sudo yum install sbt
Loaded plugins: fastestmirror, security
Setting up Install Process
Loading mirror speeds from cached hostfile
epel/metalink  | 2.7 kB 
00:00
 * base: centos.uberglobalmirror.com
 * epel: mirror.intergrid.com.au
 * extras: centos.uberglobalmirror.com
 * updates: mirror.ventraip.net.au
base   | 3.7 kB 
00:00
base/primary_db| 4.7 MB 
00:04
bintray--sbt-rpm   | 1.3 kB 
00:00
bintray--sbt-rpm/primary   | 2.0 kB 
00:00
bintray--sbt-rpm
13/13
cloudera-cdh5  |  951 B 
00:00
cloudera-cdh5/primary  |  43 kB 
00:00
cloudera-cdh5   
  146/146
cloudera-gplextras5|  951 B 
00:00
cloudera-gplextras5/primary| 2.4 kB 
00:00
cloudera-gplextras5 
  9/9
cloudera-kafka |  951 B 
00:00
cloudera-kafka/primary | 1.8 kB 
00:00
cloudera-kafka  
  4/4
cloudera-manager   |  951 B 
00:00
cloudera-manager/primary   | 4.3 kB 
00:00
cloudera-manager
  7/7
http://mirror.intergrid.com.au/epel/6/x86_64/repodata/repomd.xml: [Errno 14] 
PYCURL ERROR 6 - "Couldn't resolve host 
'mirror.intergrid.com.au'"
Trying other mirror.
http://epel.mirror.web24.net.au/6/x86_64/repodata/repomd.xml: [Errno 14] PYCURL 
ERROR 6 - "Couldn't resolve host 
'epel.mirror.web24.net.au'"
Trying other mirror.
epel   | 4.3 kB 
00:00
epel/primary_db| 5.9 MB 
00:04
extras | 3.4 kB 
00:00
extras/primary_db  |  37 kB 
00:00
updates| 3.4 kB 
00:00
updates/primary_db | 4.3 MB 
00:04
Resolving Dependencies
--> Running transaction check
---> Package sbt.noarch 0:0.13.13.1-1 will be installed
--> Processing Dependency: jpackage-utils for package: sbt-0.13.13.1-1.noarch
--> Processing Dependency: java-devel for package: sbt-0.13.13.1-1.noarch
--> Running transaction check
---> Package java-1.7.0-openjdk-devel.x86_64 1:1.7.0.121-2.6.8.1.el6_8 will be 
installed
--> Processing Dependency: java-1.7.0-openjdk = 1:1.7.0.121-2.6.8.1.el6_8 for 
package: 1:j
ava-1.7.0-openjdk-devel-1.7.0.121-2.6.8.1.el6_8.x86_64
---> Package jpackage-utils.noarch 0:1.7.5-3.16.el6 will be installed
--> Running transaction check
---> Package java-1.7.0-openjdk.x86_64 1:1.7.0.121-2.6.8.1.el6_8 will be 
installed
--> Processing Dependency: nss(x86-64) >= 3.21.0 for package: 
1:java-1.7.0-openjdk-1.7.0.1
21-2.6.8.1.el6_8.x86_64
--> Processing Dependency: xorg-x11-fonts-Type1 for package: 
1:java-1.7.0-openjdk-1.7.0.12
1-2.6.8.1.el6_8.x86_64
--> Processing Dependency: tzdata-java for package: 
1:java-1.7.0-openjdk-1.7.0.121-2.6.8.1
.el6_8.x86_64
--> Processing Dependency: libsctp.so.1(VERS_1)(64bit) for pack

Re: Spark Source Code Configuration

[Kai Jiang]

Hi Deepu,

Hope this page can give you some help.
http://spark.apache.org/developer-tools.html

Best,
Kai

On Thu, Jan 19, 2017, 14:51 Deepu Raj  wrote:

> Hi,
>
> Is there any article/Docs/support to set up Apache Spark source code on
> Eclipse/InteliJ.
>
> I have tried setting up the source code, by importing into Git & using
> maven. I am getting lot of compilation errors.
>
> #suggestions
>
> Regards,
> Deepu Raj
> +61 414 707 319
>
> -
> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>
>