Hello Chris, Sounds great!. we will update the documents. Thank you!
--Jinho Best regards 2014-08-21 2:45 GMT+09:00 Christian Schwabe <[email protected]>: > Hello Jinho, > > christians-mbp:bin chris$ netstat -a | grep 49339 > tcp46 0 0 *.49339 *.* LISTEN > > tajo-chris-worker-xxx.out is completely empty. No errors in it. > > I recompile Tajo with mvn clean install -Pdist -DskipTests -Dtar > -Dhadoop.version=2.4.0 > > > AND > > > > > > > IT WORKS!!! Yiiipie aye jeah!!! :-D :-D > > > The error must have been so, since it worked for a short time that I've > recompiled wrong according to the pull request from git and have > -Dhadoop.version = 2.4.0 forgotten. Sorry for these newbie mistakes. > I am so glad that we did it together that it works now. I can only hope that > we have helped others with it who have made the same mistake as I did. > Thank you very much. > > > Best regards, > Chris > > > Am 20.08.2014 um 15:45 schrieb Jinho Kim <[email protected]>: > > Hello Chris, > > Sorry chris, I mistook your environment. > try again following command 'netstat -a | grep <shuffle port>' > looks like build issue. could you find error log in > tajo-chris-worker-xxx.out ? > > Did you build the tajo following command ? > mvn clean install -Pdist -DskipTests -Dtar -Dhadoop.version=2.4.0 // > your hadoop version > https://github.com/apache/tajo/blob/master/BUILDING > > --Jinho > Best regards > > > 2014-08-20 21:08 GMT+09:00 Christian Schwabe <[email protected]>: > > Hello Hyunsik and Jinho > > Thank you for your continued efforts. > Cluster organization: > Tajo Master and Tajo Worker run on my MacBook. No Distribution. > > For this test the TajoPullServerService shuffle on Port 54783: > 2014-08-20 13:37:48,727 INFO > org.apache.tajo.pullserver.TajoPullServerService: httpshuffle listening on > port 54783 > > > Here a full dump from my netstat: > > christians-mbp:bin chris$ netstat > Active Internet connections > Proto Recv-Q Send-Q Local Address Foreign Address (state) > tcp4 0 0 christians-mbp.f.28093 christians-mbp.f.54813 > ESTABLISHED > tcp4 0 0 christians-mbp.f.54813 christians-mbp.f.28093 > ESTABLISHED > tcp4 0 0 christians-mbp.f.28091 christians-mbp.f.54812 > ESTABLISHED > tcp4 0 0 christians-mbp.f.54812 christians-mbp.f.28091 > ESTABLISHED > tcp4 0 0 localhost.26001 localhost.54811 > ESTABLISHED > tcp4 0 0 localhost.54811 localhost.26001 > ESTABLISHED > tcp4 0 0 localhost.26005 localhost.54810 > ESTABLISHED > tcp4 0 0 localhost.54810 localhost.26005 > ESTABLISHED > tcp4 0 0 localhost.26002 localhost.54806 > ESTABLISHED > tcp4 0 0 localhost.54806 localhost.26002 > ESTABLISHED > tcp4 0 0 christians-mbp.f.54799 professional.nl..http > CLOSE_WAIT > tcp4 0 0 localhost.26003 localhost.54784 > ESTABLISHED > tcp4 0 0 localhost.54784 localhost.26003 > ESTABLISHED > tcp4 0 0 christians-mbp.f.54163 snt-re4-9c.sjc.d.http > ESTABLISHED > tcp4 0 39 christians-mbp.f.54143 diskstation.frit.afpov > ESTABLISHED > tcp4 0 0 christians-mbp.f.54101 channel-proxy-sh.https > ESTABLISHED > tcp4 0 0 christians-mbp.f.54102 channel-proxy-sh.https > ESTABLISHED > tcp4 23 0 christians-mbp.f.54100 diskstation.frit.6690 > CLOSE_WAIT > tcp4 23 0 christians-mbp.f.54058 diskstation.frit.6690 > CLOSE_WAIT > tcp4 0 0 christians-mbp.f.54057 diskstation.frit.6690 > ESTABLISHED > tcp4 0 0 christians-mbp.f.54055 diskstation.frit.6690 > ESTABLISHED > tcp4 23 0 christians-mbp.f.54051 diskstation.frit.6690 > CLOSE_WAIT > tcp4 0 0 christians-mbp.f.54029 server22404.team.5938 > ESTABLISHED > tcp4 207 0 christians-mbp.f.53391 channel-proxy-sh.https > CLOSE_WAIT > tcp4 0 0 christians-mbp.f.52913 mailgate-fb.its..imaps > CLOSE_WAIT > tcp4 0 0 christians-mbp.f.52637 lon3-accesspoint.4070 > ESTABLISHED > tcp4 0 0 christians-mbp.f.52619 channel-proxy-sh.https > FIN_WAIT_2 > tcp4 0 0 christians-mbp.f.52591 mailgate-fb.its..imaps > ESTABLISHED > tcp4 0 0 christians-mbp.f.52557 imap.gmx.net.imaps > ESTABLISHED > tcp4 0 0 christians-mbp.f.52545 imap.gmx.net.imaps > ESTABLISHED > tcp4 0 0 christians-mbp.f.52542 mailgate-fb.its..imaps > ESTABLISHED > tcp4 0 0 christians-mbp.f.52534 imap.gmx.net.imaps > ESTABLISHED > tcp4 0 0 christians-mbp.f.52524 mailgate-fb.its..imaps > ESTABLISHED > tcp4 0 0 christians-mbp.f.52523 imap.gmx.net.imaps > ESTABLISHED > tcp4 0 0 christians-mbp.f.60387 17.130.254.13.5223 > ESTABLISHED > tcp4 0 0 localhost.26164 localhost.50911 > ESTABLISHED > tcp4 0 0 localhost.50911 localhost.26164 > ESTABLISHED > tcp4 37 0 christians-mbp.f.62717 bighp.de.https > CLOSE_WAIT > tcp4 0 0 localhost.6263 localhost.51436 > ESTABLISHED > tcp4 0 0 localhost.51436 localhost.6263 > ESTABLISHED > tcp4 0 0 localhost.49153 localhost.1023 > ESTABLISHED > tcp4 0 0 localhost.1023 localhost.49153 > ESTABLISHED > udp4 0 0 localhost.ipsec-msft *.* > udp4 0 0 localhost.isakmp *.* > udp4 0 0 localhost.ipsec-msft *.* > udp4 0 0 localhost.isakmp *.* > udp4 0 0 localhost.ntp *.* > udp4 0 0 localhost.ntp *.* > udp6 0 0 *.57515 *.* > udp4 0 0 *.57515 *.* > udp6 0 0 *.61888 *.* > udp4 0 0 *.61888 *.* > udp6 0 0 *.58274 *.* > udp4 0 0 *.58274 *.* > udp6 0 0 *.60021 *.* > udp4 0 0 *.60021 *.* > udp6 0 0 *.55834 *.* > udp4 0 0 *.55834 *.* > udp6 0 0 *.50669 *.* > udp4 0 0 *.50669 *.* > udp4 0 0 *.57621 *.* > udp4 0 0 *.17500 *.* > udp6 0 0 *.52359 *.* > udp4 0 0 *.52359 *.* > udp6 0 0 *.61162 *.* > udp4 0 0 *.61162 *.* > udp6 0 0 *.64994 *.* > udp4 0 0 *.64994 *.* > udp6 0 0 *.52746 *.* > udp4 0 0 *.52746 *.* > udp6 0 0 *.52452 *.* > udp4 0 0 *.52452 *.* > udp6 0 0 *.56102 *.* > udp4 0 0 *.56102 *.* > udp46 0 0 *.* *.* > udp4 0 0 all-systems.mcas.5350 *.* > udp4 0 0 christians-mbp.f.ipsec *.* > udp4 0 0 christians-mbp.f.isakm *.* > udp6 0 0 christians-macbo.ipsec *.* > udp6 0 0 christians-macbo.isakm *.* > udp4 0 0 christians-mbp.f.ntp *.* > udp46 0 0 *.* *.* > udp6 0 0 christians-macbo.ntp *.* > udp46 0 0 *.* *.* > udp46 0 0 *.* *.* > udp46 0 0 *.* *.* > udp4 0 0 *.* *.* > udp4 0 0 *.* *.* > udp4 0 0 *.* *.* > udp6 0 0 fd87:142d:29d4:9.ipsec *.* > udp6 0 0 fd87:142d:29d4:9.isakm *.* > udp6 0 0 fd87:142d:29d4:9.ntp *.* > udp6 0 0 fe80::6c2f:2fc4:.ntp *.* > udp6 0 0 localhost.ipsec-ms *.* > udp6 0 0 localhost.isakmp *.* > udp4 0 0 localhost.ipsec-msft *.* > udp4 0 0 localhost.isakmp *.* > udp6 0 0 localhost.ipsec-ms *.* > udp6 0 0 localhost.isakmp *.* > udp6 0 0 fe80::6c2f:2fc4:.ipsec *.* > udp6 0 0 fe80::6c2f:2fc4:.isakm *.* > udp6 0 0 localhost.ntp *.* > udp4 0 0 localhost.ntp *.* > udp6 0 0 localhost.ntp *.* > udp6 0 0 *.ntp *.* > udp4 0 0 *.ntp *.* > udp46 0 0 *.* *.* > udp4 0 0 *.* *.* > udp4 0 0 *.* *.* > udp4 0 0 *.* *.* > udp4 0 0 *.* *.* > udp4 0 0 *.* *.* > udp4 0 0 *.* *.* > udp46 0 0 *.* *.* > udp4 0 0 *.* *.* > udp6 0 0 *.mdns *.* > udp4 0 0 *.mdns *.* > udp4 0 0 *.* *.* > udp4 0 0 *.* *.* > udp4 0 0 *.netbios-dgm *.* > udp4 0 0 *.netbios-ns *.* > icm4 0 0 *.* *.* > icm6 0 0 *.* *.* > > > As you can see no service is running on the previously established Port. > In summary this means, according to the log of the Service > TajoPullServerService the port is listening, but according to netstat no > such port ist open. > My Firewall was turned off for this test. There was no improvement. > > > > For addition: > The exception is only thrown if i made the following statement. > > default> SELECT COUNT(*) FROM table1; > Progress: 0%, response time: 0.8 sec > Progress: 0%, response time: 0.807 sec > Progress: 0%, response time: 1.012 sec > Progress: 50%, response time: 1.413 sec > ERROR: 1 > java.lang.ArrayIndexOutOfBoundsException: 1 > at org.apache.tajo.util.BitArray.fromByteBuffer(BitArray.java:84) > at org.apache.tajo.storage.RawFile$RawFileScanner.next(RawFile.java:243) > at > org.apache.tajo.engine.planner.physical.SeqScanExec.next(SeqScanExec.java:254) > at > org.apache.tajo.engine.planner.physical.HashAggregateExec.compute(HashAggregateExec.java:51) > at > org.apache.tajo.engine.planner.physical.HashAggregateExec.next(HashAggregateExec.java:87) > at > org.apache.tajo.engine.planner.physical.StoreTableExec.next(StoreTableExec.java:77) > at org.apache.tajo.worker.Task.run(Task.java:425) > at org.apache.tajo.worker.TaskRunner$1.run(TaskRunner.java:425) > at java.lang.Thread.run(Thread.java:745) > > SELECT * FROM table1; is no problem. > > default> SELECT * FROM table1; > id, name, score, type > ------------------------------- > 1, abc, 1.1, a > 2, def, 2.3, b > 3, ghi, 3.4, c > 4, jkl, 4.5, d > 5, mno, 5.6, e > (5 rows, 0.955 sec, 59 B selected) > > > > If you need any further information don’t hesitate to ask. > > > > @@Jinho: I don’t know exactly what you mean with: stop iptables???? > > Best regards, > Chris > > > > >
