Hello Jinho, christians-mbp:bin chris$ netstat -a | grep 49339 tcp46 0 0 *.49339 *.* LISTEN
tajo-chris-worker-xxx.out is completely empty. No errors in it. I recompile Tajo with mvn clean install -Pdist -DskipTests -Dtar -Dhadoop.version=2.4.0 AND IT WORKS!!! Yiiipie aye jeah!!! :-D :-D The error must have been so, since it worked for a short time that I've recompiled wrong according to the pull request from git and have -Dhadoop.version = 2.4.0 forgotten. Sorry for these newbie mistakes. I am so glad that we did it together that it works now. I can only hope that we have helped others with it who have made the same mistake as I did. Thank you very much. Best regards, Chris Am 20.08.2014 um 15:45 schrieb Jinho Kim <[email protected]>: > Hello Chris, > > Sorry chris, I mistook your environment. > try again following command 'netstat -a | grep <shuffle port>' > looks like build issue. could you find error log in tajo-chris-worker-xxx.out > ? > > Did you build the tajo following command ? > mvn clean install -Pdist -DskipTests -Dtar -Dhadoop.version=2.4.0 // > your hadoop version > https://github.com/apache/tajo/blob/master/BUILDING > > --Jinho > Best regards > > > 2014-08-20 21:08 GMT+09:00 Christian Schwabe <[email protected]>: >> Hello Hyunsik and Jinho >> >> Thank you for your continued efforts. >> Cluster organization: >> Tajo Master and Tajo Worker run on my MacBook. No Distribution. >> >> For this test the TajoPullServerService shuffle on Port 54783: >> 2014-08-20 13:37:48,727 INFO >> org.apache.tajo.pullserver.TajoPullServerService: httpshuffle listening on >> port 54783 >> >> >> Here a full dump from my netstat: >> >> christians-mbp:bin chris$ netstat >> Active Internet connections >> Proto Recv-Q Send-Q Local Address Foreign Address (state) >> tcp4 0 0 christians-mbp.f.28093 christians-mbp.f.54813 >> ESTABLISHED >> tcp4 0 0 christians-mbp.f.54813 christians-mbp.f.28093 >> ESTABLISHED >> tcp4 0 0 christians-mbp.f.28091 christians-mbp.f.54812 >> ESTABLISHED >> tcp4 0 0 christians-mbp.f.54812 christians-mbp.f.28091 >> ESTABLISHED >> tcp4 0 0 localhost.26001 localhost.54811 >> ESTABLISHED >> tcp4 0 0 localhost.54811 localhost.26001 >> ESTABLISHED >> tcp4 0 0 localhost.26005 localhost.54810 >> ESTABLISHED >> tcp4 0 0 localhost.54810 localhost.26005 >> ESTABLISHED >> tcp4 0 0 localhost.26002 localhost.54806 >> ESTABLISHED >> tcp4 0 0 localhost.54806 localhost.26002 >> ESTABLISHED >> tcp4 0 0 christians-mbp.f.54799 professional.nl..http >> CLOSE_WAIT >> tcp4 0 0 localhost.26003 localhost.54784 >> ESTABLISHED >> tcp4 0 0 localhost.54784 localhost.26003 >> ESTABLISHED >> tcp4 0 0 christians-mbp.f.54163 snt-re4-9c.sjc.d.http >> ESTABLISHED >> tcp4 0 39 christians-mbp.f.54143 diskstation.frit.afpov >> ESTABLISHED >> tcp4 0 0 christians-mbp.f.54101 channel-proxy-sh.https >> ESTABLISHED >> tcp4 0 0 christians-mbp.f.54102 channel-proxy-sh.https >> ESTABLISHED >> tcp4 23 0 christians-mbp.f.54100 diskstation.frit.6690 >> CLOSE_WAIT >> tcp4 23 0 christians-mbp.f.54058 diskstation.frit.6690 >> CLOSE_WAIT >> tcp4 0 0 christians-mbp.f.54057 diskstation.frit.6690 >> ESTABLISHED >> tcp4 0 0 christians-mbp.f.54055 diskstation.frit.6690 >> ESTABLISHED >> tcp4 23 0 christians-mbp.f.54051 diskstation.frit.6690 >> CLOSE_WAIT >> tcp4 0 0 christians-mbp.f.54029 server22404.team.5938 >> ESTABLISHED >> tcp4 207 0 christians-mbp.f.53391 channel-proxy-sh.https >> CLOSE_WAIT >> tcp4 0 0 christians-mbp.f.52913 mailgate-fb.its..imaps >> CLOSE_WAIT >> tcp4 0 0 christians-mbp.f.52637 lon3-accesspoint.4070 >> ESTABLISHED >> tcp4 0 0 christians-mbp.f.52619 channel-proxy-sh.https >> FIN_WAIT_2 >> tcp4 0 0 christians-mbp.f.52591 mailgate-fb.its..imaps >> ESTABLISHED >> tcp4 0 0 christians-mbp.f.52557 imap.gmx.net.imaps >> ESTABLISHED >> tcp4 0 0 christians-mbp.f.52545 imap.gmx.net.imaps >> ESTABLISHED >> tcp4 0 0 christians-mbp.f.52542 mailgate-fb.its..imaps >> ESTABLISHED >> tcp4 0 0 christians-mbp.f.52534 imap.gmx.net.imaps >> ESTABLISHED >> tcp4 0 0 christians-mbp.f.52524 mailgate-fb.its..imaps >> ESTABLISHED >> tcp4 0 0 christians-mbp.f.52523 imap.gmx.net.imaps >> ESTABLISHED >> tcp4 0 0 christians-mbp.f.60387 17.130.254.13.5223 >> ESTABLISHED >> tcp4 0 0 localhost.26164 localhost.50911 >> ESTABLISHED >> tcp4 0 0 localhost.50911 localhost.26164 >> ESTABLISHED >> tcp4 37 0 christians-mbp.f.62717 bighp.de.https >> CLOSE_WAIT >> tcp4 0 0 localhost.6263 localhost.51436 >> ESTABLISHED >> tcp4 0 0 localhost.51436 localhost.6263 >> ESTABLISHED >> tcp4 0 0 localhost.49153 localhost.1023 >> ESTABLISHED >> tcp4 0 0 localhost.1023 localhost.49153 >> ESTABLISHED >> udp4 0 0 localhost.ipsec-msft *.* >> udp4 0 0 localhost.isakmp *.* >> udp4 0 0 localhost.ipsec-msft *.* >> udp4 0 0 localhost.isakmp *.* >> udp4 0 0 localhost.ntp *.* >> udp4 0 0 localhost.ntp *.* >> udp6 0 0 *.57515 *.* >> udp4 0 0 *.57515 *.* >> udp6 0 0 *.61888 *.* >> udp4 0 0 *.61888 *.* >> udp6 0 0 *.58274 *.* >> udp4 0 0 *.58274 *.* >> udp6 0 0 *.60021 *.* >> udp4 0 0 *.60021 *.* >> udp6 0 0 *.55834 *.* >> udp4 0 0 *.55834 *.* >> udp6 0 0 *.50669 *.* >> udp4 0 0 *.50669 *.* >> udp4 0 0 *.57621 *.* >> udp4 0 0 *.17500 *.* >> udp6 0 0 *.52359 *.* >> udp4 0 0 *.52359 *.* >> udp6 0 0 *.61162 *.* >> udp4 0 0 *.61162 *.* >> udp6 0 0 *.64994 *.* >> udp4 0 0 *.64994 *.* >> udp6 0 0 *.52746 *.* >> udp4 0 0 *.52746 *.* >> udp6 0 0 *.52452 *.* >> udp4 0 0 *.52452 *.* >> udp6 0 0 *.56102 *.* >> udp4 0 0 *.56102 *.* >> udp46 0 0 *.* *.* >> udp4 0 0 all-systems.mcas.5350 *.* >> udp4 0 0 christians-mbp.f.ipsec *.* >> udp4 0 0 christians-mbp.f.isakm *.* >> udp6 0 0 christians-macbo.ipsec *.* >> udp6 0 0 christians-macbo.isakm *.* >> udp4 0 0 christians-mbp.f.ntp *.* >> udp46 0 0 *.* *.* >> udp6 0 0 christians-macbo.ntp *.* >> udp46 0 0 *.* *.* >> udp46 0 0 *.* *.* >> udp46 0 0 *.* *.* >> udp4 0 0 *.* *.* >> udp4 0 0 *.* *.* >> udp4 0 0 *.* *.* >> udp6 0 0 fd87:142d:29d4:9.ipsec *.* >> udp6 0 0 fd87:142d:29d4:9.isakm *.* >> udp6 0 0 fd87:142d:29d4:9.ntp *.* >> udp6 0 0 fe80::6c2f:2fc4:.ntp *.* >> udp6 0 0 localhost.ipsec-ms *.* >> udp6 0 0 localhost.isakmp *.* >> udp4 0 0 localhost.ipsec-msft *.* >> udp4 0 0 localhost.isakmp *.* >> udp6 0 0 localhost.ipsec-ms *.* >> udp6 0 0 localhost.isakmp *.* >> udp6 0 0 fe80::6c2f:2fc4:.ipsec *.* >> udp6 0 0 fe80::6c2f:2fc4:.isakm *.* >> udp6 0 0 localhost.ntp *.* >> udp4 0 0 localhost.ntp *.* >> udp6 0 0 localhost.ntp *.* >> udp6 0 0 *.ntp *.* >> udp4 0 0 *.ntp *.* >> udp46 0 0 *.* *.* >> udp4 0 0 *.* *.* >> udp4 0 0 *.* *.* >> udp4 0 0 *.* *.* >> udp4 0 0 *.* *.* >> udp4 0 0 *.* *.* >> udp4 0 0 *.* *.* >> udp46 0 0 *.* *.* >> udp4 0 0 *.* *.* >> udp6 0 0 *.mdns *.* >> udp4 0 0 *.mdns *.* >> udp4 0 0 *.* *.* >> udp4 0 0 *.* *.* >> udp4 0 0 *.netbios-dgm *.* >> udp4 0 0 *.netbios-ns *.* >> icm4 0 0 *.* *.* >> icm6 0 0 *.* *.* >> >> >> As you can see no service is running on the previously established Port. >> In summary this means, according to the log of the Service >> TajoPullServerService the port is listening, but according to netstat no >> such port ist open. >> My Firewall was turned off for this test. There was no improvement. >> >> >> >> For addition: >> The exception is only thrown if i made the following statement. >> >> default> SELECT COUNT(*) FROM table1; >> Progress: 0%, response time: 0.8 sec >> Progress: 0%, response time: 0.807 sec >> Progress: 0%, response time: 1.012 sec >> Progress: 50%, response time: 1.413 sec >> ERROR: 1 >> java.lang.ArrayIndexOutOfBoundsException: 1 >> at org.apache.tajo.util.BitArray.fromByteBuffer(BitArray.java:84) >> at org.apache.tajo.storage.RawFile$RawFileScanner.next(RawFile.java:243) >> at >> org.apache.tajo.engine.planner.physical.SeqScanExec.next(SeqScanExec.java:254) >> at >> org.apache.tajo.engine.planner.physical.HashAggregateExec.compute(HashAggregateExec.java:51) >> at >> org.apache.tajo.engine.planner.physical.HashAggregateExec.next(HashAggregateExec.java:87) >> at >> org.apache.tajo.engine.planner.physical.StoreTableExec.next(StoreTableExec.java:77) >> at org.apache.tajo.worker.Task.run(Task.java:425) >> at org.apache.tajo.worker.TaskRunner$1.run(TaskRunner.java:425) >> at java.lang.Thread.run(Thread.java:745) >> >> SELECT * FROM table1; is no problem. >> >> default> SELECT * FROM table1; >> id, name, score, type >> ------------------------------- >> 1, abc, 1.1, a >> 2, def, 2.3, b >> 3, ghi, 3.4, c >> 4, jkl, 4.5, d >> 5, mno, 5.6, e >> (5 rows, 0.955 sec, 59 B selected) >> >> >> >> If you need any further information don’t hesitate to ask. >> >> >> >> @@Jinho: I don’t know exactly what you mean with: stop iptables???? >> >> Best regards, >> Chris >> >> >> >>
