another thing,
the - Permission denied 13 happens on the local FS (tables data) can be the RangeServer using the DFSBroker::Open -- (that is READONLY) to CREATE HINT FILES! by time ( 1391756724) -- it uses open and not create! LOGS: 1391756705 INFO Hypertable.RangeServer : (/root/src/hypertable/src/cc/Hypertable/RangeServer/AccessGroupHintsFile.cc:116) Exception caught writing hints file /hypertable/tables/2/0/default/P7kY29TZuWPvewLB/hints - DFS BROKER permission denied 1391756705 INFO Hypertable.RangeServer : (/root/src/hypertable/src/cc/Hypertable/RangeServer/AccessGroupHintsFile.cc:116) Exception caught writing hints file /hypertable/tables/2/0/default/P7kY29TZuWPvewLB/hints - DFS BROKER permission denied 1391756705 ERROR Hypertable.RangeServer : (/root/src/hypertable/src/cc/Hypertable/RangeServer/AccessGroupHintsFile.cc:122) Problem writing hints file /hypertable/tables/2/0/default/P7kY29TZuWPvewLB/hints - DFS BROKER permission denied 1391756724 INFO Hypertable.RangeServer : (/root/src/hypertable/src/cc/Hypertable/RangeServer/AccessGroupHintsFile.cc:116) Exception caught writing hints file /hypertable/tables/2/0/default/P7kY29TZuWPvewLB/hints - DFS BROKER permission denied 1391756724 INFO Hypertable.RangeServer : (/root/src/hypertable/src/cc/Hypertable/RangeServer/AccessGroupHintsFile.cc:116) Exception caught writing hints file /hypertable/tables/2/0/default/P7kY29TZuWPvewLB/hints - DFS BROKER permission denied 1391756724 ERROR Hypertable.RangeServer : (/root/src/hypertable/src/cc/Hypertable/RangeServer/AccessGroupHintsFile.cc:122) Problem writing hints file /hypertable/tables/2/0/default/P7kY29TZuWPvewLB/hints - DFS BROKER permission denied root@www-dev:/opt/hypertable/0.9.7.15/log# cat DfsBroker.qfs.log | grep '/hypertable/tables/2/0/default/P7kY29TZuWPvewLB/hints' 1391756576 INFO qfsBroker : (/root/src/hypertable/src/cc/DfsBroker/qfs/QfsBroker.cc:269) create(/hypertable/tables/2/0/default/P7kY29TZuWPvewLB/hints) = 16 1391756576 INFO qfsBroker : (/root/src/hypertable/src/cc/DfsBroker/qfs/QfsBroker.cc:64) close(16) file: /hypertable/tables/2/0/default/P7kY29TZuWPvewLB/hints 1391756576 INFO qfsBroker : (/root/src/hypertable/src/cc/DfsBroker/qfs/QfsBroker.h:82) close( /hypertable/tables/2/0/default/P7kY29TZuWPvewLB/hints , 21 ) 1391756625 ERROR qfsBroker : (/root/src/hypertable/src/cc/DfsBroker/qfs/QfsBroker.cc:266) open(/hypertable/tables/2/0/default/P7kY29TZuWPvewLB/hints) failure (72) - Permission denied 13 1391756625 ERROR qfsBroker : (/root/src/hypertable/src/cc/DfsBroker/qfs/QfsBroker.cc:266) open(/hypertable/tables/2/0/default/P7kY29TZuWPvewLB/hints) failure (70) - Permission denied 13 1391756652 ERROR qfsBroker : (/root/src/hypertable/src/cc/DfsBroker/qfs/QfsBroker.cc:266) open(/hypertable/tables/2/0/default/P7kY29TZuWPvewLB/hints) failure (68) - Permission denied 13 1391756652 ERROR qfsBroker : (/root/src/hypertable/src/cc/DfsBroker/qfs/QfsBroker.cc:266) open(/hypertable/tables/2/0/default/P7kY29TZuWPvewLB/hints) failure (80) - Permission denied 13 1391756683 ERROR qfsBroker : (/root/src/hypertable/src/cc/DfsBroker/qfs/QfsBroker.cc:266) open(/hypertable/tables/2/0/default/P7kY29TZuWPvewLB/hints) failure (84) - Permission denied 13 1391756683 ERROR qfsBroker : (/root/src/hypertable/src/cc/DfsBroker/qfs/QfsBroker.cc:266) open(/hypertable/tables/2/0/default/P7kY29TZuWPvewLB/hints) failure (90) - Permission denied 13 1391756705 ERROR qfsBroker : (/root/src/hypertable/src/cc/DfsBroker/qfs/QfsBroker.cc:266) open(/hypertable/tables/2/0/default/P7kY29TZuWPvewLB/hints) failure (92) - Permission denied 13 1391756705 ERROR qfsBroker : (/root/src/hypertable/src/cc/DfsBroker/qfs/QfsBroker.cc:266) open(/hypertable/tables/2/0/default/P7kY29TZuWPvewLB/hints) failure (94) - Permission denied 13 1391756724 ERROR qfsBroker : (/root/src/hypertable/src/cc/DfsBroker/qfs/QfsBroker.cc:266) open(/hypertable/tables/2/0/default/P7kY29TZuWPvewLB/hints) failure (104) - Permission denied 13 1391756724 ERROR qfsBroker : (/root/src/hypertable/src/cc/DfsBroker/qfs/QfsBroker.cc:266) open(/hypertable/tables/2/0/default/P7kY29TZuWPvewLB/hints) failure (108) - Permission denied 13 root@www-dev:/opt/hypertable/0.9.7.15/log# Thanks, Kashirin Alex On Friday, February 7, 2014 8:52:04 AM UTC+2, Alex Kashirin wrote: > > There is a close of connections-handlers, > > 1391754021 INFO qfsBroker : > (/root/src/hypertable/src/cc/DfsBroker/Lib/OpenFileMap.h:88) Removing > handle 3 from open file map because of lost owning client connection > > follow is the RangeServer fs failures. > > the error happens just around the same time! > > > When does the OpenFileMap decide actually to remove the handler. > > > Thanks, > > Kashirin Alex > > > > > > > On Friday, February 7, 2014 12:59:21 AM UTC+2, Alex Kashirin wrote: >> >> FIXED, the FD's id assignment (now, it is with the std::map managed) >> >> NOW, What was the FIX for the permission denied Issue on the QFSBroker >> that was fix ? >> >> Current outputs: >> >> root@www-dev:/opt/hypertable/0.9.7.15/fs# du >> 4 ./local/hypertable/tables/2/1/default/qyoNKN5rd__dbHKv >> 8 ./local/hypertable/tables/2/1/default >> 12 ./local/hypertable/tables/2/1 >> 13540 ./local/hypertable/tables/2/0/default/qyoNKN5rd__dbHKv >> 8 ./local/hypertable/tables/2/0/default/nOkqBfmTLuX1NEv6 >> 13552 ./local/hypertable/tables/2/0/default >> 4 ./local/hypertable/tables/2/0/_xfer/nOkqBfmTLuX1NEv6/1391726922 >> 8 ./local/hypertable/tables/2/0/_xfer/nOkqBfmTLuX1NEv6 >> 12 ./local/hypertable/tables/2/0/_xfer >> 13568 ./local/hypertable/tables/2/0 >> 13584 ./local/hypertable/tables/2 >> 4 ./local/hypertable/tables/0/1/range/qyoNKN5rd__dbHKv >> 8 ./local/hypertable/tables/0/1/range >> 4 ./local/hypertable/tables/0/1/server/qyoNKN5rd__dbHKv >> 8 ./local/hypertable/tables/0/1/server >> 20 ./local/hypertable/tables/0/1 >> 4 ./local/hypertable/tables/0/0/default/qyoNKN5rd__dbHKv >> 4 ./local/hypertable/tables/0/0/default/4MmZEeUI1pJuk6SA >> 12 ./local/hypertable/tables/0/0/default >> 4 ./local/hypertable/tables/0/0/logging/qyoNKN5rd__dbHKv >> 4 ./local/hypertable/tables/0/0/logging/4MmZEeUI1pJuk6SA >> 12 ./local/hypertable/tables/0/0/logging >> 4 ./local/hypertable/tables/0/0/location/qyoNKN5rd__dbHKv >> 4 ./local/hypertable/tables/0/0/location/4MmZEeUI1pJuk6SA >> 12 ./local/hypertable/tables/0/0/location >> 40 ./local/hypertable/tables/0/0 >> 64 ./local/hypertable/tables/0 >> 13652 ./local/hypertable/tables >> 13656 ./local/hypertable >> 13660 ./local >> 13740 . >> root@www-dev:/opt/hypertable/0.9.7.15/fs# tail -n 17 >> ../log/DfsBroker.qfs.log >> 1391726923 INFO qfsBroker : >> (/root/src/hypertable/src/cc/DfsBroker/qfs/QfsBroker.h:82) close( >> /hypertable/tables/2/0/_xfer/nOkqBfmTLuX1NEv6/1391726922/0 , 23 ) >> 1391726924 INFO qfsBroker : >> (/root/src/hypertable/src/cc/DfsBroker/qfs/QfsBroker.cc:62) close(7) file: >> /hypertable/tables/2/0/default/qyoNKN5rd__dbHKv/cs4 >> 1391726928 INFO qfsBroker : >> (/root/src/hypertable/src/cc/DfsBroker/qfs/QfsBroker.h:82) close( >> /hypertable/tables/2/0/default/qyoNKN5rd__dbHKv/cs4 , 24 ) >> 1391726928 INFO qfsBroker : >> (/root/src/hypertable/src/cc/DfsBroker/qfs/QfsBroker.cc:171) >> open(/hypertable/tables/2/0/default/qyoNKN5rd__dbHKv/cs4) = 7 >> 1391726928 INFO qfsBroker : >> (/root/src/hypertable/src/cc/DfsBroker/qfs/QfsBroker.cc:62) close(6) file: >> /hypertable/tables/2/0/_xfer/nOkqBfmTLuX1NEv6/1391726922/0 >> 1391726928 INFO qfsBroker : >> (/root/src/hypertable/src/cc/DfsBroker/qfs/QfsBroker.cc:262) >> create(/hypertable/tables/2/0/default/nOkqBfmTLuX1NEv6/hints) = 6 >> 1391726928 INFO qfsBroker : >> (/root/src/hypertable/src/cc/DfsBroker/qfs/QfsBroker.cc:62) close(6) file: >> /hypertable/tables/2/0/default/nOkqBfmTLuX1NEv6/hints >> 1391726928 INFO qfsBroker : >> (/root/src/hypertable/src/cc/DfsBroker/qfs/QfsBroker.h:82) close( >> /hypertable/tables/2/0/default/nOkqBfmTLuX1NEv6/hints , 25 ) >> 1391726928 ERROR qfsBroker : >> (/root/src/hypertable/src/cc/DfsBroker/qfs/QfsBroker.cc:259) >> open(/hypertable/tables/2/0/default/qyoNKN5rd__dbHKv/hints) failure (15) - >> Permission denied 13 >> ERROR Permission denied 13 >> 1391726928 ERROR qfsBroker : >> (/root/src/hypertable/src/cc/DfsBroker/qfs/QfsBroker.cc:259) >> open(/hypertable/tables/2/0/default/qyoNKN5rd__dbHKv/hints) failure (18) - >> Permission denied 13 >> ERROR Permission denied 13 >> 1391726928 INFO qfsBroker : >> (/root/src/hypertable/src/cc/DfsBroker/qfs/QfsBroker.cc:171) >> open(/hypertable/tables/2/0/default/qyoNKN5rd__dbHKv/hints) = 6 >> 1391726928 INFO qfsBroker : >> (/root/src/hypertable/src/cc/DfsBroker/qfs/QfsBroker.h:82) close( >> /hypertable/tables/2/0/default/qyoNKN5rd__dbHKv/hints , 32 ) >> 1391726928 INFO qfsBroker : >> (/root/src/hypertable/src/cc/DfsBroker/qfs/QfsBroker.cc:62) close(6) file: >> /hypertable/tables/2/0/default/qyoNKN5rd__dbHKv/hints >> 1391726928 INFO qfsBroker : >> (/root/src/hypertable/src/cc/DfsBroker/qfs/QfsBroker.h:82) close( >> /hypertable/tables/2/0/default/qyoNKN5rd__dbHKv/hints , 34 ) >> 1391726928 INFO qfsBroker : >> (/root/src/hypertable/src/cc/DfsBroker/qfs/QfsBroker.cc:171) >> open(/hypertable/tables/2/0/default/qyoNKN5rd__dbHKv/cs4) = 6 >> root@www-dev:/opt/hypertable/0.9.7.15/fs# >> >> >> >> QfsShell> cd 0/default/qyoNKN5rd__dbHKv/ >> QfsShell> ls >> cs4 >> hints >> QfsShell> ls -l >> cs4 <r 3> rw-r--r-- root root 13857280 Feb 6 15:48 >> hints <r 3> rw-r--r-- root root 163 Feb 6 15:46 >> >> QfsShell> ls -l >> servers/ <dir> rwxr-xr-x root root 2682 Feb 6 15:44 >> tables/ <dir> rwxr-xr-x root root 13857732 Feb 6 15:44 >> >> >> >> root@www-dev:/opt/hypertable/ >> 0.9.7.15/fs/local/hypertable/tables/2/0/default/qyoNKN5rd__dbHKv# ls -l >> total 13536 >> -rw-r--r-- 1 root root 13857280 Feb 6 15:48 cs4 >> -rw-r--r-- 1 root root 0 Feb 6 15:48 hints >> >> Thanks, need help with the Permission Denied QFS issue! >> >> Kashirin Alex >> >> >> On Wednesday, February 5, 2014 3:26:20 AM UTC+2, Alex Kashirin wrote: >>> >>> Before I ruin the copy. >>> >>> This copy, >>> >>> m_open_file_map assigned with ID of pairs- while the ID-fd is an >>> generated num grow by 2 (eg. 1 as DFS 2 as local the connection resources >>> fd) >>> >>> still to work out a more proper ID to use, as might the loop is >>> out-breaking. >>> >>> on the request of fd, and it is RS-data , it's open_file_map is fd+1 >>> (the meta is the fd) >>> >>> the fd key , get assigned at open/create as well with file type. >>> >>> 1 > for Meta >>> >>> 2 > for RS-data(table) >>> >>> if(filePath == "Fsrv") fileType[USE_openFilesCount] = 1; >>> else fileType[USE_openFilesCount] = 2; >>> >>> USE_openFilesCount --- Is the key for file_map, while for the local >>> data it is the USE_openFilesCount+1 >>> >>> addr is the same for both new file_map >>> >>> >>> >>> Let me know, if you think there is an issue of such way around. >>> >>> By the way, with the key assigned for fd, it is a way around to manage >>> the number of open_file_descriptors on the system. >>> >>> >>> >>> Thanks, >>> >>> Kashirin Alex >>> >>> >>> >>> On Tuesday, February 4, 2014 8:11:03 AM UTC+2, Alex Kashirin wrote: >>>> >>>> the QFSbroker combined with local FS. >>>> >>>> m_open_file_map get assigned predefined IDs to store by. >>>> >>>> >>>> It's now a more better version, Doug you can just download it from the >>>> server , the log details on the older email. >>>> >>>> >>>> Thanks, >>>> >>>> Kashirin Alex >>>> >>>> >>>> >>>> >>>> On Monday, February 3, 2014 7:33:42 PM UTC+2, Alex Kashirin wrote: >>>>> >>>>> Why the localbroker use FileUtils and not Filesystem.h (the >>>>> FileSystem has close file descriptor while the FileUtils do not!) >>>>> >>>>> >>>>> the localBroker, might not closing the open file descriptors >>>>> >>>>> >>>>> Thanks, >>>>> >>>>> Kashirin Alex >>>>> >>>>> >>>>> >>>>> On Sunday, February 2, 2014 3:32:50 AM UTC+2, Alex Kashirin wrote: >>>>>> >>>>>> Will be good to have opinions on the built and run. >>>>>> >>>>>> cmake file needs to be updated. >>>>>> >>>>>> does not contain Java related. >>>>>> >>>>>> Thanks, >>>>>> >>>>>> Kashirin Alex >>>>>> >>>>>> >>>>>> -- You received this message because you are subscribed to the Google Groups "Hypertable Development" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/hypertable-dev. For more options, visit https://groups.google.com/groups/opt_out.
