Hi Karl,

Got it.
I'll spin up the RC1 just now.

Regards,
Mingchun

2014-08-15 19:26 GMT+09:00 Karl Wright <daddy...@gmail.com>:
> The ticket is CONNECTORS-1010, which I have fixed and pulled up a fix for
> 1.7 for.
>
> Mingchun, can you close this vote, and spin up an RC1 that we can vote on?
>
> Thanks!
> Karl
>
>
>
> On Fri, Aug 15, 2014 at 5:50 AM, Karl Wright <daddy...@gmail.com> wrote:
>
>> Hi Erlend,
>>
>> This is actually the result of a bug fix that was made in the 1.7 time
>> frame.  The problem actually arose in the first place in 1.5, when a lock
>> needed to go from being a critical section to a cross-process lock.  But,
>> due to an oversight, this was only fixed now.
>>
>> We can lock based on the uri's hash value; that's the only viable
>> solution.  File locking, though, will be removed in MCF 2.0 entirely, in
>> favor of Zookeeper.
>>
>> I'll open a ticket.
>>
>> Karl
>>
>>
>>
>> On Fri, Aug 15, 2014 at 4:11 AM, Erlend Garåsen <e.f.gara...@usit.uio.no>
>> wrote:
>>
>>>
>>> Another thing. It's not possible to abort the job due to this problem.
>>> LockManager still tries to set locks over and over again. It's not just the
>>> previous URL/filename I entered, but several others:
>>>
>>>  WARN 2014-08-15 10:07:46,178 (Worker thread '31') - Attempt to set file
>>> lock '/www/var/data/mcf/mcf-1/conf/../data/synchdir/664/756/lock-
>>> Solr&58!https&58!&47!&47!www.journals.uio.no&58!443&47!
>>> index.php&47!nordina&47!search&47!advancedResults?
>>> subject&61!Small%20group%20learning%2C%203rd%20graders%
>>> 2C%20learning%20of%20DC-circuit%20phenomena%2C%
>>> 20active%20and%20spontaneous%20learning.lock' failed: File name too long
>>>
>>> Erlend
>>>
>>>
>>> On 15.08.14 09:46, Erlend Garåsen wrote:
>>>
>>>>
>>>> -1
>>>>
>>>> All my first tests pass, but I think I found a blocker when I ran the
>>>> last one.
>>>>
>>>> By running MCF using FileLockManager, I'm getting the following error
>>>> and MCF just tries to run this task over and over again. My synch folder
>>>> now contains a lot of files and it still grows. I think MCF should
>>>> handle long URLs and just strip the length of the filename if it becomes
>>>> too large.
>>>>
>>>> INFO 2014-08-15 09:30:54,485 (Worker thread '9') - WEB: FETCH
>>>> URL|https://www.journals.uio.no/index.php/nordina/search/
>>>> advancedResults?subject=effective%20continuing%
>>>> 20professional%20development%2C%20authentic%20and%
>>>> 20entrepreneurial%20learning%2C%20science%20and%
>>>> 20technology%20education|1408087853848+633|200|15735|
>>>> <https://www.journals.uio.no/index.php/nordina/search/advancedResults?subject=effective%20continuing%20professional%20development%2C%20authentic%20and%20entrepreneurial%20learning%2C%20science%20and%20technology%20education%7C1408087853848+633%7C200%7C15735%7C>
>>>>
>>>>   WARN 2014-08-15 09:30:54,609 (Worker thread '9') - Attempt to set file
>>>> lock
>>>> '/www/var/data/mcf/mcf-1/conf/../data/synchdir/948/350/lock-
>>>> Solr&58!https&58!&47!&47!www.journals.uio.no&58!443&47!
>>>> index.php&47!nordina&47!search&47!advancedResults?subject&61!effective%
>>>> 20continuing%20professional%20development%2C%20authentic%
>>>> 20and%20entrepreneurial%20learning%2C%20science%20and%
>>>> 20technology%20education.lock'
>>>> failed: File name too long
>>>> java.io.IOException: File name too long
>>>>      at java.io.UnixFileSystem.createFileExclusively(Native Method)
>>>>      at java.io.File.createNewFile(File.java:947)
>>>>      at
>>>> org.apache.manifoldcf.core.lockmanager.FileLockObject.
>>>> grabFileLock(FileLockObject.java:221)
>>>>
>>>>      at
>>>> org.apache.manifoldcf.core.lockmanager.FileLockObject.
>>>> obtainGlobalWriteLockNoWait(FileLockObject.java:77)
>>>>
>>>>      at
>>>> org.apache.manifoldcf.core.lockmanager.LockObject.obtainGlobalWriteLock(
>>>> LockObject.java:121)
>>>>
>>>>      at
>>>> org.apache.manifoldcf.core.lockmanager.LockObject.
>>>> enterWriteLock(LockObject.java:74)
>>>>
>>>>      at
>>>> org.apache.manifoldcf.core.lockmanager.LockGate.
>>>> enterWriteLock(LockGate.java:177)
>>>>
>>>>      at
>>>> org.apache.manifoldcf.core.lockmanager.BaseLockManager.
>>>> enter(BaseLockManager.java:1473)
>>>>
>>>>      at
>>>> org.apache.manifoldcf.core.lockmanager.BaseLockManager.
>>>> enterLocks(BaseLockManager.java:803)
>>>>
>>>>      at
>>>> org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester$
>>>> OutputAddEntryPoint.addOrReplaceDocumentWithExcept
>>>> ion(IncrementalIngester.java:3329)
>>>>
>>>>      at
>>>> org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester$
>>>> PipelineAddFanout.sendDocument(IncrementalIngester.java:3051)
>>>>
>>>>
>>>>
>>>>
>>>> On 12.08.14 05:13, Mingchun Zhao wrote:
>>>>
>>>>> Hi all,
>>>>>
>>>>> Please vote on whether to release the ManifoldCF, version 1.7, RC0.
>>>>>
>>>>> You can find the artifact at:
>>>>>
>>>>> http://people.apache.org/~mingchun/apache-manifoldcf-1.7-RC0
>>>>>
>>>>> There is also a tag at:
>>>>>
>>>>> https://svn.apache.org/repos/asf/manifoldcf/tags/release-1.7-RC0
>>>>>
>>>>> Vote will remain open at least 72 hours.
>>>>>
>>>>> Thanks!
>>>>> Mingchun Zhao
>>>>>
>>>>>
>>>>
>>>
>>

Reply via email to