[ 
https://issues.apache.org/jira/browse/NUTCH-2455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18131871#comment-18131871
 ] 

ASF GitHub Bot commented on NUTCH-2455:
---------------------------------------

github-actions[bot] commented on PR #888:
URL: https://github.com/apache/nutch/pull/888#issuecomment-6398770347

   ## Apache Yetus test-patch report
   
   |            |
   |------------|
   | -1 overall |
   
   |      |            |         |                                              
         |                                                                      
                                                                   |
   
|------|------------|---------|-------------------------------------------------------|-----------------------------------------------------------------------------------------------------------------------------------------|
   | Vote | Subsystem  | Runtime | Log                                          
         | Comment                                                              
                                                                   |
   |      |            |         |                                              
         | Prechecks                                                            
                                                                   |
   | +1   | dupname    | 0m 0s   |                                              
         | No case conflicting files found.                                     
                                                                   |
   | +1   | @author    | 0m 0s   |                                              
         | The patch does not contain any @author tags.                         
                                                                   |
   |      |            |         |                                              
         | master Compile Tests                                                 
                                                                   |
   | +1   | javadoc    | 0m 0s   |                                              
         | master passed                                                        
                                                                   |
   | -0   | patch      | 0m 32s  |                                              
         | Used diff version of patch file. Binary files and potentially other 
changes not applied. Please rebase and squash commits if necessary. |
   |      |            |         |                                              
         | Patch Compile Tests                                                  
                                                                   |
   | -1   | codespell  | 0m 3s   | 
[/results-codespell.txt](/results-codespell.txt)\</\> | The patch generated 2 
new + 0 unchanged - 0 fixed = 2 total (was 0)                                   
                                  |
   | +1   | detsecrets | 1m 7s   |                                              
         | No new issues.                                                       
                                                                   |
   | -1   | blanks     | 0m 0s   | [/blanks-eol.txt](/blanks-eol.txt)\</\>      
         | The patch has 46 line(s) that end in blanks. Use git apply 
--whitespace=fix \<\>. Refer https://git-scm.com/docs/git-apply              |
   | +1   | javadoc    | 0m 0s   |                                              
         | the patch passed                                                     
                                                                   |
   |      |            |         |                                              
         | Other Tests                                                          
                                                                   |
   | +1   | asflicense | 0m 2s   |                                              
         | The patch does not generate ASF License warnings.                    
                                                                   |
   |      |            | 1m 25s  |                                              
         |                                                                      
                                                                   |
   
   |                |                                                           
                                                       |
   
|----------------|------------------------------------------------------------------------------------------------------------------|
   | Subsystem      | Report/Notes                                              
                                                       |
   | GITHUB PR      | https://github.com/apache/nutch/pull/888                  
                                                       |
   | Optional Tests | dupname asflicense codespell detsecrets javac javadoc     
                                                       |
   | uname          | Linux d062d9582e5e 6.17.0-1022-azure \#22-Ubuntu SMP Mon 
Jul 27 17:24:03 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux |
   | Build tool     | nobuild                                                   
                                                       |
   | Personality    | /github/workspace/.yetus/personality.sh                   
                                                       |
   | git revision   | master / ee6eecd68ff52a81b6ae5dfd669d02d74d09d6c4         
                                                       |
   | Default Java   | Ubuntu-11.0.26+4-post-Ubuntu-1ubuntu122.04                
                                                       |
   | modules        | C: . U: .                                                 
                                                       |
   | versions       | git=2.34.1 codespell=2.4.1 detsecrets=1.5.0               
                                                       |
   | Powered by     | Apache Yetus 0.15.1 https://yetus.apache.org              
                                                       |
   
   This message was automatically generated.
   
   <!

> Use secondary sorting for memory-efficient HostDb integration in Generator
> --------------------------------------------------------------------------
>
>                 Key: NUTCH-2455
>                 URL: https://issues.apache.org/jira/browse/NUTCH-2455
>             Project: Nutch
>          Issue Type: Improvement
>          Components: generator
>    Affects Versions: 1.13
>            Reporter: Markus Jelsma
>            Assignee: Lewis John McGibbney
>            Priority: Major
>             Fix For: 1.24
>
>         Attachments: NUTCH-2455.patch
>
>
> Citing Sebastian at NUTCH-2420:
> ??The correct solution would be to use <host,score> pairs as keys in the 
> Selector job, with a partitioner and secondary sorting so that all keys with 
> same host end up in the same call of the reducer. If values can also hold a 
> HostDb entry and the sort comparator guarantees that the HostDb entry 
> (entries if partitioned by domain or IP) comes in front of all CrawlDb 
> entries. But that would be a substantial improvement...??



--
This message was sent by Atlassian Jira
(v10.3.26#10030026)

Reply via email to