Karl,
The following is reported in my solr logs (with some sanitisation of data).
The CIFS extract request to SOLR has the allow_token_document fields populated
but these fields don’t exist in the JIRA extract request.
I’m not sure what might be missing, both are using the same output connection
and security group.
CIFS EXTRACT
webapp=/solr path=/update/extract
params={literal.lastModified=Wed+Mar+29+14:01:20+AEDT+2017
&literal.source=\\server\archive
&literal.allow_token_document=LinkGroup:S-1-1-0
&literal.allow_token_document=LinkGroup:S-1-5-21-????????????????????????????????????????
&literal.allow_token_document=LinkGroup:S-1-5-21-????????????????????????????????????????
&literal.allow_token_document=LinkGroup:S-1-5-21-????????????????????????????????????????
&literal.allow_token_document=LinkGroup:S-1-5-21-????????????????????????????????????????
&literal.createdOn=Fri+Mar+31+07:49:14+AEDT+2017
&commitWithin=5000
&resource.name= filename.xml
&literal.id=file://///server/ archive/2017/03/29/filename.xml
&literal.fileLastModified=2017-03-29T03:01:20.769Z
&version=2.2
&literal.fileCreatedOn=2017-03-30T20:49:14.164Z
&literal.deny_token_document=LinkGroup:DEAD_AUTHORITY
&literal.attributes=32
&literal.shareName= archive
&ignoreTikaException=true
&literal.last_modified_alt=2017-03-29T03:01:20.769Z
&wt=xml}{add=[file://///server/archive/ 2017/03/29/filename.xml
(1591510847001198592)]} 0 46
JIRA EXTRACT
webapp=/solr path=/update/extract
params={literal.project_avatarUrls_32x32=http://jira/secure/projectavatar?size%3Dmedium%26pid%3D10086%26avatarId%3D10137
&literal.assignee_timeZone=Australia/Sydney
&literal.customfield_12030_name=CUSTOMFIELDVALUE
&literal.customfield_10533_id=10743
&literal.customfield_10433_self=http://jira/rest/api/2/customFieldOption/10645
&literal.reporter_avatarUrls_48x48=http://jira/secure/useravatar?avatarId%3D10200
&literal.issuetype_subtask=true
&literal.attachment_author_displayName=Username
&literal.attachment_author_displayName=Username
&literal.creator_avatarUrls_16x16=http://jira/secure/useravatar?size%3Dxsmall%26avatarId%3D10200
&literal.resolution_id=1
&literal.parent_fields_status_name=Closed
&literal.issuetype_description=User+Acceptance+Testing
&literal.customfield_10533_self=http://jira/rest/api/2/customFieldOption/10743
&literal.customfield_10433_id=10645
&literal.watches_self=http://jira/rest/api/2/issue/REQ-1174/watchers
&literal.status_statusCategory_self=http://jira/rest/api/2/statuscategory/3
&literal.comment_maxResults=0
&literal.summary=ClassificationOfSummary
&literal.parent_fields_priority_id=4
&literal.priority_id=4
&literal.attachment_thumbnail=http://jira/secure/thumbnail/79798/_thumb_79798.png
&literal.attachment_thumbnail=http://jira/secure/thumbnail/78645/_thumb_78645.png
&literal.key=REQ-1174
&literal.parent_key=REQ-936
&literal.creator_active=true
&literal.status_statusCategory_key=done
&version=2.2
&literal.priority_self=http://jira/rest/api/2/priority/4
&literal.parent_fields_issuetype_name=Task
&[email protected]
&[email protected]
&literal.parent_fields_issuetype_subtask=false
&literal.project_projectCategory_name=BITS
&literal.customfield_10632=You+must+also+update+the+Proposed/Assigned+Release+for+any+linked+issues%0d%0a%0d%0a+
&literal.parent_fields_priority_name=P3
&literal.customfield_12030_id=96
&literal.parent_fields_summary=SUMMARY FIELD PARENT
&literal.attachment_author_avatarUrls_24x24=http://jira/secure/useravatar?size%3Dsmall%26avatarId%3D10200
&literal.attachment_author_avatarUrls_24x24=http://jira/secure/useravatar?size%3Dsmall%26avatarId%3D10200
&literal.resolution_description=The+issue+was+succesfully+completed+or+fixed
&literal.id=http://jira/browse/REQ-1174
&literal.reporter_timeZone=Australia/Sydney
&literal.customfield_10177_avatarUrls_24x24=http://jira/secure/useravatar?size%3Dsmall%26avatarId%3D10200
&literal.parent_fields_status_statusCategory_id=3
&literal.customfield_12730=0|i04szb:
&literal.worklog_startAt=0
&literal.project_id=10086
&literal.webUrl=http://jira/browse/REQ-1174
&literal.priority_iconUrl=http://jira/images/icons/priorities/jira.P3.jpg
&literal.assignee_active=true
&literal.reporter_self=http://jira/rest/api/2/user?username%3Duserid
&[email protected]
&literal.status_id=6
&literal.parent_fields_status_statusCategory_key=done
&literal.aggregateprogress_progress=0
&literal.parent_fields_status_self=http://jira/rest/api/2/status/6
&literal.project_key=REQ
&literal.parent_fields_status_description=The+issue+is+considered+finished,+work+is+complete+and+changes+have+been+released.
&ignoreTikaException=true
&literal.creator_name=userid
&literal.priority_name=P3
&literal.customfield_11231=CUSTOMFIELD
&literal.parent_fields_status_id=6
&literal.customfield_10177_avatarUrls_16x16=http://jira/secure/useravatar?size%3Dxsmall%26avatarId%3D10200
&literal.customfield_10533_value=EPO
&literal.reporter_avatarUrls_24x24=http://jira/secure/useravatar?size%3Dsmall%26avatarId%3D10200
&literal.project_projectCategory_description=Business+and+IT+Shared+Project
&literal.attachment_author_avatarUrls_16x16=http://jira/secure/useravatar?size%3Dxsmall%26avatarId%3D10200
&literal.attachment_author_avatarUrls_16x16=http://jira/secure/useravatar?size%3Dxsmall%26avatarId%3D10200
&literal.reporter_active=true
&literal.issuetype_id=48
&literal.assignee_displayName=Username
&literal.status_iconUrl=http://jira/images/icons/statuses/closed.png
&literal.status_description=The+issue+is+considered+finished,+work+is+complete+and+changes+have+been+released.
&literal.parent_id=58726
&literal.updated=2013-08-23T11:43:39.000%2B1000
&literal.reporter_avatarUrls_32x32=http://jira/secure/useravatar?size%3Dmedium%26avatarId%3D10200
&literal.parent_fields_priority_self=http://jira/rest/api/2/priority/4
&literal.project_projectCategory_self=http://jira/rest/api/2/projectCategory/10112
&literal.comment_total=0
&literal.creator_displayName=Username
&literal.attachment_self=http://jira/rest/api/2/attachment/79798
&literal.attachment_self=http://jira/rest/api/2/attachment/78645
&literal.issuetype_self=http://jira/rest/api/2/issuetype/48
&literal.issuetype_iconUrl=http://jira/secure/viewavatar?size%3Dxsmall%26avatarId%3D15516%26avatarType%3Dissuetype
&literal.parent_fields_issuetype_avatarId=15518
&literal.customfield_10297=29/02/2011:+Data+Integrity+team+to+check+100%25+of+Investment+Switch+transactions
&literal.attachment_author_self=http://jira/rest/api/2/user?username%3Duserid
&literal.attachment_author_self=http://jira/rest/api/2/user?username%3Duserid
&literal.reporter_avatarUrls_16x16=http://jira/secure/useravatar?size%3Dxsmall%26avatarId%3D10200
&literal.parent_fields_issuetype_id=3
&literal.customfield_10299=18/01/2011+-+CustomFeild
&literal.attachment_author_key=userid
&literal.attachment_author_key=userid
&literal.attachment_size=177209
&literal.attachment_size=143348
&literal.reporter_name=userid
&literal.assignee_self=http://jira/rest/api/2/user?username%3Duserid
&literal.attachment_mimeType=image/jpeg
&literal.attachment_mimeType=image/jpeg
&literal.resolution_name=Completed
&literal.customfield_10177_avatarUrls_32x32=http://jira/secure/useravatar?size%3Dmedium%26avatarId%3D10200
&literal.attachment_id=79798
&literal.attachment_id=78645
&literal.parent_fields_status_statusCategory_name=Done
&literal.attachment_created=2013-08-23T11:43:12.000%2B1000
&literal.attachment_created=2013-08-19T15:08:40.000%2B1000
&literal.creator_avatarUrls_48x48=http://jira/secure/useravatar?avatarId%3D10200
&literal.customfield_10843=Awaiting+input
&literal.creator_self=http://jira/rest/api/2/user?username%3Duserid
&literal.customfield_10846=0.0
&literal.assignee_avatarUrls_32x32=http://jira/secure/useravatar?size%3Dmedium%26avatarId%3D10200
&literal.reporter_displayName=Username
&literal.watches_watchCount=1
&literal.attachment_author_avatarUrls_48x48=http://jira/secure/useravatar?avatarId%3D10200
&literal.attachment_author_avatarUrls_48x48=http://jira/secure/useravatar?avatarId%3D10200
&literal.source=http://jira
&literal.status_statusCategory_id=3
&literal.customfield_10177_avatarUrls_48x48=http://jira/secure/useravatar?avatarId%3D10200
&literal.customfield_10433_value=No
&literal.watches_isWatching=false
&literal.attachment_content=http://jira/secure/attachment/79798/No%2Bissue.jpg
&literal.attachment_content=http://jira/secure/attachment/78645/screenshot-1.jpg
&literal.parent_fields_status_iconUrl=http://jira/images/icons/statuses/closed.png
&literal.project_name=Requirements+Team
&literal.aggregateprogress_total=0
&literal.parent_self=http://jira/rest/api/2/issue/58726
&literal.attachment_author_timeZone=Australia/Sydney
&literal.attachment_author_timeZone=Australia/Sydney
&literal.resolution_self=http://jira/rest/api/2/resolution/1
&literal.resolutiondate=2013-08-23T11:43:39.000%2B1000
&literal.customfield_10177_timeZone=Australia/Sydney
&literal.status_self=http://jira/rest/api/2/status/6
&literal.attachment_author_avatarUrls_32x32=http://jira/secure/useravatar?size%3Dmedium%26avatarId%3D10200
&literal.attachment_author_avatarUrls_32x32=http://jira/secure/useravatar?size%3Dmedium%26avatarId%3D10200
&literal.progress_total=0
&literal.customfield_10177_active=true
&literal.customfield_10177_name=userid
&literal.self=http://jira/rest/api/2/issue/61034
&literal.comment_startAt=0
&literal.project_projectCategory_id=10112
&literal.customfield_12030_self=http://jira/rest/tempo-accounts/1/account/96
&literal.customfield_10177_displayName=Username
&[email protected]
&literal.customfield_10472= custmofield
&literal.parent_fields_issuetype_iconUrl=http://jira/secure/viewavatar?size%3Dxsmall%26avatarId%3D15518%26avatarType%3Dissuetype
&resource.name=docname
&literal.parent_fields_issuetype_description=A+task+that+needs+to+be+done.
&literal.issuetype_name=UAT
&literal.attachment_author_name=userid
&literal.attachment_author_name=userid
&[email protected]
&literal.assignee_name=userid
&literal.assignee_avatarUrls_48x48=http://jira/secure/useravatar?avatarId%3D10200
&literal.progress_progress=0
&literal.customfield_10177_key=userid
&literal.status_statusCategory_colorName=green
&literal.worklog_maxResults=20
&literal.project_avatarUrls_48x48=http://jira/secure/projectavatar?pid%3D10086%26avatarId%3D10137
&literal.worklog_total=0
&literal.workratio=-1
&literal.customfield_10467=<i>Click+on+Edit+to+add+or+update+Investigation+results.</i>
&literal.creator_key=userid
&literal.parent_fields_status_statusCategory_self=http://jira/rest/api/2/statuscategory/3
&literal.project_avatarUrls_16x16=http://jira/secure/projectavatar?size%3Dxsmall%26pid%3D10086%26avatarId%3D10137
&wt=xml
&[email protected]
&literal.customfield_10461=<i>Click+on+Edit+to+add+or+update+Requirements.</i>
&literal.customfield_10462=<i>Click+on+Edit+to+add+or+update+Specifications.</i>
&commitWithin=5000
&literal.customfield_10463=<i>Click+on+Edit+to+add+or+update+Development+details.</i>
&literal.reporter_key=userid
&literal.created=2013-08-19T15:08:17.000%2B1000
&literal.customfield_12030_key=EPO020003
&literal.customfield_10464=<i>Click+on+Edit+to+add+or+update+Testing+details.</i>
&literal.status_statusCategory_name=Done
&literal.attachment_author_active=true
&literal.attachment_author_active=true
&literal.creator_avatarUrls_32x32=http://jira/secure/useravatar?size%3Dmedium%26avatarId%3D10200
&literal.assignee_avatarUrls_24x24=http://jira/secure/useravatar?size%3Dsmall%26avatarId%3D10200
&literal.project_self=http://jira/rest/api/2/project/10086
&literal.attachment_filename=No+issue.jpg
&literal.attachment_filename=screenshot-1.jpg
&literal.parent_fields_status_statusCategory_colorName=green
&literal.creator_timeZone=Australia/Sydney
&literal.status_name=Closed
&literal.project_avatarUrls_24x24=http://jira/secure/projectavatar?size%3Dsmall%26pid%3D10086%26avatarId%3D10137
&literal.issuetype_avatarId=15516
&literal.customfield_10455= customfield_10455_VALUE
&literal.assignee_avatarUrls_16x16=http://jira/secure/useravatar?size%3Dxsmall%26avatarId%3D10200
&literal.customfield_10177_self=http://jira/rest/api/2/user?username%3Duserid
&literal.creator_avatarUrls_24x24=http://jira/secure/useravatar?size%3Dsmall%26avatarId%3D10200
&literal.assignee_key= assignee_key_VALUE
&literal.parent_fields_issuetype_self=http://jira/rest/api/2/issuetype/3
&literal.parent_fields_priority_iconUrl=http://jira/images/icons/priorities/jira.P3.jpg}{add=[http://jira/browse/REQ-1174
(1591236990137794560)]} 0 9
Regards
Damien Collis
Team Leader – Systems Integration
Link Group
• Level 4, 1A Homebush Bay Drive, Rhodes NSW 2138
• Email: [email protected]<mailto:[email protected]>
• Ph: +61 2 8571 5616
From: Karl Wright [mailto:[email protected]]
Sent: Friday, 2 February 2018 5:24 PM
To: [email protected]
Subject: Re: How to extract JIRA authorities
All looks good; the token qualification should always take place in the output
connection in any case.
So it looks like all the code is there and seems to be doing reasonable stuff.
The only question is whether you've got forced acls configured or not.
Karl
On Fri, Feb 2, 2018 at 1:18 AM, Karl Wright
<[email protected]<mailto:[email protected]>> wrote:
Hi Damien,
The JIRA connector fetches users from JIRA and converts them to acls:
>>>>>>
if (acls == null) {
// Get acls from issue
List<String> users = getUsers(issueID);
aclsToUse = (String[])users.toArray(new String[0]);
java.util.Arrays.sort(aclsToUse);
} else {
aclsToUse = acls;
}
<<<<<<
and
>>>>>>
// Turn into acls and add into description
String[] denyAclsToUse;
if (aclsToUse.length > 0)
denyAclsToUse = new String[]{defaultAuthorityDenyToken};
else
denyAclsToUse = new String[0];
rd.setSecurity(RepositoryDocument.SECURITY_TYPE_DOCUMENT,aclsToUse,denyAclsToUse);
<<<<<<
This only happens if you don't have any "forced" acls set in the job
specification (which would be set on the "Security" tab for the job), so be
sure nothing is set there.
The only thing I don't see here is whether the user names so fetched are
properly qualified with the relevant authority group. That's also essential
for this to work and I'll check that next. But in any case you should see
tokens indexed -- if not I'd look at your output connection and/or your index
configuration. If this is Solr you should see log info messages that include
the tokens with every document.
Karl
On Fri, Feb 2, 2018 at 1:08 AM, Karl Wright
<[email protected]<mailto:[email protected]>> wrote:
Hi Damien,
First, let me understand the problem. You say you are seeing no authorization
tokens being indexed at all, correct? It sounds like you have the authority
side configured properly. You have confirmed that you are getting authority
tokens back that you expect, it sounds like. So the fact that there is
(apparently) missing documentation for the Jira authority is not a problem for
you at this time.
I'll have a look at the JIRA repository connector code to see how/where it sets
authorization tokens and get back to you.
Karl
On Fri, Feb 2, 2018 at 12:48 AM, Damien Collis
<[email protected]<mailto:[email protected]>> wrote:
Hi User Group,
I am successfully indexing a JIRA server with Manifoldcf 2.9.1 and Solr 7.1.0.
However I am unable to correctly configure the JIRA authorities.
I have successfully configured a JIRA Authority Connection associated with an
Authority Group
I have successfully configured a User Mapping Connection to append the domain
to the simple JIRA username.
I have tested the configuration with the
http://manifoldcf/mcf-combined-service-2.9/[email protected]<https://urldefense.proofpoint.com/v2/url?u=http-3A__manifoldcf_mcf-2Dcombined-2Dservice-2D2.9_UserACLs-3Fusername-3Dusername-40domain.corp&d=DwMFaQ&c=EyrAshB9xIzcegaT9SDe6g&r=Gn5yxeb6W9ERepUyEmssft7I4Tobgyxsu0tR69ePkS8&m=QxJ-vBmm1kSCKDbEOa5bB3YY5vE4EfOOGJfVZtRqDt4&s=35OX9fn6tOOBUdPQnFW0TMJdsTaFL4j4UKwB-kgXZ5g&e=>
and receive:
AUTHORIZED:Jira
TOKEN:LinkGroup:collida
But I am not seeing any evidence of the authority values being extracted and
passed to solr upon crawling.
The documentation states… “This repository connection type is meant to secure
documents in conjunction with the Jira Authority Connection type. Please read
the associated documentation to configure document security.”
But I am unsure where to find the “associated documentation”.
BTW, I have successfully extracted Authorities for a CIFS extraction (thanks to
your responses from an earlier post)
Any assistance would be highly appreciated.
Regards
Damien Collis
Team Leader – Systems Integration
Link Group
• Level 4, 1A Homebush Bay Drive, Rhodes NSW
2138<https://urldefense.proofpoint.com/v2/url?u=https-3A__maps.google.com_-3Fq-3D1A-2BHomebush-2BBay-2BDrive-2C-2BRhodes-2BNSW-2B2138-26entry-3Dgmail-26source-3Dg&d=DwMFaQ&c=EyrAshB9xIzcegaT9SDe6g&r=Gn5yxeb6W9ERepUyEmssft7I4Tobgyxsu0tR69ePkS8&m=QxJ-vBmm1kSCKDbEOa5bB3YY5vE4EfOOGJfVZtRqDt4&s=6GBjacuLLINqbXdU2WpzxIkq7v2AViwakLS-luVCb1U&e=>
• Email: [email protected]<mailto:[email protected]>
• Ph: +61 2 8571 5616<tel:+61%202%208571%205616>
