[jira] [Commented] (CONNECTORS-1564) Support preemptive authentication to Solr connector
[
https://issues.apache.org/jira/browse/CONNECTORS-1564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16757624#comment-16757624
]
Michael Osipov commented on CONNECTORS-1564:
Sounds fine to me.
> Support preemptive authentication to Solr connector
> ---
>
> Key: CONNECTORS-1564
> URL: https://issues.apache.org/jira/browse/CONNECTORS-1564
> Project: ManifoldCF
> Issue Type: Improvement
> Components: Lucene/SOLR connector
>Reporter: Erlend Garåsen
>Assignee: Karl Wright
>Priority: Major
> Attachments: CONNECTORS-1564.patch
>
>
> We should post preemptively in case the Solr server requires basic
> authentication. This will make the communication between ManifoldCF and Solr
> much more effective instead of the following:
> * Send a HTTP POST request to Solr
> * Solr sends a 401 response
> * Send the same request, but with a "{{Authorization: Basic}}" header
> With preemptive authentication, we can send the header in the first request.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (CONNECTORS-1564) Support preemptive authentication to Solr connector
[
https://issues.apache.org/jira/browse/CONNECTORS-1564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16757517#comment-16757517
]
Karl Wright commented on CONNECTORS-1564:
-
[~michael-o], we have zero control over whether/when this gets addressed in
SolrJ. Previous interactions with the SolrJ developers do not make me feel
like a fix would likely be a prompt one. But I suggest that [~erlendfg] at
least take the step of opening a ticket.
We can afford to wait until the next MCF release is imminent before taking any
action, but if there's no resolution in sight then, I think we should implement
the workaround for the time being.
> Support preemptive authentication to Solr connector
> ---
>
> Key: CONNECTORS-1564
> URL: https://issues.apache.org/jira/browse/CONNECTORS-1564
> Project: ManifoldCF
> Issue Type: Improvement
> Components: Lucene/SOLR connector
>Reporter: Erlend Garåsen
>Assignee: Karl Wright
>Priority: Major
> Attachments: CONNECTORS-1564.patch
>
>
> We should post preemptively in case the Solr server requires basic
> authentication. This will make the communication between ManifoldCF and Solr
> much more effective instead of the following:
> * Send a HTTP POST request to Solr
> * Solr sends a 401 response
> * Send the same request, but with a "{{Authorization: Basic}}" header
> With preemptive authentication, we can send the header in the first request.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Comment Edited] (CONNECTORS-1564) Support preemptive authentication to Solr connector
[
https://issues.apache.org/jira/browse/CONNECTORS-1564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16757159#comment-16757159
]
Michael Osipov edited comment on CONNECTORS-1564 at 1/31/19 1:58 PM:
-
[~kwri...@metacarta.com], I'd to see this fixed in SolrJ rather than a
workaround by you.
was (Author: michael-o):
[~kwri...@metacarta.com], I'd rather see this fixed in SolrJ rather than a
workaround by you.
> Support preemptive authentication to Solr connector
> ---
>
> Key: CONNECTORS-1564
> URL: https://issues.apache.org/jira/browse/CONNECTORS-1564
> Project: ManifoldCF
> Issue Type: Improvement
> Components: Lucene/SOLR connector
>Reporter: Erlend Garåsen
>Assignee: Karl Wright
>Priority: Major
> Attachments: CONNECTORS-1564.patch
>
>
> We should post preemptively in case the Solr server requires basic
> authentication. This will make the communication between ManifoldCF and Solr
> much more effective instead of the following:
> * Send a HTTP POST request to Solr
> * Solr sends a 401 response
> * Send the same request, but with a "{{Authorization: Basic}}" header
> With preemptive authentication, we can send the header in the first request.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Comment Edited] (CONNECTORS-1564) Support preemptive authentication to Solr connector
[
https://issues.apache.org/jira/browse/CONNECTORS-1564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16757159#comment-16757159
]
Michael Osipov edited comment on CONNECTORS-1564 at 1/31/19 1:59 PM:
-
[~kwri...@metacarta.com], I'd to see this fixed in SolrJ rather than by a
workaround.
was (Author: michael-o):
[~kwri...@metacarta.com], I'd to see this fixed in SolrJ rather than a
workaround by you.
> Support preemptive authentication to Solr connector
> ---
>
> Key: CONNECTORS-1564
> URL: https://issues.apache.org/jira/browse/CONNECTORS-1564
> Project: ManifoldCF
> Issue Type: Improvement
> Components: Lucene/SOLR connector
>Reporter: Erlend Garåsen
>Assignee: Karl Wright
>Priority: Major
> Attachments: CONNECTORS-1564.patch
>
>
> We should post preemptively in case the Solr server requires basic
> authentication. This will make the communication between ManifoldCF and Solr
> much more effective instead of the following:
> * Send a HTTP POST request to Solr
> * Solr sends a 401 response
> * Send the same request, but with a "{{Authorization: Basic}}" header
> With preemptive authentication, we can send the header in the first request.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (CONNECTORS-1578) GSOC: Azure Storage Repository Connector
Piergiorgio Lucidi created CONNECTORS-1578: -- Summary: GSOC: Azure Storage Repository Connector Key: CONNECTORS-1578 URL: https://issues.apache.org/jira/browse/CONNECTORS-1578 Project: ManifoldCF Issue Type: New Feature Components: Azure Storage Repository Connector Reporter: Piergiorgio Lucidi Assignee: Piergiorgio Lucidi This is a project idea for [Google Summer of Code|https://summerofcode.withgoogle.com/] (GSOC). To discuss this or other ideas with your potential mentor from the Apache ManifoldCF project, sign up and post to the dev@manifoldcf.apache.org list, including "[GSOC]" in the subject. You may also comment on this Jira issue if you have created an account. We would like to extend the Content Indexing and Migration capabilities adding Azure Storage as a new repository connector for reading and indexing contents from one or more repositories supported by ManifoldCF. In this way we will help users on indexing and migrating contents from different data sources from Azure Storage. You will be involved in the development of the following tasks, you will learn how to: * Write the connector implementation * Implement unit tests * Build all the integration tests for testing the connector inside the framework * Write the documentation for this connector You will find a technical description about all the references to the Azure Java SDK on an existing issue on our JIRA: https://issues.apache.org/jira/browse/CONNECTORS-1577 We have a complete documentation on how to implement a Repository Connector: [http://manifoldcf.apache.org/release/release-2.12/en_US/writing-repository-connectors.html] Take a look at our book to understand better the framework and how to implement connectors: [https://github.com/DaddyWri/manifoldcfinaction/tree/master/pdfs] Prospective GSOC mentor: [piergior...@apache.org|mailto:piergior...@apache.org] -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (CONNECTORS-1564) Support preemptive authentication to Solr connector
[
https://issues.apache.org/jira/browse/CONNECTORS-1564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16757159#comment-16757159
]
Michael Osipov commented on CONNECTORS-1564:
[~kwri...@metacarta.com], I'd rather see this fixed in SolrJ rather than a
workaround by you.
> Support preemptive authentication to Solr connector
> ---
>
> Key: CONNECTORS-1564
> URL: https://issues.apache.org/jira/browse/CONNECTORS-1564
> Project: ManifoldCF
> Issue Type: Improvement
> Components: Lucene/SOLR connector
>Reporter: Erlend Garåsen
>Assignee: Karl Wright
>Priority: Major
> Attachments: CONNECTORS-1564.patch
>
>
> We should post preemptively in case the Solr server requires basic
> authentication. This will make the communication between ManifoldCF and Solr
> much more effective instead of the following:
> * Send a HTTP POST request to Solr
> * Solr sends a 401 response
> * Send the same request, but with a "{{Authorization: Basic}}" header
> With preemptive authentication, we can send the header in the first request.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (CONNECTORS-1564) Support preemptive authentication to Solr connector
[
https://issues.apache.org/jira/browse/CONNECTORS-1564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16757156#comment-16757156
]
Erlend Garåsen commented on CONNECTORS-1564:
Karl, some suggestions:
* I create a new ticket or rename this one (since this one is about preemptive
auth)
* I create a PR (eventually a patch — just have to check that my Apache
account still works)
* I'll start a thread about this by sending an email to the Solr list
I have already informed a Solr committer about the case.
> Support preemptive authentication to Solr connector
> ---
>
> Key: CONNECTORS-1564
> URL: https://issues.apache.org/jira/browse/CONNECTORS-1564
> Project: ManifoldCF
> Issue Type: Improvement
> Components: Lucene/SOLR connector
>Reporter: Erlend Garåsen
>Assignee: Karl Wright
>Priority: Major
> Attachments: CONNECTORS-1564.patch
>
>
> We should post preemptively in case the Solr server requires basic
> authentication. This will make the communication between ManifoldCF and Solr
> much more effective instead of the following:
> * Send a HTTP POST request to Solr
> * Solr sends a 401 response
> * Send the same request, but with a "{{Authorization: Basic}}" header
> With preemptive authentication, we can send the header in the first request.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (CONNECTORS-1577) Initial implementation of the Azure Storage Repository Connector
[ https://issues.apache.org/jira/browse/CONNECTORS-1577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piergiorgio Lucidi updated CONNECTORS-1577: --- Labels: (was: gsoc2019) > Initial implementation of the Azure Storage Repository Connector > > > Key: CONNECTORS-1577 > URL: https://issues.apache.org/jira/browse/CONNECTORS-1577 > Project: ManifoldCF > Issue Type: New Feature > Components: Azure Storage Repository Connector >Reporter: Piergiorgio Lucidi >Assignee: Piergiorgio Lucidi >Priority: Minor > > The community decided that it can be very useful to add an Azure Storage > Repository Connector for content indexing and migration purpose. > There are three different supported modes: blob, file and data disks. > Here an useful introduction: > [https://docs.microsoft.com/en-us/azure/storage/storage-introduction] > We will use a Java API for dropping contents using the Azure Storage API: > [https://docs.microsoft.com/en-us/azure/storage/storage-samples-java] > Managing accounts using the Azure SDK: > [https://github.com/Azure-Samples/storage-java-manage-storage-accounts] > For testing purpose we can also use the Azure Storage Explorer: > [https://docs.microsoft.com/en-us/azure/vs-azure-tools-storage-manage-with-storage-explorer] -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (CONNECTORS-1564) Support preemptive authentication to Solr connector
[
https://issues.apache.org/jira/browse/CONNECTORS-1564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16757137#comment-16757137
]
Karl Wright commented on CONNECTORS-1564:
-
[~erlendfg], if SolrJ is overriding our .setExpectContinue(true), then your
workaround is pretty reasonable, and I'd be happy to commit that (as long as
you include enough comment so that we can figure out what we were thinking
later).
> Support preemptive authentication to Solr connector
> ---
>
> Key: CONNECTORS-1564
> URL: https://issues.apache.org/jira/browse/CONNECTORS-1564
> Project: ManifoldCF
> Issue Type: Improvement
> Components: Lucene/SOLR connector
>Reporter: Erlend Garåsen
>Assignee: Karl Wright
>Priority: Major
> Attachments: CONNECTORS-1564.patch
>
>
> We should post preemptively in case the Solr server requires basic
> authentication. This will make the communication between ManifoldCF and Solr
> much more effective instead of the following:
> * Send a HTTP POST request to Solr
> * Solr sends a 401 response
> * Send the same request, but with a "{{Authorization: Basic}}" header
> With preemptive authentication, we can send the header in the first request.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (CONNECTORS-1577) Initial implementation of the Azure Storage Repository Connector
Piergiorgio Lucidi created CONNECTORS-1577: -- Summary: Initial implementation of the Azure Storage Repository Connector Key: CONNECTORS-1577 URL: https://issues.apache.org/jira/browse/CONNECTORS-1577 Project: ManifoldCF Issue Type: New Feature Components: Azure Storage Repository Connector Reporter: Piergiorgio Lucidi Assignee: Piergiorgio Lucidi The community decided that it can be very useful to add an Azure Storage Repository Connector for content indexing and migration purpose. There are three different supported modes: blob, file and data disks. Here an useful introduction: [https://docs.microsoft.com/en-us/azure/storage/storage-introduction] We will use a Java API for dropping contents using the Azure Storage API: [https://docs.microsoft.com/en-us/azure/storage/storage-samples-java] Managing accounts using the Azure SDK: [https://github.com/Azure-Samples/storage-java-manage-storage-accounts] For testing purpose we can also use the Azure Storage Explorer: [https://docs.microsoft.com/en-us/azure/vs-azure-tools-storage-manage-with-storage-explorer] -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (CONNECTORS-1564) Support preemptive authentication to Solr connector
[
https://issues.apache.org/jira/browse/CONNECTORS-1564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16757114#comment-16757114
]
Erlend Garåsen commented on CONNECTORS-1564:
I did another test where a custom header was set in the clientBuilder:
{code:java}
.setDefaultHeaders(Arrays.asList(new BasicHeader("X-Default-Header", "default
header httpclient"))){code}
And this header does actually show up:
{code:java}
DEBUG 2019-01-31T11:31:22,449 (Thread-4874) - http-outgoing-2 >>
X-Default-Header: default header httpclient{code}
> Support preemptive authentication to Solr connector
> ---
>
> Key: CONNECTORS-1564
> URL: https://issues.apache.org/jira/browse/CONNECTORS-1564
> Project: ManifoldCF
> Issue Type: Improvement
> Components: Lucene/SOLR connector
>Reporter: Erlend Garåsen
>Assignee: Karl Wright
>Priority: Major
> Attachments: CONNECTORS-1564.patch
>
>
> We should post preemptively in case the Solr server requires basic
> authentication. This will make the communication between ManifoldCF and Solr
> much more effective instead of the following:
> * Send a HTTP POST request to Solr
> * Solr sends a 401 response
> * Send the same request, but with a "{{Authorization: Basic}}" header
> With preemptive authentication, we can send the header in the first request.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (CONNECTORS-1491) GSOC: Azure Storage Output Connector
[ https://issues.apache.org/jira/browse/CONNECTORS-1491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piergiorgio Lucidi updated CONNECTORS-1491: --- Labels: cloud gsoc2018 gsoc2019 java junit (was: cloud gsoc2018 java junit) > GSOC: Azure Storage Output Connector > > > Key: CONNECTORS-1491 > URL: https://issues.apache.org/jira/browse/CONNECTORS-1491 > Project: ManifoldCF > Issue Type: New Feature > Components: Azure Storage Output Connector >Reporter: Piergiorgio Lucidi >Assignee: Piergiorgio Lucidi >Priority: Major > Labels: cloud, gsoc2018, gsoc2019, java, junit > Original Estimate: 480h > Remaining Estimate: 480h > > This is a project idea for [Google Summer of > Code|https://summerofcode.withgoogle.com/] (GSOC). > To discuss this or other ideas with your potential mentor from the Apache > ManifoldCF project, sign up and post to the dev@manifoldcf.apache.org list, > including "[GSOC]" in the subject. You may also comment on this Jira issue if > you have created an account. > We would like to extend the Content Migration capabilities adding Azure > Storage as a new output connector for importing contents from one or more > repositories supported by ManifoldCF. In this way we will help developers on > migrating contents from different data sources on Azure Storage. > You will be involved in the development of the following tasks, you will > learn how to: > * Write the connector implementation > * Implement unit tests > * Build all the integration tests for testing the connector inside the > framework > * Write the documentation for this connector > You will find a technical description about all the references to the Azure > Java SDK on an existing issue on our JIRA: > https://issues.apache.org/jira/browse/CONNECTORS-1441 > > We have a complete documentation on how to implement an Output Connector: > [https://manifoldcf.apache.org/release/release-2.9.1/en_US/writing-output-connectors.html] > Take a look at our book to understand better the framework and how to > implement connectors: > [https://github.com/DaddyWri/manifoldcfinaction/tree/master/pdfs] > > Prospective GSOC mentor: > [piergior...@apache.org|mailto:piergior...@apache.org] -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GSoC2019] - Proposals to improve ManifoldCF
Hi, it seems that we have only today to tag our proposals for the next edition of Google Summer of Code program. So I'm going to tag some of the old ideas with the new tag gsoc2019. Do you have any ideas to propose for students? In this case please feel free to tag or add new improvements in our JIRA project. Please let me know what you think. Thank you. Cheers, PJ -- Piergiorgio
