[Dspace-tech] Import data -Mapfile

2012-10-17 Thread Hatem Jlassi 
Hi,

Thanks for your response.
I have not put quotes in the first line (list of fields); example of file In 
attachment.

Cdlt,
Hatem 



-Message d'origine-
De : ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] De la part de helix84 
Envoyé : 17 octobre 2012 11:08 À : Hatem Jlassi Cc : 
DSpace-tech@lists.sourceforge.net Objet : Re: [Dspace-tech] Import data -Mapfile

On Wed, Oct 17, 2012 at 4:42 PM, Hatem Jlassi  
wrote:
> It's ok for Mapfile, but I have other problem, I want to import a CSV batch 
> metadata , but dspace generates this error message " Unknown metadata element 
> in heading: id".

Hi Hatem,

if I remember correctly, this can happen if the cells in the header column are 
in quotes, like this:

"id","dc.identifier.uri","collection","action",...

Just remove the quotes from the first line:

id,dc.identifier.uri,collection,action,...

All the other lines can (and should) have quotes. If this is not the problem, 
let us know and I'll take another look.

Regards,
~~helix84


data.csv
Description: data.csv
--
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://p.sf.net/sfu/appdyn_sfd2d_oct___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

Re: [Dspace-tech] Import data -Mapfile

2012-10-17 Thread Hatem Jlassi 
Hi,

Thanks very much for your help.

It's ok for Mapfile, but I have other problem, I want to import a CSV batch 
metadata , but dspace generates this error message " Unknown metadata element 
in heading: id".

If someone could help me it would be greatly appreciated.

Regards,
Hatem


-Message d'origine-
De : Brian Freels-Stendel [mailto:bfre...@unm.edu] 
Envoyé : 12 octobre 2012 17:21
À : DSpace-tech@lists.sourceforge.net; Hatem Jlassi
Objet : Re: [Dspace-tech] Import data -Mapfile

Hi Hatem,

You need to specify a filename (with complete path) for the mapfile in the 
command, and it will be created by the import routine.  It's important that the 
file does not exist before you run import initially.  (If the import fails and 
you need to run it with the resume flag, the mapfile does need to exist.)

I hope that helps.  

B--

>>> On 10/12/2012 at 2:44 PM, in message
<85c980bb1085994793231c3abd13a5620e737...@xmbx03.sti.usherbrooke.ca>, Hatem 
Jlassi  wrote:
> Hi, everyone
> 
> I want to import data in Dspace, but I don't know where map file is 
> located or can I give any name just shown above.
> 
> Please, I need more clarification about map file, or if someone can 
> give me an example of structure of this file
> 
> Thanks in advance for your help.
> 
> Regards,
> Hatem Jlassi

--
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://p.sf.net/sfu/appdyn_sfd2d_oct
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

[Dspace-tech] Import data -Mapfile

2012-10-12 Thread Hatem Jlassi 
Hi, everyone

I want to import data in Dspace, but I don't know where map file is located or 
can I give any name just shown above.

Please, I need more clarification about map file, or if someone can give me an 
example of structure of this file

Thanks in advance for your help.

Regards,
Hatem Jlassi

--
Don't let slow site performance ruin your business. Deploy New Relic APM
Deploy New Relic app performance management and know exactly
what is happening inside your Ruby, Python, PHP, Java, and .NET app
Try New Relic at no cost today and get our sweet Data Nerd shirt too!
http://p.sf.net/sfu/newrelic-dev2dev___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

[Dspace-tech] Most Recent Additions/Jspui home page

2012-08-09 Thread Hatem Jlassi 
Hi all,

Please one question, how to place a "Most Recent Additions" for all 
communities/collections on the Dspace home page with the Jspui interface?
If someone has succeeded to configure this option,  please tell us the exact 
steps to take.

Thanks in advance for your help!

Best regards,
Hatem
--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

Re: [Dspace-tech] Searching : Diacritics & Indexing

2012-08-09 Thread Hatem Jlassi 
Hi Emilio,

Thanks for your response, I added this code in DSAnalyzer.java file and rebuild 
Dspace.
import org.apache.lucene.analysis.ASCIIFoldingFilter;
result = new ASCIIFoldingFilter(result);

It works now for search with accented characters, but how to remove a French 
stop words from indexes. Actually when to search a French stop words like. (Le, 
La, De, Dans), it displays all records that contain these words. It just 
removes the English stop words.

Regards,


De : emilio lorenzo [mailto:elore...@arvo.es]
Envoyé : 9 août 2012 03:18
À : Hatem Jlassi; dspace-tech@lists.sourceforge.net
Objet : Re: [Dspace-tech] Searching : Diacritics & Indexing

Hi,

The class ISOLatin1AccentFilter has been deprecated by Lucene (although still 
can be found...) and substitued by  ASCIIFoldingFilter class
For english + latin languages installations , we suggest the following  
org.dspace.search.DSAnalyzer configuration (keep the order, is relevant for the 
searcher):

import org.apache.lucene.analysis.ASCIIFoldingFilter;
..
..
result = new StandardFilter(result);
result = new LowerCaseFilter(result);
result = new StopFilter(result, stopSet);
result = new ASCIIFoldingFilter(result);
result = new PorterStemFilter(result);

Anyway, org.dspace.search.DSAnalyzer corresponds to Lucene configuration.
SOLR conf is quite different.
Best Luck.
Emilio


El 08/08/2012 20:14, Hatem Jlassi escribió:
Hi all,

We are running a bilingual (French/English) instance of last version of Dspace 
(1.8.2). We have some problems with the search with diacritics. The Dspace's 
searcher doesn't find words with accented characters when the search doesn't 
include these accents.
We modified 
(\dspace-1.8.2-src-release\dspace-api\src\main\java\org\dspace\search\DSAnalyzer.java)
 and we added the followings two lines:
ISOLatin1AccentFilter;
result = new ISOLatin1AccentFilter(result);
Rebuild, Re-index Dspace
But the problem was not resolved.

If anyone has solved this problem - Please Help!!! Thank You

Regards,






--

Live Security Virtual Conference

Exclusive live event will cover all the ways today's security and

threat landscape has changed and how IT managers can respond. Discussions

will include endpoint security, mobile security and the latest in malware

threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/





___

DSpace-tech mailing list

DSpace-tech@lists.sourceforge.net<mailto:DSpace-tech@lists.sourceforge.net>

https://lists.sourceforge.net/lists/listinfo/dspace-tech
--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

Re: [Dspace-tech] Searching : Diacritics & Indexing

2012-08-08 Thread Hatem Jlassi 
Hi,

Thanks for your response.,
But, the source code is correct, following the file content.

Regards,


/**
 * The contents of this file are subject to the license and copyright
 * detailed in the LICENSE and NOTICE files at the root of the source
 * tree and available online at
 *
 * http://www.dspace.org/license/
 */
package org.dspace.search;

import java.io.Reader;
import java.util.Set;

import org.apache.lucene.analysis.Analyzer;
import org.apache.lucene.analysis.ISOLatin1AccentFilter;
import org.apache.lucene.analysis.LowerCaseFilter;
import org.apache.lucene.analysis.PorterStemFilter;
import org.apache.lucene.analysis.StopFilter;
import org.apache.lucene.analysis.StopwordAnalyzerBase;
import org.apache.lucene.analysis.Tokenizer;
import org.apache.lucene.analysis.TokenStream;
import org.apache.lucene.analysis.standard.StandardFilter;
import org.apache.lucene.util.Version;
import org.dspace.core.ConfigurationManager;

/**
 * Custom Lucene Analyzer that combines the standard filter, lowercase filter,
 * stemming and stopword filters.
 */
public class DSAnalyzer extends StopwordAnalyzerBase
{
protected final Version matchVersion;
/*
 * An array containing some common words that are not usually useful for
 * searching.
 */
protected static final String[] STOP_WORDS =
{

// new stopwords (per MargretB)
"a", "am", "and", "are", "as", "at", "be", "but", "by", "for",
"if", "in", "into", "is", "it", "no", "not", "of", "on", "or",
"the", "to", "was"
// old stopwords (Lucene default)
/*
 * "a", "and", "are", "as", "at", "be", "but", "by", "for", "if", "in",
 * "into", "is", "it", "no", "not", "of", "on", "or", "s", "such", "t",
 * "that", "the", "their","then", "there","these", "they", "this", "to",
 * "was", "will", "with"
 */
};

/*
 * Stop table
 */
protected final Set stopSet;

/**
 * Builds an analyzer
 * @param matchVersion Lucene version to match
 */
public DSAnalyzer(Version matchVersion) {
super(matchVersion, StopFilter.makeStopSet(matchVersion, STOP_WORDS));
this.stopSet = StopFilter.makeStopSet(matchVersion, STOP_WORDS);
this.matchVersion = matchVersion;
}

@Override
protected TokenStreamComponents createComponents(String fieldName, Reader 
reader) {
final Tokenizer source = new DSTokenizer(matchVersion, reader);
TokenStream result = new StandardFilter(matchVersion, source);
result = new StandardFilter(result);
result = new LowerCaseFilter(matchVersion, result);
result = new StopFilter(matchVersion, result, stopSet);
result = new PorterStemFilter(result);
result = new ISOLatin1AccentFilter(result);
return new TokenStreamComponents(source, result);
return result;
}

@Override
public int getPositionIncrementGap(String fieldName)
{
// If it is the default field, or bounded fields is turned off in the 
config, return the default value
if ("default".equalsIgnoreCase(fieldName) || 
!ConfigurationManager.getBooleanProperty("search.boundedfields", false))
{
return super.getPositionIncrementGap(fieldName);
}

// Not the default field, and we want bounded fields, so return an 
large gap increment
return 10;
}
}



-Message d'origine-----
De : Brian Freels-Stendel [mailto:bfre...@unm.edu] 
Envoyé : 8 août 2012 14:41
À : DSpace-tech@lists.sourceforge.net; Hatem Jlassi
Objet : Re: [Dspace-tech] Searching : Diacritics & Indexing

Hi,

I think the problem may lie in the first line.  It should be

import org.apache.lucene.analysis.ISOLatin1AccentFilter;

and be included at the top of the file with the rest of the imports.  The 
second line looks fine, and goes with the rest of the filter statements.

B--

>>> On 8/8/2012 at 12:14 PM, in message
<85c980bb1085994793231c3abd13a5629ee...@xmbx03.sti.usherbrooke.ca>, Hatem 
Jlassi  wrote:
> Hi all,
> 
> We are running a bilingual (French/English) instance of last version 
> of Dspace (1.8.2). We have some problems with the search with 
> diacritics. The Dspace's searcher doesn't find words with accented 
> characters when the search doesn't include these accents.
> We modified
> (\dspace-1.8.2-src-release\

[Dspace-tech] Searching : Diacritics & Indexing

2012-08-08 Thread Hatem Jlassi 
Hi all,

We are running a bilingual (French/English) instance of last version of Dspace 
(1.8.2). We have some problems with the search with diacritics. The Dspace's 
searcher doesn't find words with accented characters when the search doesn't 
include these accents.
We modified 
(\dspace-1.8.2-src-release\dspace-api\src\main\java\org\dspace\search\DSAnalyzer.java)
 and we added the followings two lines:
ISOLatin1AccentFilter;
result = new ISOLatin1AccentFilter(result);
Rebuild, Re-index Dspace
But the problem was not resolved.

If anyone has solved this problem - Please Help!!! Thank You

Regards,

--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech