[jira] Issue Comment Edited: (SOLR-1191) NullPointerException in delta import
[
https://issues.apache.org/jira/browse/SOLR-1191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12995381#comment-12995381
]
Gunnlaugur Thor Briem edited comment on SOLR-1191 at 2/16/11 5:09 PM:
--
Updated patch with unit test, against current branch_3x.
was (Author: gthb):
Updated patch with unit test.
NullPointerException in delta import
Key: SOLR-1191
URL: https://issues.apache.org/jira/browse/SOLR-1191
Project: Solr
Issue Type: Bug
Components: contrib - DataImportHandler
Affects Versions: 1.3, 1.4
Environment: OS: Windows Linux.
Java: 1.6
DB: MySQL SQL Server
Reporter: Ali Syed
Assignee: Noble Paul
Fix For: 1.4
Attachments: SOLR-1191.patch, SOLR-1191.patch
Seeing few of these NullPointerException during delta imports. Once this
happens delta import stops working and keeps giving the same error.
java.lang.NullPointerException
at
org.apache.solr.handler.dataimport.DocBuilder.collectDelta(DocBuilder.java:622)
at
org.apache.solr.handler.dataimport.DocBuilder.doDelta(DocBuilder.java:240)
at
org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:159)
at
org.apache.solr.handler.dataimport.DataImporter.doDeltaImport(DataImporter.java:337)
at
org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:376)
at
org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.java:355)
Running delta import for a particular entity fixes the problem and delta
import start working again.
Here is the log just before after the exception
05/27 11:59:29 86987686 INFO btpool0-538 org.apache.solr.core.SolrCore -
[localhost] webapp=/solr path=/dataimport
params={command=delta-importoptimize=false} status=0 QTime=0
05/27 11:59:29 86987687 INFO Thread-4162
org.apache.solr.handler.dataimport.SolrWriter - Read dataimport.properties
05/27 11:59:29 86987687 INFO Thread-4162
org.apache.solr.handler.dataimport.DataImporter - Starting Delta Import
05/27 11:59:29 86987687 INFO Thread-4162
org.apache.solr.handler.dataimport.SolrWriter - Read dataimport.properties
05/27 11:59:29 86987687 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Starting delta collection.
05/27 11:59:29 86987690 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Running ModifiedRowKey() for
Entity: content
05/27 11:59:29 86987690 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Completed ModifiedRowKey for
Entity: content rows obtained : 0
05/27 11:59:29 86987690 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Completed DeletedRowKey for
Entity: content rows obtained : 0
05/27 11:59:29 86987692 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Completed parentDeltaQuery
for Entity: content
05/27 11:59:29 86987692 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Running ModifiedRowKey() for
Entity: job
05/27 11:59:29 86987692 INFO Thread-4162
org.apache.solr.handler.dataimport.JdbcDataSource - Creating a connection
for entity job with URL: jdbc:sqlserver://localhost;databaseName=TestDB
05/27 11:59:29 86987704 INFO Thread-4162
org.apache.solr.handler.dataimport.JdbcDataSource - Time taken for
getConnection(): 12
05/27 11:59:29 86987707 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Completed ModifiedRowKey for
Entity: job rows obtained : 0
05/27 11:59:29 86987707 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Completed DeletedRowKey for
Entity: job rows obtained : 0
05/27 11:59:29 86987707 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Completed parentDeltaQuery
for Entity: job
05/27 11:59:29 86987707 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Delta Import completed
successfully
05/27 11:59:29 86987707 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Starting delta collection.
05/27 11:59:29 86987709 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Running ModifiedRowKey() for
Entity: user
05/27 11:59:29 86987709 INFO Thread-4162
org.apache.solr.handler.dataimport.JdbcDataSource - Creating a connection
for entity user with URL: jdbc:sqlserver://localhost;databaseName=TestDB
05/27 11:59:29 86987716 INFO Thread-4162
org.apache.solr.handler.dataimport.JdbcDataSource - Time taken for
getConnection(): 7
05/27 11:59:29 86987873 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Completed ModifiedRowKey for
Entity: user rows obtained : 46
05/27 11:59:29 86987873 INFO Thread-4162
[jira] Issue Comment Edited: (SOLR-1191) NullPointerException in delta import
[
https://issues.apache.org/jira/browse/SOLR-1191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12982216#action_12982216
]
Gunnlaugur Thor Briem edited comment on SOLR-1191 at 1/17/11 10:23 AM:
---
I added a patch to resolve this. It resolves deltaQuery columns against pk when
they differ by prefix (and report error more helpfully when no column matches,
or more than one column matches).
No unit test, sorry (but there's not much deltaQuery coverage anyway). All
existing unit tests pass, and this is working fine for me in production.
was (Author: gthb):
Patch to resolve this. It resolves deltaQuery columns against pk when they
differ by prefix (and report error more helpfully when no column matches, or
more than one column matches).
No unit test, sorry (but there's not much deltaQuery coverage anyway). All
existing unit tests pass, and this is working fine for me in production.
NullPointerException in delta import
Key: SOLR-1191
URL: https://issues.apache.org/jira/browse/SOLR-1191
Project: Solr
Issue Type: Bug
Components: contrib - DataImportHandler
Affects Versions: 1.3, 1.4
Environment: OS: Windows Linux.
Java: 1.6
DB: MySQL SQL Server
Reporter: Ali Syed
Assignee: Noble Paul
Fix For: 1.4
Attachments: SOLR-1191.patch
Seeing few of these NullPointerException during delta imports. Once this
happens delta import stops working and keeps giving the same error.
java.lang.NullPointerException
at
org.apache.solr.handler.dataimport.DocBuilder.collectDelta(DocBuilder.java:622)
at
org.apache.solr.handler.dataimport.DocBuilder.doDelta(DocBuilder.java:240)
at
org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:159)
at
org.apache.solr.handler.dataimport.DataImporter.doDeltaImport(DataImporter.java:337)
at
org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:376)
at
org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.java:355)
Running delta import for a particular entity fixes the problem and delta
import start working again.
Here is the log just before after the exception
05/27 11:59:29 86987686 INFO btpool0-538 org.apache.solr.core.SolrCore -
[localhost] webapp=/solr path=/dataimport
params={command=delta-importoptimize=false} status=0 QTime=0
05/27 11:59:29 86987687 INFO Thread-4162
org.apache.solr.handler.dataimport.SolrWriter - Read dataimport.properties
05/27 11:59:29 86987687 INFO Thread-4162
org.apache.solr.handler.dataimport.DataImporter - Starting Delta Import
05/27 11:59:29 86987687 INFO Thread-4162
org.apache.solr.handler.dataimport.SolrWriter - Read dataimport.properties
05/27 11:59:29 86987687 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Starting delta collection.
05/27 11:59:29 86987690 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Running ModifiedRowKey() for
Entity: content
05/27 11:59:29 86987690 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Completed ModifiedRowKey for
Entity: content rows obtained : 0
05/27 11:59:29 86987690 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Completed DeletedRowKey for
Entity: content rows obtained : 0
05/27 11:59:29 86987692 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Completed parentDeltaQuery
for Entity: content
05/27 11:59:29 86987692 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Running ModifiedRowKey() for
Entity: job
05/27 11:59:29 86987692 INFO Thread-4162
org.apache.solr.handler.dataimport.JdbcDataSource - Creating a connection
for entity job with URL: jdbc:sqlserver://localhost;databaseName=TestDB
05/27 11:59:29 86987704 INFO Thread-4162
org.apache.solr.handler.dataimport.JdbcDataSource - Time taken for
getConnection(): 12
05/27 11:59:29 86987707 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Completed ModifiedRowKey for
Entity: job rows obtained : 0
05/27 11:59:29 86987707 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Completed DeletedRowKey for
Entity: job rows obtained : 0
05/27 11:59:29 86987707 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Completed parentDeltaQuery
for Entity: job
05/27 11:59:29 86987707 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Delta Import completed
successfully
05/27 11:59:29 86987707 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Starting delta collection.
05/27 11:59:29 86987709 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Running ModifiedRowKey() for
[jira] Issue Comment Edited: (SOLR-1191) NullPointerException in delta import
[
https://issues.apache.org/jira/browse/SOLR-1191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12982216#action_12982216
]
Gunnlaugur Thor Briem edited comment on SOLR-1191 at 1/17/11 10:24 AM:
---
I added a patch against branch_3x to resolve this. It resolves deltaQuery
columns against pk when they differ by prefix (and report error more helpfully
when no column matches, or more than one column matches).
No unit test, sorry (but there's not much deltaQuery coverage anyway). All
existing unit tests pass, and this is working fine for me in production.
was (Author: gthb):
I added a patch to resolve this. It resolves deltaQuery columns against pk
when they differ by prefix (and report error more helpfully when no column
matches, or more than one column matches).
No unit test, sorry (but there's not much deltaQuery coverage anyway). All
existing unit tests pass, and this is working fine for me in production.
NullPointerException in delta import
Key: SOLR-1191
URL: https://issues.apache.org/jira/browse/SOLR-1191
Project: Solr
Issue Type: Bug
Components: contrib - DataImportHandler
Affects Versions: 1.3, 1.4
Environment: OS: Windows Linux.
Java: 1.6
DB: MySQL SQL Server
Reporter: Ali Syed
Assignee: Noble Paul
Fix For: 1.4
Attachments: SOLR-1191.patch
Seeing few of these NullPointerException during delta imports. Once this
happens delta import stops working and keeps giving the same error.
java.lang.NullPointerException
at
org.apache.solr.handler.dataimport.DocBuilder.collectDelta(DocBuilder.java:622)
at
org.apache.solr.handler.dataimport.DocBuilder.doDelta(DocBuilder.java:240)
at
org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:159)
at
org.apache.solr.handler.dataimport.DataImporter.doDeltaImport(DataImporter.java:337)
at
org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:376)
at
org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.java:355)
Running delta import for a particular entity fixes the problem and delta
import start working again.
Here is the log just before after the exception
05/27 11:59:29 86987686 INFO btpool0-538 org.apache.solr.core.SolrCore -
[localhost] webapp=/solr path=/dataimport
params={command=delta-importoptimize=false} status=0 QTime=0
05/27 11:59:29 86987687 INFO Thread-4162
org.apache.solr.handler.dataimport.SolrWriter - Read dataimport.properties
05/27 11:59:29 86987687 INFO Thread-4162
org.apache.solr.handler.dataimport.DataImporter - Starting Delta Import
05/27 11:59:29 86987687 INFO Thread-4162
org.apache.solr.handler.dataimport.SolrWriter - Read dataimport.properties
05/27 11:59:29 86987687 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Starting delta collection.
05/27 11:59:29 86987690 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Running ModifiedRowKey() for
Entity: content
05/27 11:59:29 86987690 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Completed ModifiedRowKey for
Entity: content rows obtained : 0
05/27 11:59:29 86987690 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Completed DeletedRowKey for
Entity: content rows obtained : 0
05/27 11:59:29 86987692 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Completed parentDeltaQuery
for Entity: content
05/27 11:59:29 86987692 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Running ModifiedRowKey() for
Entity: job
05/27 11:59:29 86987692 INFO Thread-4162
org.apache.solr.handler.dataimport.JdbcDataSource - Creating a connection
for entity job with URL: jdbc:sqlserver://localhost;databaseName=TestDB
05/27 11:59:29 86987704 INFO Thread-4162
org.apache.solr.handler.dataimport.JdbcDataSource - Time taken for
getConnection(): 12
05/27 11:59:29 86987707 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Completed ModifiedRowKey for
Entity: job rows obtained : 0
05/27 11:59:29 86987707 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Completed DeletedRowKey for
Entity: job rows obtained : 0
05/27 11:59:29 86987707 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Completed parentDeltaQuery
for Entity: job
05/27 11:59:29 86987707 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Delta Import completed
successfully
05/27 11:59:29 86987707 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Starting delta collection.
05/27 11:59:29 86987709 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Running
[jira] Issue Comment Edited: (SOLR-1191) NullPointerException in delta import
[
https://issues.apache.org/jira/browse/SOLR-1191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12982216#action_12982216
]
Gunnlaugur Thor Briem edited comment on SOLR-1191 at 1/17/11 10:25 AM:
---
I added a patch against branch_3x to resolve this. It resolves deltaQuery
columns against pk when they differ by prefix (and reports the error more
helpfully when no column matches, or more than one column matches).
No unit test, sorry (but there's not much deltaQuery coverage anyway). All
existing unit tests pass, and this is working fine for me in production.
was (Author: gthb):
I added a patch against branch_3x to resolve this. It resolves deltaQuery
columns against pk when they differ by prefix (and report error more helpfully
when no column matches, or more than one column matches).
No unit test, sorry (but there's not much deltaQuery coverage anyway). All
existing unit tests pass, and this is working fine for me in production.
NullPointerException in delta import
Key: SOLR-1191
URL: https://issues.apache.org/jira/browse/SOLR-1191
Project: Solr
Issue Type: Bug
Components: contrib - DataImportHandler
Affects Versions: 1.3, 1.4
Environment: OS: Windows Linux.
Java: 1.6
DB: MySQL SQL Server
Reporter: Ali Syed
Assignee: Noble Paul
Fix For: 1.4
Attachments: SOLR-1191.patch
Seeing few of these NullPointerException during delta imports. Once this
happens delta import stops working and keeps giving the same error.
java.lang.NullPointerException
at
org.apache.solr.handler.dataimport.DocBuilder.collectDelta(DocBuilder.java:622)
at
org.apache.solr.handler.dataimport.DocBuilder.doDelta(DocBuilder.java:240)
at
org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:159)
at
org.apache.solr.handler.dataimport.DataImporter.doDeltaImport(DataImporter.java:337)
at
org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:376)
at
org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.java:355)
Running delta import for a particular entity fixes the problem and delta
import start working again.
Here is the log just before after the exception
05/27 11:59:29 86987686 INFO btpool0-538 org.apache.solr.core.SolrCore -
[localhost] webapp=/solr path=/dataimport
params={command=delta-importoptimize=false} status=0 QTime=0
05/27 11:59:29 86987687 INFO Thread-4162
org.apache.solr.handler.dataimport.SolrWriter - Read dataimport.properties
05/27 11:59:29 86987687 INFO Thread-4162
org.apache.solr.handler.dataimport.DataImporter - Starting Delta Import
05/27 11:59:29 86987687 INFO Thread-4162
org.apache.solr.handler.dataimport.SolrWriter - Read dataimport.properties
05/27 11:59:29 86987687 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Starting delta collection.
05/27 11:59:29 86987690 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Running ModifiedRowKey() for
Entity: content
05/27 11:59:29 86987690 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Completed ModifiedRowKey for
Entity: content rows obtained : 0
05/27 11:59:29 86987690 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Completed DeletedRowKey for
Entity: content rows obtained : 0
05/27 11:59:29 86987692 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Completed parentDeltaQuery
for Entity: content
05/27 11:59:29 86987692 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Running ModifiedRowKey() for
Entity: job
05/27 11:59:29 86987692 INFO Thread-4162
org.apache.solr.handler.dataimport.JdbcDataSource - Creating a connection
for entity job with URL: jdbc:sqlserver://localhost;databaseName=TestDB
05/27 11:59:29 86987704 INFO Thread-4162
org.apache.solr.handler.dataimport.JdbcDataSource - Time taken for
getConnection(): 12
05/27 11:59:29 86987707 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Completed ModifiedRowKey for
Entity: job rows obtained : 0
05/27 11:59:29 86987707 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Completed DeletedRowKey for
Entity: job rows obtained : 0
05/27 11:59:29 86987707 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Completed parentDeltaQuery
for Entity: job
05/27 11:59:29 86987707 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Delta Import completed
successfully
05/27 11:59:29 86987707 INFO Thread-4162
org.apache.solr.handler.dataimport.DocBuilder - Starting delta collection.
05/27 11:59:29 86987709 INFO Thread-4162
