I am using solr-8.11.2. My MySql table has 13001335 which is around 259.9
GB.
solr.in.sh has the following entry -
SOLR_JAVA_MEM="-Xms15g -Xmx15g"
SOLR_OPTS="$SOLR_OPTS -Dsolr.disable.shardsWhitelist=true"
<dataConfig>
<dataSource type="JdbcDataSource"
driver="com.mysql.jdbc.Driver"
batchSize="-1"
autoReconnect="true"
useSSL="false"
socketTimeout="0"
connectTimeout="0"
encoding="UTF-8"
url="jdbc:mysql://xxx.xxx.xx.xxx:3306/archive_dbase?zeroDateTimeBehavior=convertToNull"
user="archive_user"
password="password66"/>
<document>
<entity name="newarchive" pk="ID"
query="SELECT * FROM newarchive"
deltaImportQuery="SELECT * FROM newarchive
WHERE posting_id = '${dataimporter.delta.posting_id}'"
deltaQuery="SELECT posting_id FROM newarchive
WHERE Deadline > '${dataimporter.last_index_time}'">
</entity>
</document>
</dataConfig>
Whenever I import the MySql stops after sometime and then restarts. Not all
records are imported. What changes do I need to make?
Regards,
Anuj