索引更新

Document Typexml<delete><query>*:*</query></delete><commit/>
提交：

Response:

{

  "responseHeader": {

    "status": 0,

    "QTime": 3

  }

}

数据清理成功：

更新SOLR 数据

[root@itdba nutch]# /u01/nutch/nutch/runtime/local/bin/nutch updatedb -D mapred.reduce.tasks=2 -D mapred.child.java.opts=-Xmx1000m -D mapred.reduce.tasks.speculative.execution=false -D mapred.map.tasks.speculative.execution=false -D mapred.compress.map.output=true 1434821324-26372 -crawlId 20150621

DbUpdaterJob: starting at 2015-06-21 14:56:30

DbUpdaterJob: batchId: 1434821324-26372

DbUpdaterJob: finished at 2015-06-21 14:56:38, time elapsed: 00:00:07

[root@itdba nutch]# /u01/nutch/nutch/runtime/local/bin/nutch index -D mapred.reduce.tasks=2 -D mapred.child.java.opts=-Xmx1000m -D mapred.reduce.tasks.speculative.execution=false -D mapred.map.tasks.speculative.execution=false -D mapred.compress.map.output=true -D solr.server.url=http://localhost:8983/solr/ -all -crawlId 20150621

IndexingJob: starting

Active IndexWriters :

SOLRIndexWriter

        solr.server.url : URL of the SOLR instance (mandatory)

        solr.commit.size : buffer size when sending to SOLR (default 1000)

        solr.mapping.file : name of the mapping file for fields (default solrindex-mapping.xml)

        solr.auth : use authentication (default false)

        solr.auth.username : username for authentication

        solr.auth.password : password for authentication

http://pt.itdba.net:8983/solr/collection1/browse?q=csdn

数据查询，成功！

重复数据删除

[root@itdba nutch]# /u01/nutch/nutch/runtime/local/bin/nutch solrdedup -D mapred.reduce.tasks=2 -D mapred.child.java.opts=-Xmx1000m -D mapred.reduce.tasks.speculative.execution=false -D mapred.map.tasks.speculative.execution=false -D mapred.compress.map.output=true http://localhost:8983/solr/