Tuesday, May 31, 2016

SharePoint 2013: The item has been truncated in the index because it exceeds the maximum size

Problem

During routine system checks, you discover numerous instances of the following warning occurring in the Search subsystem crawl log:
The item has been truncated in the index because it exceeds the maximum size. ( Item truncated. Field=body, Occurrences=121961, Chars=524290; ; SearchID = [ID string] )

Troubleshooting

  1. Checked MaxCharactersInPropertyStoreForRetrieval property: executed this commandlet
    (Get-SPEnterpriseSearchMetadataManagedProperty -Identity body -SearchApplication (Get-SPEnterpriseSearchServiceApplication)).MaxCharactersInPropertyStoreForRetrieval
    This returned 2097152, which is greater than the Chars count in the warning.  This value is in bytes.
  2. Checked MaxCharactersInPropertyStoreIndex property: executed this commandlet:
    (Get-SPEnterpriseSearchMetadataManagedProperty -Identity body -SearchApplication (Get-SPEnterpriseSearchServiceApplication)).MaxCharactersInPropertyStoreIndex
    This returned 0. This value is in bytes.
  3. Increased MaxCharactersInPropertyStoreIndex property:  executed this script
    $prop=Get-SPEnterpriseSearchMetadataManagedProperty -Identity body -SearchApplication (Get-SPEnterpriseSearchServiceApplication)
    $prop.MaxCharactersInPropertyStoreIndex=2097152
    $prop.Update()
  4. Checked Crawl Log for number of warnings: found 1405.
  5. Set three instances of this warning to be recrawled and then launched incremental crawl: see Notes below for steps.
  6. Checked Crawl Log for number of warnings: found 1402.
  7. Set all instances of warning to be re-crawled and then launched incremental crawl.
  8. Checked Crawl Log for number of warnings: found only 1271.  This indicates that 134 instances of this warning were resolved by increasing the MaxCharactersInPropertyStoreIndex value.

Solution

  • Increase the value of MaxCharactersInPropertyStoreIndex to something greater than the Occurrences value in the warning message.

References

Notes

  • To re-crawl an item appearing in the crawl log, perform these steps:
    1. Go to the Search Administration page
    2. Click Crawl Log (left quicklinks area)
    3. In the Warnings column, click on the number that appears there
    4. Hover the cursor over one of the instances of the warning: a dropdown bar appears
    5. Click it and then select Recrawl this item in the next crawl.
  • Chars: this value, in the warning message, indicates how much data is returned from the query. 
    • The MaxCharactersInPropertyStoreForRetrieval managed property relates to this,
  • Occurrences: this value indicates how much data may actually be stored in the index.  
    • The MaxCharactersInPropertyStoreIndex managed property relates to this.
  • After setting all remaining instances to be re-crawled, I found that six remained and that re-crawling these six was not affected by the change in the MaxCharactersInPropertyStoreIndex value.  Still not clear why that is.

No comments: