Are you able to search for specific categories in the column as well?
The numbers are a reference to the category ID and should be displayed when the name is empty or duplicated in the list which is the case when the name is empty. Do some of your categories have empty names or maybe contain HTML? Can you retrieve the actual name for the category with ID 5640?