The rigidity of filtered colimits of N-cluster tilting subcategories