Tokenizing environmental attributes does more harm than good