So this seems similar to the effect of 'glitch tokens', but in this case its probably more like a 'glitch embedding'; some place in it's latent space of embeddings that the model arrived in by chance due to their conversation that is not where its supposed to be and/or very out of sample. Maybe sunflower seed oil math represents a "glitch concept embedding"...