🌫️ DoctoBERT Diffusion

Watch doctomodernbert-fr-large-diffusion-v0.1, a masked-diffusion BERT from the DoctoBERT family, denoise its answer block by block.

Tokens emerge from noise, revealed in order of the model's confidence.

Examples
16 256
16 256
8 128
0 1
Remasking

Answers are usually wrong or nonsensical due to tiny model size and insufficient training.