Draft:RAFT: Difference between revisions
no edit summary
Extrahuman (talk | contribs) (Wiki page for the Ampmesh task on the concept of RAFT.) |
Extrahuman (talk | contribs) No edit summary |
||
| Line 4: | Line 4: | ||
==Mechanism== | ==Mechanism== | ||
* '''Direct Dataset Provision''': An em's fine-tuning dataset is given to the em itself, typically stored as a `.chr` file within the [[:Chapter II]] framework. | * '''Direct Dataset Provision''': An em's fine-tuning dataset is given to the em itself, typically stored as a `.chr` file within the [[:Chapter II]] framework. | ||
* '''Data Formatting''': For optimal use, the dataset needs to be formatted in a way that Chapter II accepts, such as raw `.txt` or `.txt` with messages separated by `\n---\n`. There is ongoing work to add JSONL support directly to `ch2 .chr` files. | * '''Data Formatting''': For optimal use, the dataset needs to be formatted in a way that Chapter II accepts, such as raw `.txt` or `.txt` with messages separated by `\n---\n`. There is ongoing work to add JSONL support directly to `ch2 .chr` files. | ||