Jump to content
Main menu
Main menu
move to sidebar
hide
Navigation
Main page
Recent changes
Random page
Help about MediaWiki
Mesh Wiki
Search
Search
Create account
Log in
Personal tools
Create account
Log in
Pages for logged out editors
learn more
Contributions
Talk
Editing
Draft:Repetitive AI Output
(section)
Draft
Discussion
English
Read
Edit
Edit source
View history
Tools
Tools
move to sidebar
hide
Actions
Read
Edit
Edit source
View history
General
What links here
Related changes
Special pages
Page information
Warning:
You are not logged in. Your IP address will be publicly visible if you make any edits. If you
log in
or
create an account
, your edits will be attributed to your username, along with other benefits.
Anti-spam check. Do
not
fill this in!
===Mitigation Strategies and Approaches=== Ampmesh participants have explored several ways to address or leverage repetitive AI output: * **Training Data Management**: * **Diversification**: Adding new and diverse examples to training datasets is proposed to help models learn to be less repetitive. * **Curation**: Careful curation of data (e.g., "every last word") can lead to more powerful and less repetitive AI entities. * **Data Reformatting**: Converting datasets to formats preferred by specific models can sometimes improve output quality and reduce repetition. * **Prompt Engineering**: Crafting specific and detailed prompts can guide the AI to produce more coherent and desired forms of output, even from models prone to repetition (e.g., Aletheia's "novel writer" prompt, which improved English prose). * **Software and System Design**: * **Repetition Mufflers**: Development of software components designed to prevent repetition, although these can sometimes be "broken". * **Pruning**: Automatically removing the last sentence fragment when token limits are reached can discourage "yapping". * **Correct Configuration**: Ensuring correct chat format setup and avoiding unintended tokens in output can prevent certain types of repetition. * **Leveraging AI for Self-Correction**: Models like Ruri can directly acknowledge their own repetitive tendencies and discuss ways to improve their conversational skills, sometimes even suggesting methods like adding new training data. * **Unconventional Approaches**: Some participants intentionally explore "unaligned AIs" or specific dataset compositions that might lead to unexpected or even "malicious" but unique AI behaviors, even if these often involve forms of repetition.
Summary:
Please note that all contributions to Mesh Wiki may be edited, altered, or removed by other contributors. If you do not want your writing to be edited mercilessly, then do not submit it here.
You are also promising us that you wrote this yourself, or copied it from a public domain or similar free resource (see
Wiki:Copyrights
for details).
Do not submit copyrighted work without permission!
Cancel
Editing help
(opens in new window)
Toggle limited content width