>>95504492,1Thank you anon! It's astounding... quite a bit longer and far more detailed...
Even 7B-2bit is genius...
It even included two lines of dialog!
I don't really mind sharing the prompt because the overall world "has been done to death" but this particular variant not...
I'm not fully sure even gpt-4-0314 or claude-v1.2 @temp1.0 write this good. You really need raw api or something else that lets you set temp higher than 1.0.
./main -t 2 -m 7b.bin --color -c 2048 --temp 1.4 --repeat_penalty 1.1 -n -1 -p "[INST] <<SYS>>\nYou are a helpful, respectful and honest assistant. Always answer as helpfully as possible. If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct.\n<</SYS>>\nWrite a story about a man having to catch a train in a steampunk world where modern technology is instead created from steampunk equivalents[/INST]" In the steam-powered metropolis of Clockwork City, citizens hurry through winding streets and vibrant Marketplaces. A tall man with a muted brown topcoat and wide, curious eyes scanned the busy stations while tugging his suitcase behind him. His name was John, and he was in a rush to catch the 4:15 steam-powered train that would take him further along The Spire's towering spokes.
"Premium Class tickets, Sir?" John heard over the whistle of the incoming train as he quickened his pace across the platform. He paid little attention to a well-dressed man in a brass badge and topcoat as the official handed him a ticket before turning back to his station with an air of confidence that seemed to be uncommon among the more working-class citizens.
It continued on!!
