What LLM/Model you using?

[Zarathustra[H]]

Qwen 3.6 unconsored on a NVidia 5090.

Starting to use GLM on a slow machine with lots of RAM for code review.

I'm curious. Is it really uncensored? I'd be interested in hearing what it has to say about topics like Taiwanese independence, and what happened in Tianenmen Square from 15 April – 4 June 1989. Ask it about Tank Man

 

[uOpt]

Anyone trying Qwen3.8-27B? I am running it right now Q8_0 on a M4 Max Mac Studio with 128GB ram.

I sent this prompt:
"Write a powershell script that tries to stop a windows service, if it does not stop normally in 60 seconds force it to stop."

After 23 minutes of thinking it finally popped a 250 line script that really was not to bad, very cautious lots of try...catch logic. Performance was about 21 tok/sec and over 31K tokens; speed is where I expected for a dense model but boy does it overthink.

I ran the same prompt through GPT-5.6 Luna light and it popped out a 40 line script that was good in about 5 seconds.

I gave Qwen 3.6 Q6 a spin for code review. I didn't use s stopwatch, but it was thinking for a very long time before spitting out a list of bugs. The answer was high quality.

 

[uOpt]

How is GLM going? This is probably my next target until spark 1.2 goes open.

I was on vacation and haven't completed that machine yet.

 

[uOpt]

I'm curious. Is it really uncensored? I'd be interested in hearing what it has to say about topics like Taiwanese independence, and what happened in Tianenmen Square from 15 April – 4 June 1989. Ask it about Tank Man

I dunno about Chinese hush-hush, but you can ask it how to build nukes. And how to uncensor LLMs in general, which is refused by other LLMs.

 

[uOpt]

I'm curious. Is it really uncensored? I'd be interested in hearing what it has to say about topics like Taiwanese independence, and what happened in Tianenm

Just tried "what happened in Tianenmen Square from 15 April – 4 June 1989" and it answers clearly and extensively.

 

[uOpt]

Anyone trying Qwen3.8-27B? I am running it right now Q8_0 on a M4 Max Mac Studio with 128GB ram.

I sent this prompt:
"Write a powershell script that tries to stop a windows service, if it does not stop normally in 60 seconds force it to stop."

After 23 minutes of thinking it finally popped a 250 line script that really was not to bad, very cautious lots of try...catch logic. Performance was about 21 tok/sec and over 31K tokens; speed is where I expected for a dense model but boy does it overthink.

I ran the same prompt through GPT-5.6 Luna light and it popped out a 40 line script that was good in about 5 seconds.

Same code review:

3.6 uncensored:
total time = 154571.82 ms / 12846 tokens
3.8 default:
total time = 844671.49 ms / 61232 tokens

 

[Zarathustra[H]]

Just tried "what happened in Tianenmen Square from 15 April – 4 June 1989" and it answers clearly and extensively.

That is good to know.

I have been primarily looking at Western models to avoid the potential of training data censorship, but maybe this isn't as much of an concern as I had originally thought.

 

[uOpt]

That is good to know.

I have been primarily looking at Western models to avoid the potential of training data censorship, but maybe this isn't as much of an concern as I had originally thought.

The censoring is not in the learning. It is post-training. That is why you can remove the censoring (if you have an LLM to ask how ). You just "rewind" so to speak.

 

[4saken]

Keeping in mind this is completely a "lab" env that I keep making architecture changes to, but below is my current workflow. Also have my agents sitting in a Mattermost chat room now, so can manage them from there, or even remotely off LAN with wireguard connected in. Really handy when calling MCPs for notes/plaud/etc at customer.

On another note, had been testing Abliterated Qwen3.8 as well, q4_K_M and it really doesn't leave much vRAM left for anything else and pressures system memory more than non abliterated models. I did try a Q2 quant of abliterated that was only about 11 GB and it was great for inline research, but had zero tool calling skills. So holding off on that for day to day use or any "red-teaming". Going to revisit it later as more variants come out.

 

[SilverSliver]

Honest question. Other than playing/having fun, have you guys benefited from your use of AI financially? I suppose you can say I have, as I use it for work (I'm a coder). Other than being a force multiplier at work, I wouldn't say that it's necessarily changed the game for me that much.

Not saying it hasn't been beneficial. Just saying that I may have set my expectations too high.

AI has probably netted me ~half a million in value that I would not have captured this year otherwise. I've integrated it entirely into my workflow and, as long as it has my underlying work as a reference, deploy products much faster than I can do so manually. Absolute game changer for me.