I mean, Americans have turned blind eyes to roiling problems for decades.

What feels different is the curtain is pulled back now, at least for the rest of the world and many folks here, because everything turned into Idiocracy.

Americans may not be doing anything about it, but I also have a lot of family that’s sorta realizing “Oh… Reconstruction failed really hard, didn’t it?” Or “Oh… we’re a surveillance state.” And are looking back on lives and seeing some nasty shit (like bigoted aunts/uncles and worse) for what it was.

You don’t have to overclock, but I’d at least look at your mobo’s settings. Many mobos set really, really bad, non stock settings by default, especially with XMP memory.

An example: they might default to 1.3V VSOC which is absolutely a “default overclock” and is going to make idle power skyrocket, and your CPU potentially unstable because infinity fabric doesn’t like that. For reference, I personally wouldn’t go over 1.2V VSOC myself and shoot for like 1.1V.

I’d recommend Buildzoid’s videos:

https://youtu.be/dlYxmRcdLVw

https://youtu.be/Xcn_nvWGj7U

And Igor’s Lab for general text info.

Also, if you don’t turn on XMP at least (aka the RAM’s rated speed), they will run at some slow default and hurt your inference speed rather significantly.

For DDR5? Depends how much you care about latency:

https://pcpartpicker.com/products/memory/#ff=ddr5&Z=131072002&B=1000000000%2C1250000000&sort=price&page=1

The $342 Crucial kit is kinda a no-brainer for 128. Its timings aren’t great when overclocked, but it’s 5600 MHz out of the box, low voltage, and significantly cheaper per gigabyte than many 64GB/96GB kits. See for yourself:

https://www.igorslab.de/en/when-size-is-all-that-matters-crucial-2x-64-gb-ddr5-5600-kit-with-new-micron-32-gbit-ics-in-test-incl-gaming-and-overclocking/4/

The overclockability matters even less if you are on a 7000 series CPU.

I got the 1.25V Flare X5 kit because I wanted tighter timings for sim games, albeit at a MUCH lower price ($390) than it is now.

RAM prices seem to be rising (hence the price of my kit spiked by $200), so now is not a bad time to buy.

To what?

64G would be good, as that’s enough to fit GLM Air. There are some good 2x64GB 6000Mhz kits for 128GB as well.

I have access to GLM 4.6 through a service but that’s the ~350B parameter model and I’m pretty sure that’s not what you’re running at home.

It is. I’m running this model, with hybrid CPU+GPU inference, specifically: https://huggingface.co/Downtown-Case/GLM-4.6-128GB-RAM-IK-GGUF

You can likely run GLM Air on your 3060 desktop if you have 48GB+ RAM, or a smaller MoE easily. Heck. I’ll make a quant just for you, if you want.

Depending on the use case, I’d recommend ERNIE 4.5 21B (or 28B for vision) on your Macbook, or a Qwen 30B variant. Look for DWQ MLX quants, specifically: https://huggingface.co/models?sort=modified&search=dwq

Not anymore.

I can run GLM 4.6 on a Ryzen/single RTX 3090 desktop at 7 tokens/s, and it blows lesser API models away. I can run 14-49Bs (or GLM Air) in more utilitarian cases that do just fine.

And I can reach for free/dirt cheap APIs called locally when needed.

But again, it’s all ‘special interest tinkerer’ tier. You can’t do that with ollama run, you have to mess with exotic libraries and tweaked setups and RAG chains to squeeze out that kind of performance. But all that getting simplified is inevitable.

Use an anti-fingerprinting browser like Cromite:

https://github.com/uazo/cromite

And yes, new email. Maybe sign up via your cellular data (but only tethered or with a mobile browser like Cromite).

Personally I have just stayed off Reddit now.

What about people living in a country where youtube is blocked. I guess Google just says “fuck 'em”?

Yyep.

If you’re using a VPN, you’re likely anonymized and not directly making YouTube any money. Those are leeches, as far as a Google accountant is concerned.

Anything even tangentially AI, anything that even sounds like AI gets mass downvotes on Lemmy.

Don’t get me wrong, Sam Altman is an even bigger con artist than Musk. But outside the self hosting niches, Lemmy skews towards whatever the opposite extreme of ‘tech bro’ is.

Net might get to where you need AI

I hate to say it, but we’re basically there, and AI doesn’t help a ton. If the net is slop and trash, there’s not a lot it can do.

Hopefully by then they will have figured out a way to make it free.

Fortunately self hosting is 100% taking off. Getting a (free) local agent to sift through the net’s sludge will be about as easy as tweaking Firefox before long.

You can already do it. I already do it (and am happy to ramble about how when asked), but it’s more of an enthusiast/tinkerer thing now.

It’s because ‘anti-woke’ is not the same to every sect. You have:

• Oldschool conservatives like Mike Pence, a dying breed.

• Tech Bro billionaires like Musk, and their acolytes.

• ‘Talk radio/podcast’ conservatives like Steve Banon, the late Rush Limbaugh, Rumble influencers and such.

• The ‘Great Replacement Theory’ macho style MAGA like JD Vance.

There’s some weird intersection between them, and some fundamentally incompatible tenants that are finally colliding now that the Democrats are so useless as lighting rods.

but when they do get an AI for making porn they use it for BBC and twinks.

This is such an understatement, and already being done. Have you seen the eyebrow-searing stuff on CivitAI and SDXL discords?

Its glorious. It would make Mike Pence’s head explode.

Yep, LLM.

FYI this is today’s Wikipedia front page news, if you wish to look it up. Come on, bot, you can do it.

Okay…

Pop quiz. Who was just elected as president of Ireland?

Bad bot.

(Seriously, someone ban this spammer unless they offer proof of life?)

I was fortunate enough to travel outside the country recently.

Someone local asked us WTF is going on in America, and got… silence from our group, which was divided between Fox News boomers and millennials like me.

I think that’s quite emblematic. We can’t even talk about this shit in person without blowing up.

What you see online/in news now is a caricature of the worst of America. Normal people here aren’t chronically online, or worse, professional influencers, and algorithmic scams/busted parties largely made them delusional voters.

That being said, I’m a U.S. southerner and I have seen some shit you wouldn’t believe. Like shit too dramatic for television. Some is finally out in the open.

Well Musk’s quote there isn’t wrong.

Musk isn’t an engineer, but neither are those consultants. They should all be deferring to deeper within the company for technical decisions instead of conflating some sci fi literacy with practical decision making, and leave musk to making much coarser ones at most.

the press loves to give disproportionate airtime and column inches to far-right demagogues

Bingo.

Now you basically understand how we got here.

And that’s why Sora sucks, because it’s censored, closed weights, totally opaque, largely toolless, and peddled like spam.