My biggest takeaway here is that choosing the context length and (to a lesser extent) the temperature carefully is important for reducing hallucinations. I expected model families to vary widely between themselves but not for context length to have such a massive impact tbh.

It seems from this like reducing context length in applications where it isn’t essential for the model to hold very large amounts of context simultaneously would be best practice no?

And diesel prices (which underpin essentially all industry and production) have gone even more brrrrrrrrrr. Which means just about everything else will be shooting up in price soon if the strait remains closed…

Yeah, it’s a great game. I didn’t quite do the full completionist thing, but I told myself I’d get at least 95% of all of the banandium gems for each level and that would be good enough haha.

I actually do like roguelikes and might check this out because if it does have a good gameplay loop it will have a ton of replayability as opposed to a DLC that just adds another world or two and you’re done with it in four hours. It’s cool they’re offering a demo as well.

Interesting project. Is it actually possible to track workouts using your phone or smartwatch without needing proprietary third-party apps like Strava or Garmin Connect though?

Looks like it now has Docling Content Extraction Support for RAG. Has anyone used Docling much?

Oh and I typically get 16-20 tok/s running a 32b model on Ollama using Open WebUI. Also I have experienced issues with 4-bit quantization for the K/V cache on some models myself so just FYI

It really depends on how you quantize the model and the K/V cache as well. This is a useful calculator. https://smcleod.net/vram-estimator/ I can comfortably fit most 32b models quantized to 4-bit (usually KVM or IQ4XS) on my 3090’s 24 GB of VRAM with a reasonable context size. If you’re going to be needing a much larger context window to input large documents etc then you’d need to go smaller with the model size (14b, 27b etc) or get a multi GPU set up or something with unified memory and a lot of ram (like the Mac Minis others are mentioning).

Is it possible to use StreetComplete on iOS?

I think we can all agree that modifications to these models which remove censorship and propaganda on behalf of one particular country or party is valuable for the sake of accuracy and impartiality, but reading some of the example responses for the new model I honestly find myself wondering if they haven’t gone a bit further than that by replacing some of the old non-responses and positive portrayals of China and the CPC with a highly critical perspective typified by western governments which are hostile to China (in particular the US). Even the name of the model certainly doesn’t make it sound like neutrality and accuracy is their primary aim here.

I used to daily drive Ubuntu some years ago for work/personal use but have been back on Win 10 primarily for the last 4-5 years. I was considering trying to go back due to how much Windows sucks (despite some proprietary software only being available on it) but remembering the trouble I had with some networking/printer drivers and troubleshooting those issues and then seeing this article Is definitely making me reconsider…

Yeah I use voyager pretty much exclusively on my iPhone so maybe I should request a feature like that there? Seems like it would be something that many people would appreciate. Not sure why I end up seeing posts with -10, -15 votes… Those are generally trash haha

It would be cool if they would provide some useful statistics about the aggregated data as well. Maybe something like showing the percentile for pay to the ED/CEO or for the total compensation compared to other organizations in the sector.

I didn’t scour the site so maybe this does exist.

The US government’s position on this can be summed up as “massive unaccountable US tech firms having all of your data and manipulating public opinion via their black box algorithms is okay, but Chinese companies doing that is a national security concern”. I call BS. The degree to which China is actually a US adversary is being massively overstated by the US government as they see this as a threat to US geopolitical hegemony and America’s ability to propagandize its own citizens. I have spent some time on RedNote (Xiaohongshu) and all I have seen is friendly cross-cultural exchange and discussion between these supposed ‘adversaries’.

Seeing stuff like this in the uplifting news community instead of shit like ‘local kid spends 60 hours a week selling lemonade to pay for sister’s cancer treatments’ is why I appreciate Lemmy vs Reddit.

Based on the differences in color for each handle it makes me wonder if the one for not washing your hands is a different material. Maybe an antimicrobial metal like a copper alloy.

The guardian article only summarizes a limited amount of the product test information. See here for more products that were tested: https://www.mamavation.com/health/condoms-lubricants-pfas-forever-chemicals.html#Not_Our_Favorite_Condoms

This kind of technocratic approach can sound great and it’s always good to have policy and positions formed by those most knowledgeable in the relevant field. The problem is that the “experts” that will likely have her ear will be the ones that are vetted and approved by the power elite, the wealthiest in this country who will largely recommend what is best to protect their privilege, wealth and position.

This is the kind of news that should actually be posted on all of the ‘uplifting news’ communities, instead of ‘teen works 600 hours for minimum wage to help pay for his mother’s dialysis’ or whatever…

I there a changelog available?