• 0 Posts
  • 46 Comments
Joined 1 year ago
cake
Cake day: September 25th, 2023

help-circle




  • Right, and I mentioned CUDA earlier as one of the reason of their success, so it’s definitely something important. Clients might be interested in e.g Google TPU, startups like Etched, Tenstorrent, Groq, Cerebras Systems or heck even design their own but are probably limited by their current stack relying on CUDA. I imagine though that if backlog do keep on existing there will be abstraction libraries, at least for the most popular ones e.g TensorFlow, JAX or PyTorch, simply because the cost of waiting is too high.

    Anyway what I meant isn’t about hardware or software but rather ROI, namely when Goldman Sachs and others issue analyst report saying that the promise itself isn’t up to par with actual usage for paying customers.



  • I’m not sure if you played PCVR in the Summer but imagine that in a tiny room… it’s just way too hot. Again I’m NOT saying it’s good, or bad, I’m only saying you made assumption about OP usage. I’m not sure if you tried CloudXR but basically, it works and it’s not that complex to setup (e.g 1h) so it’s relatively faster and cheaper than building and owning a gaming PC.

    I don’t understand why you are even arguing about a legitimate usage.





  • Stuff like LLMs or ConvNets (and the likes) can already be used to do some pretty amazing stuff that we could not do a decade ago, there is really no need to shit rainbows and puke glitter all over it.

    I’m shitting rainbows and puking glitter on a daily basis BUT it’s not against AI as a field, it’s not against AI research, rather it’s against :

    • catastrophism and fear, even eschatology, used as a marketing tactic
    • open systems and research that become close
    • trying to lock a market with legislation
    • people who use a model, especially a model they don’t even have e.g using a proprietary API, and claim they are an AI startup
    • C-levels decision that anything now must include AI
    • claims that this or that skill is soon to be replaced by AI with actually no proof of it
    • meaningless test results with grand claim like “passing the bar exam” used as marketing tactics
    • claims that it scales, it “just needs more data”, not for .1% improvement but for radical change, e.g emergent learning
    • for-profit (different from public research) scrapping datasets without paying back anything to actual creators
    • ignoring or lying about non renewable resource consumption for both training and inference
    • relying on “free” or loss leader strategies to dominate a market
    • promoting to be doing the work for the good of humanity then signing exclusive partnership with a corporation already fined for monopoly practices

    I’m sure I’m forgetting a few but basically none of those criticism are technical. None of those criticism is about the current progress made. Rather, they are about business practices.


  • Their valuation is because there’s STILL a lineup a mile long for their flagship GPUs.

    Genuinely curious, how do you know where the valuation, any valuation, come from?

    This is an interesting story, and it might be factually true, but as far as I know unless someone has actually asked the biggest investor WHY they did bet on a stock, nobody why a valuation is what it is. We might have guesses, and they might even be correct, but they also change.

    I mentioned it few times here before but my bet is yes, what you did mention BUT also because the same investors do not know where else do put their money yet and thus simply can’t jump boats. They are stuck there and it might again be become they initially though the demand was high with nobody else could fulfill it, but I believe that’s not correct anymore.


  • Unfortunately it’s part of the marketing, thanks OpenAI for that “Oh no… we can’t share GPT2, too dangerous” then… here it is. Definitely interesting then but now World shattering. Same for GPT3 … but through exclusive partnership with Microsoft, all closed, rinse and repeat for GPT4. It’s a scare tactic to lock what was initially open, both directly and closing the door behind them through regulation, at least trying to.



  • move on to the next […] eager to see what they come up with next.

    That’s a point I’m making in a lot of conversations lately : IMHO the bubble didn’t pop BECAUSE capital doesn’t know where to go next. Despite reports from big banks that there is a LOT of investment for not a lot of actual returns, people are still waiting on where to put that money next. Until there is such a place, they believe it’s still more beneficial to keep the bet on-going.






    1. I’m not using that
    2. about a week
    3. it’s indeed like the gallery
    4. yes, you need to compile the firmware and flash it over USB. The first time is a tricky but then it takes just few minutes
    5. strangers have said it looked like actual paper. It’s extremely readible
    6. indeed it’s one face per firmware… but assuming there is enough space, you could imagine modifying it in order to have more faces
    7. for now I just briefly chat on Discord to get the basics going as I was one of the very first to have the new ESP S3, cf https://github.com/sqfmi/Watchy/issues/252
    8. cf 1 but I bet there is, I was thinking of changing the WiFi HTTP server to possibly send data to HomeAssistant but I didn’t explore that yet
    9. it’s my daily driver, it’s a HUGE thing but it works and often sparks interesting conversations, I like it

    Happy to clarify a bit more if need be.