Just a regular Joe.

  • 0 Posts
  • 190 Comments
Joined 3 years ago
cake
Cake day: July 7th, 2023

help-circle




  • demonstrated any actual competency in this domain

    It may be that he/they have significant competency in this domain, just not publically or under this name/pseudonym.

    I’ve personally made contributions under pseudonyms just to avoid employer paperwork/approvals, for projects that I’d rather not have my real name attached to, and for sharing in potentially hostile communities.

    I’ve also developed software internal to companies that has never been released publicly.

    In short … he doesn’t need to prove his prior credentials to you, me, or anyone. He may have some, he may not.

    We can legitimately critique what he/they have done in this project all we like though.


  • Linus seems to be taking a perfectly pragmatic approach, given that AI is not going away short of WW3.

    I can imagine some individual sub-system maintainers introducing various AI-roadblocks though.

    I also expect this to be increasingly addressed (in general) with model & tooling improvements, giving more weight to higher quality reports and MRs, and more respect for project rules and processes. A mix of soft and hard gates, CLAs, improved early automated bug report & patch reviews and other CI gates.



  • AI hype and uncertainty is definitely influencing decision making, that’s for sure. If your company doesn’t have strong integrated product and architectural leadership, then managers across the company are probably grasping at straws, hoping to find some meaningful goals and ideas that stick. And lazy leaders, who traditionally rely on Gartner and similar feeds for trends and investment direction, probably think anything AI related is a safer bet than … well, anything else their underlings are proposing.

    Hence the need to wrap sound decisions in a layer of AI. It’s BS, and many know it’s BS, but it seems necessary just now.


  • gwbasic on an XT here. Automate yourself out of that particular job. If not you, someone else probably will, or some expensive outside consultant will identify it for the chopping block. Find something of more value to do within the company, and slap an AI label on it for good measure. You are in the trenches now and you see the dysfunction… It’s likely the same company-wide, so rife with opportunity.










  • My caveats were clearly stated… After capital expenditure, it’s just operational costs, where electricity & cooling are the big ones.

    At that point, it is insanely profitable to serve. The cheap API prices on open weights models hints at the profit margins involved in the US (the frontier labs and hyperscalers don’t open their books for us), unsurprisingly)

    Therefore, the longer they can serve existing and lower cost models at the current rates, the better for their bottom line. It’s just common sense in business.

    It doesn’t mean the company as a whole is profitable. I expect we’ll see turmoil in the coming months and years, and the prize will be compute capacity, with electricity & cooling options.


  • There is also a commercial aspect…

    Bigger models are more expensive to train and serve…

    Inference is currently insanely profitable if you have the hardware and the automation in place to support and serve it. At that point, it’s a money printing machine, and you want to squeeze as much out of it as you can.

    While training new models is extremely expensive, and serving them probably makes less profit (at least initially).

    Having an external brake applied to the frontier labs is likely good for their bottom line, while increasing hype and directing customers’ annoyance away from them.

    It’s likely only a temporary benefit, though. The dragon will catch up and apply more pressure, both on inference price and capabilities.