We already know AGI isn’t possible with LLM technology but looking past this, what I despise in the current state of AI tech journalism is the loop of:

• AI stakeholder/spokesperson says something unrealistic
• Journalist nods their head approvingly
• Article is virtually an ad that recounts an event
• Rinse and repeat

Too many tech enthusiasts masquerading as ‘journalists’ who seemingly suffer from short-term memory loss.

It’s like i’m seeing the same information on repeat because ‘journalists’ fall for the same marketing tactics endlessly and do little to actually question what they hear.

i think it was more a manufactured movement by corporate America than grassroots, that stoked discontent by feeding exceptionalism and institutionalised racism (among other things).

is it that impressive? I’m guessing it’s just a layer of speech-to-text then token parsing like usual.

I don’t live in the US but it must be hard seeing that there are groups that are anti-vaccines who will make those decisions for their children who inevitably will get sick, and those who are sensible have the full knowledge that this was easily avoidable because prior to vaccinations there was widespread death.

Also not uniquely a US problem but clearly at the forefront of online media.

on the point of depreciation. would a hyperscaler be able to make a profitable return on a per GPU basis before they’ve maxed out its use?

genuine question not a rhetorical.

LLMs ingest tokens as input. It is a core component of natural language processing. When entering a query into an LLM the text will be parsed as tokens.

I don’t know if the investing is inherently problematic. I do believe that the current situation is the culmination of many intersecting societal issues.

I’m no expert so take what I say with a grain of salt.

LLMs are prohibitively expensive to run.

If I wanted to make a basic rollerball pen, the cost would be high because I would have to gather the resources just to make a single unit. Mass manufacturing drops the price considerably to make it affordable for me to buy a pen.

But tokens aren’t the same as a factory line. If it’s $1 for me to use an LLM then it’s $100 for 100 people. It scales poorly.

LLM availability over cloud infrastructure requires resources that are expensive to build and depreciate quickly to the point that ROI is untenable (ie. Nvidia’s GPUs).

Now imagine a stock market that hinges around a handful of companies that are involved in that infrastructure component (eg. SK hynix). If many retail investors have dumped their savings into those stocks which can’t provide an expected return then the value of people’s savings will inevitably fluctuate on the whims of the AI industry.

You can imagine what will happen the next time a Chinese company releases a free and efficient LLM that can run on an 8GB RAM personal laptop. The panic selling will reverberate through the markets and a lot of people’s savings will evaporate overnight.

they have the same problems we see in other advanced economies:

• aging population
• lack of housing
• not enough births
• household financial pressure
• using trading/gambling as an additional income stream

They do have well known global industries but workers generally-speaking aren’t paid enough / have limited free time outside of their work. To add more pressure I believe the government increased the pension which is typically paid by the working population who are already financially stretched as it is.

They’re on track for destabilisation in the next 20-30 years.

i presume it means their economy will crash sooner than USA’s.

we’re standing on a cliff watching people get swept away by a big wave and you keep clarifying to all the onlookers that it’s actually called a tsunami.

forest from the trees dude.

Anthropic is likely to tell investors that it sees its total addressable ​market (TAM) exceeding $30 trillion, ahead of the $28.5 ‌trillion estimate from SpaceX (SPCX.O), the Wall Street Journal reported on Tuesday.

they’re predicting to sell GREATER THAN $30 trillion because they’re overvaluing a business that has no pathway to profitability.

It also isn’t ’way overblown’ because in no way is this standard behaviour in a market. To me it looks like a pump and dump with more steps.

keep in mind that would be enough to solve homelessness in virtually any nation

My take is that the Saudis were incredibly fortunate to be sitting on a resource that has had inelastic demand for decades. So fortunate in fact that they didn’t get good at anything else that wasn’t related to oil.

They’ve known for some time that the oil reserves can’t sustain them forever so they’ve dabbled in investments in various industries with lacklustre results.

Their recent foray into gaming is symbolic of this. An industry that bleeds cash without the creative talent that underpins it. I mean Microsoft is a good example of when ‘business’ intersects with the production of art.

i presume this is for tax dodging?

mark zuckerberg must have the hardest time making any sort of genuine human connection.

there used to be a time when a business had to have a proven product/service that brought consistent value to the customer.

openai has been throwing darts blindly at the dartboard for the last three years that it bewilders me that anyone could think they have the ability to be stable or profitable in the near future.

my thing is, if everyone is using LLMs to write emails (for example) then there needs to be a re-think about online communication as a whole and that would definitely not involve LLMs.

i would recommend to watch the clip first

basic rule for life (and messing with computer hardware / software) - it’s inevitable that you will have times that are challenging and difficult but if you work through the problems you’ll come out the other side with more experience under your belt.

You may have zero knowledge now but I can already tell that the desire to improve is there.

We all start somewhere.

OpenAI is trying to artificially plump themselves up before going for IPO. They “attacked” a vendor that dispenses LLM and LLM-adjacent products that are similarly aligned with OpenAI’s goals. It almost seems like it was a coordinated event to generate a sense of mystique around their premier models (à la Anthropic with Mythos).

literally said at the conference last week that we don’t need people we need more agents to get rid of the people.

this cunt is high off his own supply and is barely held accountable for the contradictions he makes