Need to let loose a primal scream without collecting footnotes first? Have a sneer percolating in your system but not enough time/energy to make a whole post about it? Go forth and be mid: Welcome to the Stubsack, your first port of call for learning fresh Awful youāll near-instantly regret.
Any awful.systems sub may be subsneered in this subthread, techtakes or no.
If your sneer seems higher quality than you thought, feel free to cutānāpaste it into its own post ā thereās no quota for posting and the bar really isnāt that high.
The post Xitter web has spawned soo many āesotericā right wing freaks, but thereās no appropriate sneer-space for them. Iām talking redscare-ish, reality challenged āculture criticsā who write about everything but understand nothing. Iām talking about reply-guys who make the same 6 tweets about the same 3 subjects. Theyāre inescapable at this point, yet I donāt see them mocked (as much as they should be)
Like, there was one dude a while back who insisted that women couldnāt be surgeons because they didnāt believe in the moon or in stars? I think each and every one of these guys is uniquely fucked up and if I canāt escape them, I would love to sneer at them.
(Credit and/or blame to David Gerard for starting this.)
https://xcancel.com/jasonlk/status/1946069562723897802
Vibe Coding Day 8,
Iām not even out of bed yet and Iām already planning my day on @Replit.
Today is AI Day, to really add AI to our algo.
[ā¦]
If @Replit deleted my database between my last session and now there will be hell to pay
Saw this, was going to post this a literal minute before you did but stared into this abyss a little too long.
Hereās what the abyss revealed:
- Guy is fucking stupid
- Guy is fucking stupid, hence the AI use
- Guy is fucking stupid, AI accidentally his whole database and he is still an AI glazer
Canāt wait to see this guy just use a different but same tool to delete his shit again, and learn nothing
Iād be lying if I said the randomly generated narrative the LLM is stringing together isnāt hilarious.
āI panicked and ran database commands without permission.ā
āI destroyed all production data.ā
āYou immediately said āNoā, 'āStopā, āYou didnāt even ask.āā
āBut it was already too late.ā
Thread on this lying bullshit
I feel like this response is still falling for the trick on some level. Of course itās going to āact contriteā and talk about how it āpanickedā because it was trained on human conversations and while that no doubt included a lot of Supernatural fanfic the reinforcement learning process is going to focus on the patterns of a helpful asistant rather than a barely-caged demon. Thatās the role itās trying to play and the work itās cribbing the script from includes a whole lot of shitposts about solving problems with ārm -rf /ā
also great: the promptfondlers unrapidly rediscovering why source control management exists and is desired
their story is so incoherent, i canāt even tell if there was a database to begin with
Iām kind of half looking forward to every soda being sweetened with aspartame or acesulfame potassium, so I can finally quit drinking them. Perhaps blue food might indirectly help people like me eat healthier for a while. Thanks, torment nexus.
janitorai - which seems to be a hosting site for creepy AI chats - is blocking all UK visitors due to the OSA
https://blog.janitorai.com/posts/3/
Iām torn here, the OSA seems to me to be massive overreach but perhaps shielding limeys from AI is wroth it
I need to rant about yet another SV tech trend which is getting increasingly annoying.
Itās something that is probably less noticeable if you live in a primarily English-speaking region, but if not, there is this very annoying thing that a lot of websites from US tech companies do now, which is that they automatically translate content, without ever asking. So English is pretty big on the web, and many English websites are now auto-translated to German for me. And the translations are usually bad. And by that I mean really fucking bad. (And Iām not talking about the translation feature in webbrowsers, itās the websites themselves.)
Small example of a recent experience: I was browsing stuff on Etsy, and Etsy is one of the websites which does this now. Entire product pages with titles and descriptions and everything is auto-translated, without ever asking me if I want that.
On a product page I then saw:
Material: gefĆ¼hlt
This was very strangeā¦ because that makes no sense at all. āGefĆ¼hltā is a form (participle) of the verb āfĆ¼hlenā, which means āto feelā. It can be used in a past tense form of the verb.
So, to make sense of this you first have to translate that back to English, the past tense āto feelā as āfeltā. And of course āfeltā can also mean a kind of fabric (which in German is called āFilzā), so itās a word with more than one meaning in English. You know, words with multiple meanings, like most words in any language. But the brilliant SV engineers do not seem to understand that you cannot translate words without the context theyāre in.
And this is not a singular experience. Many product descriptions on Etsy are full of such mistakes now, sometimes to the point of being downright baffling. And Ebay does the same now, and the translated product titles and descriptions are a complete shit show as well.
And Youtube started replacing the audio of English videos by default with AI-auto-generated translations spoken by horrible AI voices. By default! Itās unbearable. At least thereās a button to switch back to the original audio, but I keep having to press it. And now Youtube Shorts is doing it too, except that the YT Shorts video player does not seem to have any button to disable it at all!
Is it that unimaginable for SV tech that people speak more than one language? And that maybe you fucking ask before shoving a horribly bad machine translation into peopleās faces?
Click here if you want a horribly bad translation in your face
Is it that unimaginable for SV tech that people speak more than one language? And that maybe you fucking ask before shoving a horribly bad machine translation into peopleās faces?
This really gets on my nerves too. They probably came up with the idea that they could increase time spent on their platforms and thus revenue by providing more content in their usersā native languages (especially non-English). Simply forcing it on everyone, without giving their users a choice, was probably the cheapest way to implement it. Even if this annoys most of their user base, it makes their investors happy, I guess, at least over the short term. If this bubble has shown us anything, it is that investors hardly care whether a feature is desirable from the usersā point of view or not.
if itās opt-out, it also keeps use of the shitty ai dubbing high thus making it an artficial use case. itās like with gemini counting every google search as single use of it
Is it that unimaginable for SV tech that people speak more than one language? And that maybe you fucking ask before shoving a horribly bad machine translation into peopleās faces?
Considering how many are Trump bros, they probably consider getting consent to be Cuck Shittm and treat hearing anything but English as sufficient grounds to call ICE.
Ah, im not the only one, yes very annoying. I wonder if there isnāt also a setting they can ask the browsers about the users preferred language usage. Like how you can change languages on a windows install and some installers/etc follow that preferred language.
I found out about that too when I arrived at Reddit and it was translated to Swedish automatically.
Yes, right, Reddit too! Forgot that one. When I visit there I use alternative Reddit front-ends now which luckily spare me from this.
btw I noticed that Etsy is not actually in SV, so the problem is bigger than that.
An underappreciated 8th-season Star Trek: TNG episode where Data tries to get closer to humanity by creating an innovative new metamaterial out of memories of past emotions
Ooooh that would explain a similarly weird interaction I had on a ticket-selling website, buying a streaming ticket to a live show for the German retro game discussion podcast Stay Forever: they translated the title of the event as āBleib fĆ¼r immer am Lebenā, guess they named it āStay Forever Liveā? No way to know for sure, of course.
aliexpress did that since forever but you can just set display language once and youāre done. these ai-dubs are probably worst so far but can be turned off by uploader (itās opt-out) (for now)
Yud:
ChatGPT has already broken marriages, and hot AI girls are on track to remove a lot of men from the mating pool.
And suddenly I realized that I never want to hear a Rationalist say the words āmating poolā.
(I fired up xcancel to see if any of the usual suspects were saying anything eminently sneerable. Yudkowsky is re-xitting Hanania and some random guy who believes in g. Maybe he should see if the Pioneer Fund will bankroll publicity for his new bookā¦)
Good news for women, less risk of the pool needing to be drained because someone crapped in it again.
hot AI girls are on track to remove a lot of men from the mating pool
Canāt remove them if they were never in it.
hot AI girls are on track to remove a lot of men from the mating pool.
Wasnāt the āproblemā that thereās too many men in the mating pool and women are āalphamaxxingā or whatever the fuck to get the highest quality dick? Shouldnāt this be a good thing for incels like Hanania.
mating pool
probably on par with the other stuff you might see at a rationalist poly compound
rsyslog goes āAI firstā, for what reason? no one knows.
Opening ipython greeted me with this: āTip: IPython 9.0+ has hooks to integrate AI/LLM completions.ā
I wish open source projects would stop doing this.
rsyslog goes āAI firstā
what
Thanks for the āfrom now on stay away from this foreverā warning. Reading that blog post is almost surreal (āhow AI is shaping the future of loggingā), I have to remind myself itās a syslog daemon.
I wouldāve stanād syslog-ng but theyāve also been pulling some fuckery with docs again lately thatās making me anxious, so Iām very :|||||
Potential hot take: AI is gonna kill open source
Between sucking up a lot of funding that would otherwise go to FOSS projects, DDOSing FOSS infrastructure through mass scraping, and undermining FOSS licenses through mass code theft, the bubble has done plenty of damage to the FOSS movement - damage Iām not sure it can recover from.
that and deluge of fake bug reports
The deluge of fake bug reports is definitely something I should have noted as well, since that directly damages FOSSā capacity to find and fix bugs.
Baldur Bjanason has predicted that FOSS is at risk of being hit by āa vicious cycle leading to collapseā, and security is a major part of his hypothesised cycle:
-
Declining surplus and burnout leads to maintainers increasingly stepping back from their projects.
-
Many of these projects either bitrot serious bugs or get taken over by malicious actors who are highly motivated because they canāt relay on pervasive memory bugs anymore for exploits.
-
OSS increasingly gets a reputation (deserved or not) for being unsafe and unreliable.
-
That decline in users leads to even more maintainers stepping back.
yeah but have you considered how much itās worth that gramma can vibecode a todo app in seconds now???
-
Donāt know if LLMs will kill OSS, but they sure are a kick-in-the-dick
I remember popping into IRC or a mailing list to ask subsystem questions to learn from the sources themselves how something works (or should work). Depending who what and where definitely had differing experiences but overall I felt like there was typically a helpful person on the other side. Nowadays I fear the slop will make people a lot less willing to help when they are overwhelmed with AI generated garbage patches or mails losing some of the rose-tinted charm of open source.
Itās extremely annoying everywhere. GitHubās updates were about AI for so fucking long that I stopped reading them, which means I now miss actually useful stuff until someone informs me of it months later.
For example, did you know GitHub Actions now has really good free ARM runners? Itās amazing! I love it! Shame GitHub only botherās to tell me about their revolutionary features of āplease spam me with useless PRsā andā¦ make a pong game? What? Why would I want this?
ugh, why would i want a summary of a pull request? the whole point of reviewing a pull request is checking the details to make sure itās not missing something important or doing something wrong.
thescream.tiff
the announcement post is obviously LLM-generated as well
My favorite static site generator, Marmite, is now making Special Accomodations for AI bros by making a context file? The dev is also making all of his PRs with Claude.
Anyone have any recommendations for replacements?
I donāt know static site generators, but I took a look at your site and the text doesnāt render! The font file appears to not be good. Also sorry for having to move to another software.
Iām working on it! Hopefully itāll be legible sometime this week.
deleted by creator
Vegemite?
Iāll get my coat.
found on reddit. posted without further comment
Shot-in-the-dark prediction here - the Xbox graphics team probably wonāt be filling those positions any time soon.
As a sidenote, part of me expects more such cases to crop up in the following months, simply because the widespread layoffs and enshittification of the entire tech industry is gonna wipe out everyone who cares about quality.
Sanders why https://gizmodo.com/bernie-sanders-reveals-the-ai-doomsday-scenario-that-worries-top-experts-2000628611
Sen. Sanders: I have talked to CEOs. Funny that you mention it. I wonāt mention his name, but Iāve just gotten off the phone with one of the leading experts in the world on artificial intelligence, two hours ago.
. . .
Second point: This is not science fiction. There are very, very knowledgeable peopleāand I just talked to one todayāwho worry very much that human beings will not be able to control the technology, and that artificial intelligence will in fact dominate our society. We will not be able to control it. It may be able to control us. Thatās kind of the doomsday scenarioāand there is some concern about that among very knowledgeable people in the industry.
taking a wild guess itās Yudkowsky. āvery knowledgeable peopleā and āmany/most expertsā is staying on my AI apocalypse bingo sheet.
even among people critical of AI (who donāt otherwise talk about it that much), the AI apocalypse angle seems really common and itās frustrating to see it normalized everywhere. though I think Iām more nitpicking than anything because itās not usually their most important issue, and maybe itās useful as a wedge issue just to bring attention to other criticisms about AI? Iām not really familiar with Bernie Sandersā takes on AI or how other politicians talk about this. I donāt know if that makes sense, Iām very tired
Not surprised. Making Hype and Criti-hype the two poles of the public debate has been effective in corralling people who get that there is something wrong with the āAIā into Criti-hype. And politicians needs to be generalists so the trap is easy to spring.
Still, always a pity when people who should know better fall into it.
Hereās an example of normal people using Bayes correctly (rationally assigning probabilities and acting on them) while rats Just Donāt Get Why Normies Donāt Freak Out:
For quite a while, Iāve been quite confused why (sweet nonexistent God, whyyyyy) so many people intuitively believe that any risk of a genocide of some ethnicity is unacceptable while beingā¦ at best lukewarm against the idea of humanity going extinct.
(Dude then goes on to try to game-theorize this, I didnāt bother to poke holes in it)
The thing is, genocides have happened, and people around the world are perfectly happy to advocate for it in diverse situations. Probability wise, the risk of genocide somewhere is very close to 1, while the risk of āomnicideā is much closer to zero. If you want to advocate for eliminating something, working to eliminating the risk of genocide is much more rational than working to eliminate the risk of everyone dying.
At least on commenter gets it:
Most people distinguish between intentional acts and shit that happens.
(source)
Edit never read the comments (again). The commenter referenced above obviously didnāt feel like a pithy one liner adhered to the LW ethos, and instead added an addendum wondering why people were more upset about police brutality killing people than traffic fatalities. Nice āsaveā, dipshit.
Hmm, should I be more worried and outraged about genocides that are happening at this very moment, or some imaginary scifi scenario dreamed up by people who really like drawing charts?
One of the ways the rationalists try to rebut this is through the idiotic dust specks argument. Deep down, they want to smuggle in the argument that their fanciful scenarios are actually far more important than real life issues, because what if their scenarios are just so bad that their weight overcomes the low probability that they occur?
(I donāt know much philosophy, so I am curious about philosophical counterarguments to this. Mathematically, I can say that the more they add scifi nonsense to their scenarios, the more that reduces the probability that they occur.)
reverse dust specks: how many LWers would we need to permanently deprive of access to internet to see rationalist discourse dying out?
Whatās your P(that question has been asked at a US three letter agency)
it either was, or wasnāt, so 50%
You know, I hadnāt actually connected the dots before, but the dust speck argument is basically yet another ostensibly-secular reformulation of Pascalās wager. Only instead of Heaven being infinitely good if you convert thereās some infinitely bad thing that happens if you donāt do whatever Eliezer asks of you.
Recently, Iāve realized that there is a decent explanation for why so many people believe that - if we model them as operating under a strict zero-sum game model of the worldā¦ āeveryone losesā is basically an incoherent statement - as a best approximation it would either denote no change and therefore be morally neutral, or an equal outcome, and would therefore be preferable to some.
Yes, this is why people think that. This is a normal thought to think others have.
Why do these guys all sound like deathnote, but stupid?
because they cribbed their ideas from deathnote, and theyāre stupid
Hereās my unified theory of human psychology, based on the assumption most people believe in the Tooth Fairy and absolutely no other unstated bizarre and incorrect assumptions no siree!
I mean if you want to be exceedingly generous (I sadly have my moments), this is actually remarkably close to the āintentional actsā and āshit happensā distinction, in a perverse Rationalist way. ^^
Thats fair, if you want to be generous, if you are not going to be Id say there are still conceptually large differences between the quote and āshit happensā. But yes, you are right. If only they had listened to Scott when he said ātalk less like robotsā
Remember last week when that study on AIās impact on development speed dropped?
A lot of peeps take away on this little graphic was āsee, impacts of AI on sw development are a net negative!ā I think the real take away is that METR, the AI safety group running the study, is a motley collection of deeply unserious clowns pretending to do science and their experimental set up is garbage.
https://substack.com/home/post/p-168077291
āFirst, I donāt like calling this study an āRCT.ā There is no control group! There are 16 people and they receive both treatments. Weāre supposed to believe that the ātreated unitsā here are the coding assignments. Weāll see in a second that this characterization isnāt so simple.ā
(I am once again shilling Ben Rechtās substack. )
When you look at METRās web site and review the credentials of its staff, you find that almost none of them has any sort of academic research background. No doctorates as far as I can tell, and lots of rationalist junk affiliations.
oh yeah that was obvious when you see who they are and what they do. also, one of the large opensource projects was the lesswrong site lololol
iām surprised itās as well constructed a study as it is even given that
While I also fully expect the conclusion to check out, itās also worth acknowledging that the actual goal for these systems isnāt to supplement skilled developers who can operate effectively without them, itās to replace those developers either with the LLM tools themselves or with cheaper and worse developers who rely on the LLM tools more.
True. They arenāt building city sized data centers and offering people 9 figure salaries for no reason. They are trying to front load the cost of paying for labour for the rest of time.
OpenAI claims that their AI can get a gold medal on the International Mathematical Olympiad. The public models still do poorly even after spending hundreds of dollars in computing costs, but weāve got a super secret scary internal model! No, you cannot see it, it lives in Canada, but weāre gonna release it in a few months, along with GPT5 and Half-Life 3. The solutions are also written in an atrociously unreadable manner, which just shows how our model is so advanced and experimental, and definitely not to let a generous grader give a high score. (It would be real interesting if OpenAI had a tool that could rewrite something with better grammar, hmmmā¦) I definitely trust OpenAIās major announcements here, they havenāt lied about anything involving math before and certainly wouldnāt have every incentive in the world to continue lying!
It does feel a little unfortunate that some critics like Gary Marcus are somewhat taking OpenAIās claims at face value, when in my opinion, the entire problem is that nobody can independently verify any of their claims. If a tobacco company released a study about the effects of smoking on lung cancer and neglected to provide any experimental methodology, my main concern would not be the results of that study.
Edit: A really funny observation that I just thought of: in the OpenAI guyās thread, he talks about how former IMO medalists graded the solutions in message #6 (presumably to show that they were graded impartially), but then in message #11 he is proud to have many past IMO participants working at OpenAI. Hope nobody puts two and two together!
This result has me flummoxed frankly. I was expecting Google to get a gold medal this year since last year they won a silver and were a point away from gold. In fact, Google did announce after OAI that they had won gold.
But the OAI claim is that they have some secret sauce that allowed a āpureā llm to win gold and that the approach is totally generic- no search or tools like verifiers required. Big if true but ofc no one else is allowed to gaze at the mystery machine. It is hard for me to take them seriously given their sketchy history, yet the claim as stated has me shooketh.
Also funny aside, the guy who lead the project was poached by the zucc. So heās walking out the front door with the crown jewels lmaou.
404media posted an article absolutely dunking on the idea of pivoting to AI, as one does:
media executives still see AI as a business opportunity and a shiny object that they can tell investors and their staffs that they are very bullish on. They have to say this, I guess, because everything else they have tried hasnāt worked
Weāyes, even youāare using some version of AI, or some tools that have LLMs or machine learning in them in some way shape or form already
Fucking ghastly equivocation. Not just between āLLMsā and āmachine learningā, but between opening a website that has a chatbot icon I never click and actually wasting my time asking questions to the slop machine.
This is pure speculation, but I suspect machine learning as a field is going to tank in funding and get its name dragged through the mud by the popping of the bubble, chiefly due to its (current) near-inability to separate itself from AI as a concept.
Itās distressingly pervasive: autocorrect, speech recognition (not just in voice assistants, in accessibility tools), image correction in mobile cameras, so many things that are on by default and āhelpfulā
Apparently, for some corporate customers, Outlook has automatically turned on AI summaries as a sidebar in the preview pane for inbox messages. No, nobody Iāve talked to finds this at all helpful.
A thing I recently noticed: instead of showing the messages themselves, the MS Teams application on my work phone shows obviously AI generated summaries of messages in the notification tray. And by āsummariesā I mean third person paraphrasings that are longer than the original messages and get truncated anyway.
āWorse than uselessā would be an understatement.
It feels like gang initiation for insufferable dorks
Sex pest billionaire Travis Kalanick says AI is great for more than just vibe coding. Itās also great for vibe physics.
@TinyTimmyTokyo He has more dollars than sense, as they say. (Funnier if you say it out loud)
@blakestaceyMy guess is that vibe-physics involves bruteforcing a problem until you find a solution. That method sorta works, but is wholly inefficient and rarely robust/general enough to be useful.
Nah, heās just talking to an LLM.
āIāll go down this thread with [Chat]GPT or Grok and Iāll start to get to the edge of whatās known in quantum physics and then Iām doing the equivalent of vibe coding, except itās vibe physics,ā Kalanick explained. āAnd weāre approaching whatās known. And Iām trying to poke and see if thereās breakthroughs to be had. And Iāve gotten pretty damn close to some interesting breakthroughs just doing that.ā
And I donāt think you can brute force physics in general, having to experimentally confirm or disprove every random-ass intermediary hypothesis the brute force generator comes up with seems like quite the bottle neck.
For sure. Thereās an infinite amount of ways to get things wrong in math and physics. Without a fundamental understanding, all they can do is prompt-fondle and roll dice.
They are not even rolling the dice. The bot is just humoring them, it apparently just defaults to eventually going āyou are close to the edge of what is, known, well done keep goingā.
If infinite monkeys with typewriters can compose Shakespeare, then infinite monkeys with slop machines can produce Einstein (but you need to pump in infinite amounts of money first into my CodeMonkeyfy startup, just in case).
The curl Bug Bounty is getting flooded with slop, and the security team is prepared to do something drastic to stop it. Going by this specific quote, reporters falling for the hype is a major issue:
As a lot of these reporters seem to genuinely think they help out, apparently blatantly tricked by the marketing of the AI hype-machines, it is not certain that removing the money from the table is going to completely stop the flood. We need to be prepared for that as well. Letās burn that bridge if we get to it.
Reading through some of the examples at the end of the article itās infuriating when these slop reports have opened and when the patient curl developers try to give them benefit of the doubt the reporter replies with āyou have a vulnerability and I cannot explain further since Iām not an expertā. Oh but for sure itās broken and you are expert enough to know? One of the examples the reporter kept replying with how a strcpy() could be unsafe and the curl devs were kindly explaining that yes in general that function has potential for issues but their usage was not such a case. Reporter just repeats without paying attention. Insanity.
I love working in systems writing C and assembly but Iāve grown many gray hairs over the years being yelled at that āC is the worstā or ālol memory bugā or the classic āthis thing isnāt working perfectly for me so it must have been written in C and we need to rewrite it entirely in (alpha) language which is for sure better than the collective centuries of expertise in C existing nowā. These LLMs sure do amplify these obnoxious voices because now the fancy chatbot says so.
Reading through some of the examples at the end of the article itās infuriating when these slop reports have opened and when the patient curl developers try to give them benefit of the doubt the reporter replies with āyou have a vulnerability and I cannot explain further since Iām not an expertā
At that point, I feel the team would be justified in telling these slop-porters to go fuck themselves and closing the report - theyāve made it crystal clear theyāre beyond saving.
(And on a wider note, I suspect the security team is gonna be a lot less willing to give benefit of the doubt going forward, considering the slop-porters are actively punishing them for doing so)
Itās unfortunate that the bug bounty payout removal is probably the best immediate remedy for some filtering but with curl being everywhere resume padders are still going to rush to generate slop reports or patches. I hope they are more fast and direct with communication as well. Their current patience and politeness is admirable.
