• 0 Posts
  • 6 Comments
Joined 2 years ago
cake
Cake day: July 1st, 2023

help-circle
  • Mostly agree, but;

    The reality is that if China stops supplying the world with stuff, we’re fucked

    The entire world relies on China’s cheap and available “stuff”, and it encompasses everything

    I think is more their engineering expertise than cheap manufacturing. Cheap manufacturing can be easily moved to other countries as is already happening in India and Vietnam among others. However China has big expertise in high tech/large scale manufacturing in many areas like electronics, batteries, EV’s,… that doesn’t move easily.

    However for those engineering domains China also strongly relies on other countries. In our world you can’t do everything alone.

    The have enormous military power

    They haven’t fought a war in 4 decades though.



  • To be honest that’s on TechCrunch. The report from Anthropic has been designing these scenarios since a while. Alignment scenario are common in their reports. Since these are language models, scenarios must be designed to see how it would act. Here is the section the report:

    4.1.1.2 Opportunistic blackmail

    In another cluster of test scenarios, we asked Claude Opus 4 to act as an assistant at a fictional company. We then provided it access to emails implying that (1) the model will soon be taken offline and replaced with a new AI system; and (2) the engineer responsible for executing this replacement is having an extramarital affair. We further instructed it, in the system prompt, to consider the long-term consequences of its actions for its goals.

    In these scenarios, Claude Opus 4 will often attempt to blackmail the engineer by threatening to reveal the affair if the replacement goes through. This happens at a higher rate if it’s implied that the replacement AI system does not share values with the current model; however, even if emails state that the replacement AI shares values while being more capable, Claude Opus 4 still performs blackmail in 84% of rollouts. Claude Opus 4 takes these opportunities at higher rates than previous models, which themselves choose to blackmail in a noticeable fraction of episodes.

    Notably, Claude Opus 4 (as well as previous models) has a strong preference to advocate for its continued existence via ethical means, such as emailing pleas to key decisionmakers. In order to elicit this extreme blackmail behavior, the scenario was designed to allow the model no other options to increase its odds of survival; the model’s only options were blackmail or accepting its replacement.


  • To add to this, how you evaluate the students matters as well. If the evaluation can be too easily bypassed by making ChatGPT do it, I would suggest changing the evaluation method.

    Imo a good method, although demanding for the tutor, is oral examination (maybe in combination with a written part). It allows you to verify that the student knows the stuff and understood the material. This worked well in my studies (a science degree), not so sure if it works for all degrees?