awg

Karma: 364

awg 27 Mar 2024 1:10 UTC
1 point
0
in reply to: Seth Herd’s comment on: On Devin
Totally agree with you here. I think probably half of their development energy was spent getting to where GPT-4 Functions were right when Functions came out and they were probably like...oh...welp.

awg 27 Mar 2024 1:08 UTC
1 point
0
in reply to: Gerald Monroe’s comment on: On Devin
Just seeing this, sorry. I think they could have gotten a lot of the infrastructure going even before GPT-4, just in a sort of toy fashion, but I agree, most of the development probably happened after GPT-4 became available. I don’t think long context was as necessary, because my guess is the infrastructure set up behind the scenes was already parceling out subtasks to subagents and that probably circumvented the need for super-long context, though I’m sure having longer context definitely helps.
My guess is right now they’re probably trying to optimize which sort of subtasks go to which model by A/B testing. If Claude 3 Opus is as good as people say at coding, maybe they’re using that for actual coding task output? Maybe they’re using GPT-4T or Gemini 1.5 Pro for a central orchestration model? Who knows. I feel like there are lots of conceivable ways to string this kind of thing together, and there will be more and more coming out every week now...

awg 18 Mar 2024 13:56 UTC
20 points
15
on: On Devin
It took longer to get from AutoGPT to Devin than I initially thought it would, though in retrospect it only took “this long” because that’s literally about how long it takes to productize something comparatively new like this.
It does make me realize though that the baking timer has dinged and we’re about to see a lot more of this stuff coming out of the oven.

awg 17 Nov 2023 13:47 UTC
1 point
0
in reply to: Chris_Leong’s comment on: We are Peacecraft.ai!
Agreed. You’ll bifurcate the mission and end up doing both things worse than you would have done if you’d just picked one and focused.

awg 30 Aug 2023 15:47 UTC
1 point
−2
in reply to: Dan H’s comment on: Broken Benchmark: MMLU
Your position seems to be one that says this is not something to be worried about/looking at. Can you explain why?
For instance, if it is a desire to train predictive systems to provide accurate information, how is 10% or even 1-2% label noise “fine” under those conditions (if, for example, we could somehow get that number down to 0%)?

awg 29 Aug 2023 19:35 UTC
2 points
0
in reply to: Maxwell Peterson’s comment on: Dating Roundup #1: This is Why You’re Single
Ah. Yeah, it’s been forever and a day since I used it as well. Bummer to hear they’ve succumbed to the swiping model!

awg 29 Aug 2023 19:02 UTC
2 points
0
on: Dating Roundup #1: This is Why You’re Single
Isn’t OkCupid still around? I was confused by your saying that it no longer exists. Did it change ownership or style or something?
https://www.okcupid.com/

Broken Benchmark: MMLU

awg29 Aug 2023 18:09 UTC

23 points

5 comments1 min readLW link

(www.youtube.com)

awg 29 Jul 2023 23:35 UTC
2 points
0
in reply to: Gerald Monroe’s comment on: Self-driving car bets
This was a lot clearer, thank you.

awg 29 Jul 2023 23:14 UTC
12 points
9
in reply to: Gerald Monroe’s comment on: Self-driving car bets
You speak with such a confident authoritative tone, but it is so hard to parse what your actual conclusions are.
You are refuting Paul’s core conclusion that there’s a “30% chance of TAI by 2033,” but your long refutation is met with: “wait, are you trying to say that you think 30% is too high or too low?” Pretty clear sign you’re not communicating yourself properly.
Even your answer to his direct follow-up question: “Do you think 30% is too low or too high for July 2033?” was hard to parse. You did not say something simple and easily understandable like, “I think 30% is too high for these reasons: …” you say “Once criticality is achieved the odds drop to 0 [+ more words].” The odds of what drop to zero? The odds of TAI? But you seem to be saying that once criticality is reached, TAI is inevitable? Even the rest of your long answer leaves in doubt where you’re really coming down on the premise.
By the way, I don’t think I would even be making this comment myself if A) I didn’t have such a hard time trying to understand what your conclusions were myself and B) you didn’t have such a confident, authoritative tone that seemed to present your ideas as if they were patently obvious.

awg 26 Jul 2023 20:39 UTC
2 points
0
in reply to: Lord Dreadwar’s comment on: The UAP Disclosure Act of 2023 and its implications
Well summarized.

awg 26 Jul 2023 18:06 UTC
2 points
1
in reply to: Lord Dreadwar’s comment on: The UAP Disclosure Act of 2023 and its implications
I would be interested to know if that’s true and they are updating on that information or if they’re going “But Grusch didn’t reveal any of that classified information TO ME, John Q. Public. So it’s not even worth thinking about at all!”

awg 24 Jul 2023 22:22 UTC
7 points
5
in reply to: Lord Dreadwar’s comment on: The UAP Disclosure Act of 2023 and its implications
Would love to hear from the people who voted to disagree with you as to why they voted that way/what they specifically disagree with here.
Edit: 2 days later and no one wants to speak up? Seriously? Seems like some evidence for Lord Dreadwar’s points #1 and #2 above.

awg 23 Jul 2023 17:15 UTC
2 points
1
in reply to: tintintintin’s comment on: The UAP Disclosure Act of 2023 and its implications
I think the silence from major news outlets could be explained for the same reason that there has been silence from the vast majority of the LessWrong community: stigmatization and the fear of looking like crackpots.

awg 23 Jul 2023 17:14 UTC
1 point
0
in reply to: Mitchell_Porter’s comment on: The UAP Disclosure Act of 2023 and its implications
This is very, very poor reasoning. If your position is that an unexplained phenomena + conspiracy are too wild, why would you use a different, far-less-supported unexplained phenomena + conspiracy to dismiss it?

awg 21 Jul 2023 21:54 UTC
6 points
2
in reply to: Eliezer Yudkowsky’s comment on: UFO Betting: Put Up or Shut Up
How does all of the recent official activity fit into your worldview here? Do you have your own speculations/explanations for why, e.g., Chuck Schumer would propose such specifically-worded legislation on this topic? Does that stuff just not factor into your worldview at all (or perhaps is weighted next to nothing against your own tweeted-about intuitions)?

awg 21 Jul 2023 21:49 UTC
6 points
3
on: The UAP Disclosure Act of 2023 and its implications
My sense is that discussion of this incredibly stigmatized topic will not proliferate on LW until there is some “real evidence” (whatever that ends up being) released to discuss. Which is kind of a shame, since I totally agree with you that there is seemingly far too much official activity swirling around this topic for there to be no “there” there, regardless of what “there” is.

awg 21 Jul 2023 21:39 UTC
4 points
1
in reply to: GonM’s comment on: The UAP Disclosure Act of 2023 and its implications
There’s been one high-profile betting thread on this: https://www.lesswrong.com/posts/t5W87hQF5gKyTofQB/ufo-betting-put-up-or-shut-up

awg 8 Jul 2023 15:48 UTC
1 point
0
in reply to: Carl Feynman’s comment on: Why it’s so hard to talk about Consciousness
When you see the color red, what is that like? When you run your hand over something rough and bumpy, what is that like? When you taste salt, what is that like?

awg 5 Jul 2023 17:49 UTC
1 point
0
on: Why it’s so hard to talk about Consciousness
I’m wondering where Biological Naturalism^[1] falls within these two camps? It seems like sort of a “third way” in between them, and incidentally, is the explanation that I personally have found most compelling.
Here’s GPT-4′s summary:
Biological Naturalism is a theory of mind proposed by philosopher John Searle. It is a middle ground between two dominant but opposing views of the mind: materialism and dualism. Materialism suggests that the mind is completely reducible to physical processes in the brain, while dualism posits that the mind and body are distinct and separate.
Searle’s Biological Naturalism, on the other hand, asserts that while mental processes are caused by physical processes in the brain, they are not reducible to them. This means that while consciousness and other mental phenomena are rooted in the physical workings of the brain, they also have their own first-person ontology that is not captured by third-person descriptions of the brain’s workings.
Searle uses the analogy of water and H2O to explain this concept. Just as water is composed of H2O molecules but has properties (like wetness) that are not properties of individual H2O molecules, consciousness is caused by physical processes in the brain but has properties (like subjectivity) that are not properties of individual neurons or neural networks.
In other words, Biological Naturalism acknowledges the physical basis of consciousness while also recognizing that consciousness has a subjective character that is not explained by purely physical descriptions. This theory allows for the study of the mind as part of the natural biological sciences, while also acknowledging the unique properties of mental phenomena.
Setting aside how problematic of an individual Searle is, this theory has always struck me as the most cogent and has stood up to the test of time in my own ontology.
Taking it a step further into my own theorizing: I suspect consciousness is a natural feature of all systems and exists on a spectrum from very-low-consciousness systems (individual atoms, stars, clouds of gas, rocks) to very-high-consciousness systems (animals). My pet theory is that we will one day find out that everything is conscious and it’s just a matter of “how much.” Hmm, maybe this indicates I’m a Camp #2 person? I’m finding it hard to classify myself. Maybe someone else will find it easier.
1. ^
  Despite its name, I don’t think there’s anything in the theory that says consciousness has to arise from biological components per se, just that consciousness is a natural byproduct of at least some information processing systems, most notably the biological ones that exists in our skulls.

awg

Bro­ken Bench­mark: MMLU

Broken Benchmark: MMLU