TagLast edit: 4 Apr 2022 13:20 UTC by Lucius Bushnaq

Modularity is the extent to which a system can be divided into clusters. It is a very broad concept which can be applied across many different domains, for example:

In graph theory, modularity can be measured in terms of a graph’s structure. For instance, there is a common mathematical definition for graphs, which is based on the idea of modules as partitions of the nodes of a graph, with more edges within modules than would be expected by chance.

In evolutionary biology, modularity has been observed at many different levels, from protein structure to organ systems. There is currently no universally accepted explanation for why modularity seems to have been produced by evolution, and less so by genetic algorithms, although there are widely-held theories (most notably the idea of modularly varying goals, as proposed by Kashtan & Alon).

Modularity may be highly relevant for alignment research, because the more modular a system is, the greater the chances that we will be able to understand the cognition it is performing in terms of high-level abstractions.

LLM Mo­du­lar­ity: The Separa­bil­ity of Ca­pa­bil­ities in Large Lan­guage Models

NickyP26 Mar 2023 21:57 UTC
98 points
3 comments41 min readLW link

Iden­ti­fi­ca­tion of Nat­u­ral Modularity

Stephen Fowler25 Jun 2022 15:05 UTC
15 points
3 comments7 min readLW link

The­o­ries of Mo­du­lar­ity in the Biolog­i­cal Literature

4 Apr 2022 12:48 UTC
51 points
13 comments7 min readLW link

What Is The True Name of Mo­du­lar­ity?

1 Jul 2022 14:55 UTC
38 points
10 comments12 min readLW link

Evolu­tion of Modularity

johnswentworth14 Nov 2019 6:49 UTC
174 points
12 comments2 min readLW link1 review

Emer­gent mod­u­lar­ity and safety

Richard_Ngo21 Oct 2021 1:54 UTC
31 points
15 comments3 min readLW link

Mo­du­lar­ity, sig­nal­ing, and be­lief in belief

Kaj_Sotala13 Nov 2011 11:54 UTC
29 points
14 comments5 min readLW link

Mo­du­lar­ity and Buzzy

Kaj_Sotala4 Aug 2011 11:35 UTC
33 points
27 comments9 min readLW link

The econ­omy as an anal­ogy for ad­vanced AI systems

15 Nov 2022 11:16 UTC
28 points
0 comments5 min readLW link

In­ter­nal In­ter­faces Are a High-Pri­or­ity In­ter­pretabil­ity Target

Thane Ruthenis29 Dec 2022 17:49 UTC
26 points
6 comments7 min readLW link

Idea: Net­work mod­u­lar­ity and in­ter­pretabil­ity by sex­ual reproduction

qbolec12 Feb 2023 23:06 UTC
3 points
3 comments1 min readLW link

EIS X: Con­tinual Learn­ing, Mo­du­lar­ity, Com­pres­sion, and Biolog­i­cal Brains

scasper21 Feb 2023 16:59 UTC
14 points
4 comments3 min readLW link

Pro­ject In­tro: Selec­tion The­o­rems for Modularity

4 Apr 2022 12:59 UTC
71 points
20 comments16 min readLW link

Ten ex­per­i­ments in mod­u­lar­ity, which we’d like you to run!

16 Jun 2022 9:17 UTC
62 points
3 comments9 min readLW link

Selec­tion pro­cesses for subagents

Ryan Kidd30 Jun 2022 23:57 UTC
36 points
2 comments9 min readLW link

Statis­tics for vague con­cepts and “Colors” of places

Q Home19 Aug 2022 10:33 UTC
−1 points
2 comments8 min readLW link

AISC Pro­ject: Model­ling Tra­jec­to­ries of Lan­guage Models

NickyP13 Nov 2023 14:33 UTC
26 points
0 comments12 min readLW link

Basin broad­ness de­pends on the size and num­ber of or­thog­o­nal features

27 Aug 2022 17:29 UTC
36 points
21 comments6 min readLW link

Search­ing for Mo­du­lar­ity in Large Lan­guage Models

8 Sep 2022 2:25 UTC
44 points
3 comments14 min readLW link
No comments.