Another approach to determine to what extent automatic methods agree among themselves on the number of assigned domains is to look at agreement among all automatic methods – i.e. automatic consensus. The automatic methods agreed completely on 168 out of all 315 chains analyzed, or 53.3% of chains. . A large proportion of these chains are single-domain chains - out of 107 single domain chains 95 (88.8%) show complete agreement among automatic methods, or 88.8% of chains, however, agreement among automatic methods drops rapidly as the number of domains increases (out of 8 4-domain chains only 1 had complete agreement, while for 5-domain or 6-domain chains there was no agreement among automatic methods).
Most chains that are cut correctly by all methods have clearly identifiable globular domains. Chains that are difficult for all methods are those that consist of several domains that are often small and compact, or alternatively represent very large sprawling structures. These situations are usually more difficult for methods because parameters such as connectivity, globularity, preservation of beta-sheet structures and other characteristics used by methods are more difficult to capture (see "Algorithm description" in Methods section).
| Number of domains per chain |
Number of chains for which there is consensus among automatic methods |
Total chains |
Percent of chains for which there is consensus among automatic methods |
| 1 |
95 |
107 |
88.8% |
| 2 |
55 |
138 |
39.9% |
| 3 |
17 |
54 |
31.5% |
| 4 |
1 |
8 |
12.5% |
Consensus among different algorithmic methods. The criterion is the number of assigned domains for a given chain. The evaluation is performed using Balanced_Domain_Benchmark_2