{"id":19235,"date":"2024-01-23T14:45:10","date_gmt":"2024-01-23T14:45:10","guid":{"rendered":"https:\/\/www.michaeldempsey.me\/blog\/?p=19235"},"modified":"2024-01-23T14:45:13","modified_gmt":"2024-01-23T14:45:13","slug":"collective-intelligence-multi-agent-debate-agi","status":"publish","type":"post","link":"https:\/\/www.michaeldempsey.me\/blog\/2024\/01\/23\/collective-intelligence-multi-agent-debate-agi\/","title":{"rendered":"Collective Intelligence, Multi-Agent Debate, &#038; AGI"},"content":{"rendered":"\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p class=\"wp-block-paragraph\">What magical trick makes us intelligent? The trick is that there is no trick. The power of intelligence stems from our vast diversity, not from any single, perfect principle.<\/p>\n<cite>Marvin Minsky<\/cite><\/blockquote>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>The Frontiers of Increasing AI Performance<\/strong><\/h2>\n\n\n\n<p class=\"has-drop-cap wp-block-paragraph\">There has been a lot of work done on pushing the performance of machine learning with the structure of transformers + scaling in the past few years. Alongside this, AI has continued to progress performance with things like more advanced prompt engineering, chain of thought, expanded context windows, data-calling pipelines like RAG, mixture of experts models, and most recently <a href=\"https:\/\/huggingface.co\/blog\/mlabonne\/merge-models\">merged models<\/a> (Frankenmerges being my favorite naming convention).<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Alongside the consensus of Transformer-driven approaches, small parts of the AI world have turned to look at novel architectures like those used by <a href=\"https:\/\/arxiv.org\/abs\/2302.10866\">HYENA<\/a>, <a href=\"https:\/\/arxiv.org\/abs\/2305.13048\">RWKV<\/a>, <a href=\"https:\/\/arxiv.org\/abs\/2312.00752\">Mamba<\/a>, and more that aim to solve many of the difficulties with pure play Transfomer architecture.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">All of these are an attempt to have better, faster, and larger scopes of knowledge and\/or \u201cmore correct\u201d knowledge, alongside more efficiency. Despite the improvements, it is debatable if we have seen creativity <em>really<\/em> emerge and there have been few examples of highly novel insights generated using LLMs.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Put simply, AI is great at getting to binarily correct answers quickly, but it\u2019s not clear it has a unique performance edge to humans in creatively minded and\/or non-deterministic problems.<\/p>\n\n\n\n<figure class=\"wp-block-embed aligncenter is-type-rich is-provider-twitter wp-block-embed-twitter\"><div class=\"wp-block-embed__wrapper\">\n<blockquote class=\"twitter-tweet\" data-width=\"550\" data-dnt=\"true\"><p lang=\"en\" dir=\"ltr\">Love when non technical people discovers that virtually all human knowledge are compressed into a 2gb file <a href=\"https:\/\/t.co\/rilimI8FzV\">pic.twitter.com\/rilimI8FzV<\/a><\/p>&mdash; Brandon G. Neri (@nerijs) <a href=\"https:\/\/twitter.com\/nerijs\/status\/1713286086078652858?ref_src=twsrc%5Etfw\">October 14, 2023<\/a><\/blockquote><script async src=\"https:\/\/platform.twitter.com\/widgets.js\" charset=\"utf-8\"><\/script>\n<\/div><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/arxiv.org\/pdf\/2305.19118.pdf\">Researchers in MAD<\/a> have even noticed that regardless of the pushing from a user, <em>\u201cOnce the LLM has established confidence in its answers, it is unable to generate novel thoughts later through self reflection even if the initial stance is incorrect.\u201d<\/em> They call this Degeneration of Thought.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Like many people over the long history of AI, I am left wondering if the solution for unlocking creativity and increasing performance can come from a more &#8220;biological&#8221; approach. <strong>Will true AGI come not from distilling all of human knowledge down to a series of weights, but from observing the debate and conversation amongst brilliant entities?<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Enter Collective Intelligence (CI) and Multi-Agent Debate (MAD).<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Collective Intelligence: The Core Premise and its Evolution<\/h2>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p class=\"wp-block-paragraph\">Often, decisions made by an individual may lack the precision seen in decisions formed by the majority. Collective intelligence is a kind of shared or group intelligence, a process where the opinions of many are consolidated into decisions. It arises from the collaboration and competition amongst various entities. This intelligence manifests in bacteria, animals, humans, and computer networks, appearing in various consensus-based decision-making patterns&#8230;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8230;By harnessing communication and evolution within an agent society,<br>it becomes possible to simulate the evolution observed in biological societies, conduct sociological experiments, and gain insights that can potentially advance human society.<\/p>\n<cite><a href=\"https:\/\/arxiv.org\/pdf\/2309.07864.pdf\">The Rise and Potential of Large Language Model<br>Based Agents: A Survey<\/a><\/cite><\/blockquote>\n\n\n\n<figure class=\"wp-block-image alignwide size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"624\" height=\"506\" src=\"https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/CImap.png\" alt=\"\" class=\"wp-image-19251\" srcset=\"https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/CImap.png 624w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/CImap-300x243.png 300w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/CImap-580x470.png 580w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/CImap-320x259.png 320w\" sizes=\"auto, (max-width: 624px) 100vw, 624px\" \/><figcaption class=\"wp-element-caption\">The perfect naming conventions around these concepts are gray areas at best. Via <a href=\"https:\/\/arxiv.org\/pdf\/2304.05147.pdf\">Artificial Collective Intelligence Engineering: a Survey<\/a><\/figcaption><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">There are many ways in which the AI community describes collective intelligence, all filled with various naming conventions and nuances. <strong>We view Collective Intelligence as the broader study of a variety of opinions being consolidated into a decision, while Multi-Agent Debate is a mechanism that serves LLMs well to engage in this.<\/strong> <sup id=\"mfn-content-000000000000083e0000000000000000_19235-1\" class=\"modern-footnotes-footnote \" data-mfn=\"1\" data-mfn-post-scope=\"000000000000083e0000000000000000_19235\"><a href=\"javascript:void(0)\"  role=\"button\" aria-pressed=\"false\" aria-describedby=\"mfn-content-000000000000083e0000000000000000_19235-1\">1<\/a><\/sup><span role=\"tooltip\" class=\"modern-footnotes-footnote__note\" tabindex=\"0\" data-mfn=\"1\">MAD dates back to the 1980s, with <a href=\"https:\/\/www.cs.ox.ac.uk\/people\/michael.wooldridge\/pubs\/imas\/IMAS2e.html\">this book by Michael Woolridge<\/a> from 2002\/9 being a great moment in time look at the promises of the concept. It definitely is, 100% not not available on LibGen if you&#8217;re interested in reading it.<\/span><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">We believe these all surround the premise of using a variety of entities which are embodied with specific principles, data, viewpoints, etc. in order to come to a nuanced answer or collection of insights. These agents are typically managed by an AI Orchestrator of sorts, which is tasked with a higher level set of goals\/criteria to accomplish and acts to advance the discussion.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">I originally started experimenting with MAD through more sophisticated prompts enabled by frontier LLMs expanding larger context windows. The first example was using a prompt structure called HIVE (Highly Intelligent Virtual Entities), which you can see the results of in the example below if you expand the text.<\/p>\n\n\n\n<p class=\"has-text-align-justify has-typology-bg-color has-typology-acc-background-color has-text-color has-background has-link-color wp-elements-1 wp-block-paragraph\"><em><strong><span class=\"collapseomatic \" id=\"id6ae1784c2f31d\"  tabindex=\"0\" title=\"Expand here for HIVE Prompt Example\"    >Expand here for HIVE Prompt Example<\/span><div id=\"target-id6ae1784c2f31d\" class=\"collapseomatic_content \"><br><\/strong>*HIVE PROMPT*<br>Context: I&#8217;d like to start a company that uses AI to analyze audio for early detection of diseases. I want it to be big enough to generate at least $250M of revenue per year after 7 years. I&#8217;d like to know what products i should start with, what research papers supports being able to create those products, and who my first 5 customers should be. I&#8217;d also like to know how much to charge them and why.<br><br>Result:Initiating the HIVE MIND session with 5 Virtual Entities to solve the problem: <br><br>Evelyn: AI Technology Specialist (Personality traits: Innovative, Analytical, Direct)<br>Marcus: Healthcare Industry Expert (Personality traits: Experienced, Frank, Strategic)<br>Leon: Financial Analyst (Personality traits: Meticulous, Realist, Blunt)<br>Sophia: Legal and Compliance Advisor (Personality traits: Thorough, Ethical, Pragmatic)<br>Nina: Consumer Behavior Analyst (Personality traits: Insightful, Creative, Honest)<br><br>Evelyn: We\u2019re looking at integrating AI in audio analysis for early disease detection. This is cutting-edge, but let\u2019s not forget the importance of a robust AI model. I suggest we start by identifying diseases that have distinct audible markers. Research papers have shown potential in detecting respiratory diseases from cough sounds. Let\u2019s focus on this.<br><br>Marcus: Agreed, Evelyn. Respiratory diseases are a good start. However, the healthcare sector is heavily regulated. We need to ensure that our product aligns with medical standards and has the necessary certifications. Partnerships with medical institutions for clinical trials could be pivotal.<br><br>Leon: From a financial perspective, we must consider the development costs against our seven-year, $250M revenue goal. Investing in solid R&amp;D is crucial, but we need a clear path to profitability. We should consider a subscription-based model for continuous revenue flow.<br><br>Sophia: While you&#8217;re all focusing on the product and finances, don\u2019t underestimate regulatory hurdles. We need to navigate FDA approvals and data privacy laws, especially HIPAA in the US. It\u2019s not just about creating a product but ensuring it\u2019s legally compliant.<br><br>Nina: Understanding our customers is key. We should target healthcare providers who are early adopters of technology. They\u2019ll be more open to integrating our solution into their practice. As for pricing, it should reflect the value we provide in improving diagnostic accuracy and saving time, but we must also consider what the market can bear.<br><br>(PAUSE)<br><br>How would you like the Virtual Entities to proceed?<br><br>Continue<br>Summary<br>Devils Advocacy<br>Ask the User Questions<br>Or provide your own input to continue the conversation<\/em><br><br><em>*END EXAMPLE* (a user would continue to push the conversation further here)<br><mark style=\"background-color:#ffffff\" class=\"has-inline-color has-typology-acc-color\"><\/div><\/mark><\/em><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The core premise of HIVE is that you have a hive mind of 5 entities that can discuss and debate a given task with prompts built in to continue to further the conversation via user input. Each entity is given a first name, a background, and a number of personality traits that either the user programs or the LLM will automatically create based off of the given task. It works decently well at encouraging and simulating what I would deem predictable but at times intriguing debate.<\/p>\n\n\n\n<figure class=\"wp-block-image alignwide size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"978\" height=\"640\" src=\"https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/agentgpt.png\" alt=\"\" class=\"wp-image-19241\" srcset=\"https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/agentgpt.png 978w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/agentgpt-300x196.png 300w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/agentgpt-768x503.png 768w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/agentgpt-770x504.png 770w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/agentgpt-580x380.png 580w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/agentgpt-320x209.png 320w\" sizes=\"auto, (max-width: 978px) 100vw, 978px\" \/><figcaption class=\"wp-element-caption\"><a href=\"https:\/\/arxiv.org\/abs\/2308.11432\">A Survey on Large Language Model based Autonomous Agents<\/a><\/figcaption><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">As we moved away from simple prompting, we began to see an explosion of more advanced LLM-based autonomous agents across a variety of agent types armed with various types of infrastructure.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">An Explosion of Research and Use-Cases in 2023<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">As many started to notice the power of MAD, new technical implementations of the concept began to accelerate. Perhaps the most notable has been <a href=\"https:\/\/microsoft.github.io\/autogen\/\">AutoGen<\/a> from Microsoft, as well as <a href=\"https:\/\/github.com\/joaomdmoura\/crewAI\">CrewAI<\/a>, both of which aim to provide core infrastructure to enable multi-agent debate. We\u2019ve also seen adjacent projects such as <a href=\"https:\/\/github.com\/cpacker\/MemGPT\">MemGPT<\/a> or <a href=\"https:\/\/www.socialagi.dev\/\">SocialAGI<\/a>, which create self-updating models for the user with \u201cinfinite\u201d context, as well as <a href=\"https:\/\/arxiv.org\/abs\/2401.02777\">RAISE<\/a> which uses a modular scratchpad approach for adjusting agents. <\/p>\n\n\n\n<figure class=\"wp-block-image alignwide size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"693\" height=\"426\" src=\"https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/generativeagents.png\" alt=\"\" class=\"wp-image-19242\" srcset=\"https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/generativeagents.png 693w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/generativeagents-300x184.png 300w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/generativeagents-580x357.png 580w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/generativeagents-320x197.png 320w\" sizes=\"auto, (max-width: 693px) 100vw, 693px\" \/><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">A large portion of this got on my radar due to <a href=\"https:\/\/arxiv.org\/pdf\/2304.03442.pdf\">Generative Agents: Interactive Simulacra of Human Behavior<\/a> which created a sandbox environment where agents autonomously took actions, remembered and reflected on them, and then stored the insights as memories.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">People were quick to fork the repo, leading to various experiments and boundaries being pushed to understand just how much we could learn from these agents collaborating and living in this world. That said, despite it being incredibly fun, the environment was a bit too open to drive meaningful results for now.<sup id=\"mfn-content-000000000000083e0000000000000000_19235-2\" class=\"modern-footnotes-footnote \" data-mfn=\"2\" data-mfn-post-scope=\"000000000000083e0000000000000000_19235\"><a href=\"javascript:void(0)\"  role=\"button\" aria-pressed=\"false\" aria-describedby=\"mfn-content-000000000000083e0000000000000000_19235-2\">2<\/a><\/sup><span role=\"tooltip\" class=\"modern-footnotes-footnote__note\" tabindex=\"0\" data-mfn=\"2\">I recommend <a href=\"https:\/\/github.com\/rlancemartin\/generative_agents\">forking this<\/a> and running a local LLM to minimize costs. It\u2019s a fun experiment.<\/span><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">A variety of papers built upon this idea (and many others of biological intelligence) to build out more focused use-cases to Collective Intelligence and MAD systems.<\/p>\n\n\n\n<figure class=\"wp-block-image alignwide size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"511\" height=\"339\" src=\"https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/tradingpt.png\" alt=\"\" class=\"wp-image-19243\" srcset=\"https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/tradingpt.png 511w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/tradingpt-300x199.png 300w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/tradingpt-320x212.png 320w\" sizes=\"auto, (max-width: 511px) 100vw, 511px\" \/><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/arxiv.org\/pdf\/2309.03736.pdf\">TradingGPT<\/a> effectively simulated a hedge fund by orchestrating distinct characters using layered memory in agents and debate to build trading strategies and make investment decisions.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Their abstract describes this framework:<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><em>The efficacy of GPTs lies in their ability to decode human instructions, achieved through comprehensively processing historical inputs as an entirety within their memory system. Yet, the memory processing of GPTs does not precisely emulate the hierarchical nature of human memory, which is categorized into long, medium, and short-term layers. This can result in LLMs struggling to prioritize immediate and critical tasks efficiently. To bridge this gap, we introduce an innovative LLM multi-agent framework endowed with layered memories.<\/em><\/p>\n\n\n\n<figure class=\"wp-block-image alignwide size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"785\" src=\"https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/chemgpt-1024x785.png\" alt=\"\" class=\"wp-image-19244\" srcset=\"https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/chemgpt-1024x785.png 1024w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/chemgpt-300x230.png 300w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/chemgpt-768x589.png 768w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/chemgpt-1536x1177.png 1536w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/chemgpt-770x590.png 770w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/chemgpt-580x444.png 580w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/chemgpt-320x245.png 320w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/chemgpt.png 1720w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\"><a href=\"https:\/\/pubs.acs.org\/doi\/suppl\/10.1021\/acscentsci.3c01087\/suppl_file\/oc3c01087_si_001.pdf\">ChatGPT Research Group for Optimizing the Crystallinity of MOFs and COFs<\/a><\/figcaption><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">Through 2023, more research emerged ranging from simplistic\/dressed up CoT prompting mechanisms to advanced retrieval dynamics to novel memory architectures, and much more. These use-cases include <a href=\"https:\/\/arxiv.org\/pdf\/2311.11591.pdf\">Design<\/a>, <a href=\"https:\/\/arxiv.org\/pdf\/2312.16534.pdf\">Education<\/a>, <a href=\"https:\/\/arxiv.org\/pdf\/2311.10537.pdf\">Medicine<\/a>, <a href=\"https:\/\/pubs.acs.org\/doi\/suppl\/10.1021\/acscentsci.3c01087\/suppl_file\/oc3c01087_si_001.pdf\">Chemistry<\/a> labwork, <a href=\"https:\/\/arxiv.org\/pdf\/2312.15198.pdf\">Social Science Research<\/a>, <a href=\"https:\/\/arxiv.org\/pdf\/2401.04259.pdf\">Scientific Paper Review<\/a>, and even <a href=\"https:\/\/github.com\/agiresearch\/WarAgent\">World Wars<\/a>, among many others.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">For further exploration I highly recommend survey papers including <a href=\"https:\/\/arxiv.org\/pdf\/2308.11432.pdf\">this one from September 2023<\/a>, <a href=\"https:\/\/arxiv.org\/pdf\/2309.07864.pdf\">this other one from September 2023<\/a>, and <a href=\"https:\/\/arxiv.org\/pdf\/2401.03428.pdf\">this one from January 2024<\/a>.<sup id=\"mfn-content-000000000000083e0000000000000000_19235-3\" class=\"modern-footnotes-footnote \" data-mfn=\"3\" data-mfn-post-scope=\"000000000000083e0000000000000000_19235\"><a href=\"javascript:void(0)\"  role=\"button\" aria-pressed=\"false\" aria-describedby=\"mfn-content-000000000000083e0000000000000000_19235-3\">3<\/a><\/sup><span role=\"tooltip\" class=\"modern-footnotes-footnote__note\" tabindex=\"0\" data-mfn=\"3\">I\u2019m sure there are others but this is like 300 papers to read so\u2026enjoy<\/span><\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"415\" height=\"337\" src=\"https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/MADperformance.png\" alt=\"\" class=\"wp-image-19245\" style=\"width:484px;height:auto\" srcset=\"https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/MADperformance.png 415w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/MADperformance-300x244.png 300w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/MADperformance-320x260.png 320w\" sizes=\"auto, (max-width: 415px) 100vw, 415px\" \/><figcaption class=\"wp-element-caption\">Performance increases of traditional LLMs when using Multi-Agent Debate via <a href=\"https:\/\/arxiv.org\/pdf\/2305.19118.pdf\">Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debate<\/a><\/figcaption><\/figure>\n<\/div>\n\n\n<p class=\"wp-block-paragraph\">The main underpinning across all of these is that they were able to increase performance either on a relative basis to the model<sup id=\"mfn-content-000000000000083e0000000000000000_19235-4\" class=\"modern-footnotes-footnote \" data-mfn=\"4\" data-mfn-post-scope=\"000000000000083e0000000000000000_19235\"><a href=\"javascript:void(0)\"  role=\"button\" aria-pressed=\"false\" aria-describedby=\"mfn-content-000000000000083e0000000000000000_19235-4\">4<\/a><\/sup><span role=\"tooltip\" class=\"modern-footnotes-footnote__note\" tabindex=\"0\" data-mfn=\"4\">While not purely multi-agent debate, <a href=\"https:\/\/arxiv.org\/pdf\/2401.05268.pdf\">AutoACT<\/a> for example used a division of labor strategy to get LLaMa-2-13b to perform close to ChatGPT 3.5-Turbo<\/span> or an absolute basis. In addition, they allow humans and models to reflect upon outputs from LLMs in a more thoughtful way due to the debate modality instead of the prompt -&gt; answer modality.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">A note on Compute Constraints<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">A perpetual question that comes up in discussing CI is how much compute will be required to push the frontier. My view is we can look towards frontier models broadly, which are grappling with similar trade off questions on a weekly basis.<sup id=\"mfn-content-000000000000083e0000000000000000_19235-5\" class=\"modern-footnotes-footnote \" data-mfn=\"5\" data-mfn-post-scope=\"000000000000083e0000000000000000_19235\"><a href=\"javascript:void(0)\"  role=\"button\" aria-pressed=\"false\" aria-describedby=\"mfn-content-000000000000083e0000000000000000_19235-5\">5<\/a><\/sup><span role=\"tooltip\" class=\"modern-footnotes-footnote__note\" tabindex=\"0\" data-mfn=\"5\">Yes OAI, Anthropic, and META are going to throw waves of H100s and data at frontier models, but at the same time Microsoft is pushing on models like <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/blog\/phi-2-the-surprising-power-of-small-language-models\/\">Phi<\/a> and others. We are lucky that we get massive R&amp;D spend on both sides with some nice OSS contributions on smaller models<\/span>.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">MoE models and merged model architectures represent significant strides in this direction.<sup id=\"mfn-content-000000000000083e0000000000000000_19235-6\" class=\"modern-footnotes-footnote \" data-mfn=\"6\" data-mfn-post-scope=\"000000000000083e0000000000000000_19235\"><a href=\"javascript:void(0)\"  role=\"button\" aria-pressed=\"false\" aria-describedby=\"mfn-content-000000000000083e0000000000000000_19235-6\">6<\/a><\/sup><span role=\"tooltip\" class=\"modern-footnotes-footnote__note\" tabindex=\"0\" data-mfn=\"6\">MoE models, by activating only the relevant &#8216;experts&#8217; for specific tasks, sidestep the computational exorbitance of monolithic models. Similarly, merged models optimize performance by intelligently amalgamating neural pathways.<\/span> Both of these architectural innovations perhaps point to the idea that achieving breakthrough performance is as much about strategic structural innovation as it is about raw computational power, ensuring every computational unit is maximized. And if we believe that, it\u2019s not clear to me that we won\u2019t have similar structural experiments with single MoE models optimized for debate all the way to using multiple models at once (and properly syncing the learning of them) to do MAD.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">The Progression of Collective Intelligence<\/h2>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p class=\"wp-block-paragraph\"><strong>Cambridge Student:<\/strong>\u00a0&#8220;To get to AGI, can we just keep min maxing language models, or is there another breakthrough that we haven&#8217;t really found yet to get to AGI?&#8221;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Sam Altman:<\/strong>\u00a0&#8220;We need another breakthrough. We can still push on large language models quite a lot, and we will do that. We can take the hill that we&#8217;re on and keep climbing it, and the peak of that is still pretty far away. But, within reason, I don&#8217;t think that doing that will (get us to) AGI. If (for example) super intelligence can&#8217;t discover novel physics I don&#8217;t think it&#8217;s a superintelligence. And teaching it to clone the behavior of humans and human text &#8211; I don&#8217;t think that&#8217;s going to get there.And so there&#8217;s this question which has been debated in the field for a long time: what do we have to do in addition to a language model to make a system that can go discover new physics?&#8221;<\/p>\n<cite><a href=\"https:\/\/www.youtube.com\/watch?v=NjpNG0CJRMM\">Sam Altman &amp; OpenAI | 2023 Hawking Fellow | Cambridge Union<\/a><\/cite><\/blockquote>\n\n\n\n<p class=\"wp-block-paragraph\">As we continue to progress in AI, there are both societal and technologically important impacts Collective Intelligence and MAD may have.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>The Selection of agents for debate<\/strong><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">We as individuals might train agents to represent our own interests with both private and external data to make <em>or<\/em> simulate decisions on our behalf. This may be viewed as a clone of ourselves, or it may be viewed as our copilot, chief of staff, or assistant, depending on how we orchestrate and feed it data and context.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">We also will use external-only facing agents like those made by <a href=\"https:\/\/www.delphi.ai\/\">Delphi<\/a>. This will lead to more sophisticated <em>merged<\/em> agents of various entities that can then be related within a given persona. This is in some ways a subset of \u201ctraditional\u201d collective intelligence where the cumulative intelligence of given domain experts create a master entity to engage in debate with other master entities, like having an economist (which is comprised of knowledge from many economist agents) debate a trader in public market analysis.<sup id=\"mfn-content-000000000000083e0000000000000000_19235-7\" class=\"modern-footnotes-footnote \" data-mfn=\"7\" data-mfn-post-scope=\"000000000000083e0000000000000000_19235\"><a href=\"javascript:void(0)\"  role=\"button\" aria-pressed=\"false\" aria-describedby=\"mfn-content-000000000000083e0000000000000000_19235-7\">7<\/a><\/sup><span role=\"tooltip\" class=\"modern-footnotes-footnote__note\" tabindex=\"0\" data-mfn=\"7\">This psychologically is also interesting because it gets at the idea that \u201cexperts\u201d perhaps are not ideal for debating complex and uncertain topics. Maybe our blind spots are what enable us to be optimistic or think creatively?<\/span><\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>The role of humans<\/strong><\/h3>\n\n\n\n<div class=\"wp-block-jetpack-slideshow alignwide is-style-rectangular\" data-effect=\"slide\"><div class=\"wp-block-jetpack-slideshow_container swiper-container\"><ul class=\"wp-block-jetpack-slideshow_swiper-wrapper swiper-wrapper\"><li class=\"wp-block-jetpack-slideshow_slide swiper-slide\"><figure><img loading=\"lazy\" decoding=\"async\" width=\"503\" height=\"291\" alt=\"\" class=\"wp-block-jetpack-slideshow_image wp-image-19258\" data-id=\"19258\" src=\"https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/Screenshot-2024-01-22-at-3.47.02-PM.png\" srcset=\"https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/Screenshot-2024-01-22-at-3.47.02-PM.png 503w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/Screenshot-2024-01-22-at-3.47.02-PM-300x174.png 300w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/Screenshot-2024-01-22-at-3.47.02-PM-320x185.png 320w\" sizes=\"(max-width: 503px) 100vw, 503px\" \/><\/figure><\/li><li class=\"wp-block-jetpack-slideshow_slide swiper-slide\"><figure><img loading=\"lazy\" decoding=\"async\" width=\"504\" height=\"238\" alt=\"\" class=\"wp-block-jetpack-slideshow_image wp-image-19256\" data-id=\"19256\" src=\"https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/Screenshot-2024-01-22-at-3.46.10-PM.png\" srcset=\"https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/Screenshot-2024-01-22-at-3.46.10-PM.png 504w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/Screenshot-2024-01-22-at-3.46.10-PM-300x142.png 300w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/Screenshot-2024-01-22-at-3.46.10-PM-320x151.png 320w\" sizes=\"(max-width: 504px) 100vw, 504px\" \/><\/figure><\/li><li class=\"wp-block-jetpack-slideshow_slide swiper-slide\"><figure><img loading=\"lazy\" decoding=\"async\" width=\"476\" height=\"236\" alt=\"\" class=\"wp-block-jetpack-slideshow_image wp-image-19255\" data-id=\"19255\" src=\"https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/Screenshot-2024-01-22-at-3.46.23-PM.png\" srcset=\"https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/Screenshot-2024-01-22-at-3.46.23-PM.png 476w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/Screenshot-2024-01-22-at-3.46.23-PM-300x149.png 300w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/Screenshot-2024-01-22-at-3.46.23-PM-320x159.png 320w\" sizes=\"(max-width: 476px) 100vw, 476px\" \/><\/figure><\/li><li class=\"wp-block-jetpack-slideshow_slide swiper-slide\"><figure><img loading=\"lazy\" decoding=\"async\" width=\"491\" height=\"261\" alt=\"\" class=\"wp-block-jetpack-slideshow_image wp-image-19257\" data-id=\"19257\" src=\"https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/Screenshot-2024-01-22-at-3.46.42-PM.png\" srcset=\"https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/Screenshot-2024-01-22-at-3.46.42-PM.png 491w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/Screenshot-2024-01-22-at-3.46.42-PM-300x159.png 300w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/Screenshot-2024-01-22-at-3.46.42-PM-320x170.png 320w\" sizes=\"(max-width: 491px) 100vw, 491px\" \/><\/figure><\/li><\/ul><a class=\"wp-block-jetpack-slideshow_button-prev swiper-button-prev swiper-button-white\" role=\"button\"><\/a><a class=\"wp-block-jetpack-slideshow_button-next swiper-button-next swiper-button-white\" role=\"button\"><\/a><a aria-label=\"Pause Slideshow\" class=\"wp-block-jetpack-slideshow_button-pause\" role=\"button\"><\/a><div class=\"wp-block-jetpack-slideshow_pagination swiper-pagination swiper-pagination-white\"><\/div><\/div><\/div>\n\n\n\n<p class=\"wp-block-paragraph\">Humans may follow a progression of usefulness in tasks in a Collective Intelligence driven world until ultimately serving as data input instead of arbiters of truth.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">First, humans will play a role as the ultimate orchestrator of a given task. We experienced this already with the usage of HIVE, as it implements a human feedback mechanism to steer the debate as well as with custom instructions in ChatGPT where the model suggests further exploratory questions based on context and then the user chooses which direction to go.<sup id=\"mfn-content-000000000000083e0000000000000000_19235-8\" class=\"modern-footnotes-footnote \" data-mfn=\"8\" data-mfn-post-scope=\"000000000000083e0000000000000000_19235\"><a href=\"javascript:void(0)\"  role=\"button\" aria-pressed=\"false\" aria-describedby=\"mfn-content-000000000000083e0000000000000000_19235-8\">8<\/a><\/sup><span role=\"tooltip\" class=\"modern-footnotes-footnote__note\" tabindex=\"0\" data-mfn=\"8\">I implemented this in my <a href=\"https:\/\/chat.openai.com\/g\/g-92kVaJVL5-research-paper-analyzer\">Research Paper Reader GPT<\/a><\/span> <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">While today these suggestions are ideal ~30% of the time, we expect LLMs will become more proficient at iterating suggestions. This skillset will progress into AI orchestrators that will drive conversations at a higher % than humans in some form, before eventually advancing the vast majority of multi-agent debate towards a form of self-play.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Self-Play, Self-Reward Language Models, &amp; Synthetic Data<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Alex Irpan recently published <a href=\"https:\/\/www.alexirpan.com\/2024\/01\/10\/ai-timelines-2024.html\">one of the best posts on the state of AI<\/a> I&#8217;ve read in awhile.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">In it, he discussed the OpenAI team\u2019s continual pursuit of self-play and the immense value if done correctly to progressing intelligence:<\/p>\n\n\n\n<blockquote class=\"quoteback\" darkmode=\"\" data-title=\"My AI Timelines Have Sped Up (Again)\" data-author=\"Alex Irpan\" cite=\"https:\/\/www.alexirpan.com\/2024\/01\/10\/ai-timelines-2024.html\">\nA long time ago, when OpenAI still did RL in games \/ simulation, they were very into&nbsp;<a href=\"https:\/\/openai.com\/research\/competitive-self-play\" target=\"_blank\" rel=\"noopener\">self-play<\/a>. You run agents against copies of themselves, score their interactions, and update the models towards interactions with higher reward. Given enough time, they learn complex strategies through competition. At the time, I remember Ilya said they cared because self-play was a method to turn compute into data. You run your model, get data from your model\u2019s interactions with the environment, funnel it back in, and get an exponential improvement in your Elo curves. What was quickly clear was that this was true, but only in the narrow regime where self-play was possible. In practice that usually meant game-like environments with at most a few hundred different entities, plus a ground truth reward function that was not too easy or hard, and an easy ability to reset and run faster than real time. Without all those qualities, self-play sputtered and died with nothing to show for it besides warmer GPUs.\n<footer>Alex Irpan<cite> <a href=\"https:\/\/www.alexirpan.com\/2024\/01\/10\/ai-timelines-2024.html\">https:\/\/www.alexirpan.com\/2024\/01\/10\/ai-timelines-2024.html<\/a><\/cite><\/footer>\n<\/blockquote><script note=\"\" src=\"https:\/\/cdn.jsdelivr.net\/gh\/Blogger-Peer-Review\/quotebacks@1\/quoteback.js\"><\/script>\n\n\n\n<p class=\"wp-block-paragraph\">While self-play has canonically been built around using reinforcement learning (RL) in environments with clearer reward functions and outcomes, it&#8217;s likely similar approaches could continue to push forward MAD.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">On queue, Meta recently published<em> <a href=\"https:\/\/arxiv.org\/abs\/2401.10020\">Self-Rewarding Language Models<\/a><\/em> (SR-LMs) which enables a model to iteratively evaluate and tweak its responses based on certain criteria. Unlike traditional self-play in games, the goal here is not just to win a game but to improve the quality and relevance of text generation and understanding with a synthetic data feedback loop.<sup id=\"mfn-content-000000000000083e0000000000000000_19235-9\" class=\"modern-footnotes-footnote \" data-mfn=\"9\" data-mfn-post-scope=\"000000000000083e0000000000000000_19235\"><a href=\"javascript:void(0)\"  role=\"button\" aria-pressed=\"false\" aria-describedby=\"mfn-content-000000000000083e0000000000000000_19235-9\">9<\/a><\/sup><span role=\"tooltip\" class=\"modern-footnotes-footnote__note\" tabindex=\"0\" data-mfn=\"9\">The paper didn&#8217;t explore more than 3 iterations, so there could even be scaling laws that show more iterations improve performance even more.<\/span><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">It doesn\u2019t take much creativity to see how this could progress in both the form of individual agent generation as well as debate quality with SR-LM like models as over time, the agents involved in the debate could become more adept at constructing arguments and counterarguments, learning from previous interactions just like they learn from their self-generated text. <sup id=\"mfn-content-000000000000083e0000000000000000_19235-10\" class=\"modern-footnotes-footnote \" data-mfn=\"10\" data-mfn-post-scope=\"000000000000083e0000000000000000_19235\"><a href=\"javascript:void(0)\"  role=\"button\" aria-pressed=\"false\" aria-describedby=\"mfn-content-000000000000083e0000000000000000_19235-10\">10<\/a><\/sup><span role=\"tooltip\" class=\"modern-footnotes-footnote__note\" tabindex=\"0\" data-mfn=\"10\">There is some risk here of &#8216;reward hacking&#8217; or echo chambers, where the system might reinforce its biases or exploit loopholes in the reward mechanism in the criteria<\/span><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The mechanism of effectively dueling agents shouldn&#8217;t be new to those of us who were fascinated by Generative Adversarial Networks over the past decade. Irpan draws a similar conclusion with respect to these types of behaviors entering into language models.<\/p>\n\n\n\n<blockquote class=\"quoteback\" darkmode=\"\" data-title=\"My AI Timelines Have Sped Up (Again)\" data-author=\"Alex Irpan\" cite=\"https:\/\/www.alexirpan.com\/2024\/01\/10\/ai-timelines-2024.html\">\n<div><p>Language models in 2024 remind me of image classification in 2016, where people turned to GANs to augment their datasets. One of my first papers,&nbsp;<a href=\"https:\/\/sites.google.com\/view\/graspgan\" target=\"_blank\" rel=\"noopener\">GraspGAN<\/a>, was on the subject, and we showed it worked in the low-data regime of robotics. \u201cEvery image on the Internet\u201d is now arguably a low-data regime, which is a bit crazy to think about.<\/p><\/div>\n<footer>Alex Irpan<cite> <a href=\"https:\/\/www.alexirpan.com\/2024\/01\/10\/ai-timelines-2024.html\">https:\/\/www.alexirpan.com\/2024\/01\/10\/ai-timelines-2024.html<\/a><\/cite><\/footer>\n<\/blockquote><script note=\"\" src=\"https:\/\/cdn.jsdelivr.net\/gh\/Blogger-Peer-Review\/quotebacks@1\/quoteback.js\"><\/script>\n\n\n\n<p class=\"wp-block-paragraph\">These concepts align well with what I have been calling <a href=\"https:\/\/twitter.com\/mhdempsey\/status\/1728141900039782590\">a second revolution in synthetic data<\/a>, as we\u2019ve seen research labs like <a href=\"https:\/\/nousresearch.com\/\">Nous Research<\/a> use synthetic data to train and fine-tune a variety of models, as well as larger labs increasingly showing <a href=\"https:\/\/deepmind.google\/discover\/blog\/alphageometry-an-olympiad-level-ai-system-for-geometry\/?utm_source=twitter&amp;utm_medium=social\">very strong performance<\/a> with their own synthetic data.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Moving Forward<\/h2>\n\n\n\n<h3 class=\"wp-block-heading\">From Debate to Simulation<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">It is important to remember that MAD in its current form is very skeuomorphic in structure. Just as we have seen organizational structures evolve over time with new roles tasked with new objectives, enabled by new technologies, it&#8217;s likely that agent debate will progress in ways that aren&#8217;t pattern-matched only to how our current world works.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">While this means we could eventually have previously un-thought of roles and debate structures, in the interim, we could bring in novel types of environments that impact how agents move, behave and think. We also could have different types of emotions impact behaviors. <a href=\"https:\/\/arxiv.org\/pdf\/2307.11760.pdf\">This paper<\/a>, talks about emotional intelligence being integrated into LLMs showing a 10% performance uplift. One could imagine companies like <a href=\"http:\/\/hume.ai\/\">Hume.ai<\/a> expanding the boundaries of this.<\/p>\n\n\n\n<figure class=\"wp-block-image alignwide size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"655\" src=\"https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/waragent-1024x655.png\" alt=\"\" class=\"wp-image-19247\" srcset=\"https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/waragent-1024x655.png 1024w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/waragent-300x192.png 300w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/waragent-768x491.png 768w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/waragent-1536x982.png 1536w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/waragent-770x492.png 770w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/waragent-580x371.png 580w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/waragent-320x205.png 320w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/waragent.png 1708w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\"><a href=\"https:\/\/github.com\/agiresearch\/WarAgent?tab=readme-ov-file\">War and Peace (WarAgent): Large Language Model-based Multi-Agent Simulation of World Wars<\/a><\/figcaption><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">We can naturally push even further towards longer-term <em>simulation<\/em> of events as we simplistically saw in <a href=\"https:\/\/github.com\/agiresearch\/WarAgent\">WarAgent<\/a>. The implications of this are obvious but it&#8217;s worth asking the question <strong>If we can simulate how large groups of intelligent people make decisions through sophisticated MAD, and understand confidence variables of these end states through Collective Intelligence principles, have we not built a future prediction machine?<\/strong><sup id=\"mfn-content-000000000000083e0000000000000000_19235-11\" class=\"modern-footnotes-footnote \" data-mfn=\"11\" data-mfn-post-scope=\"000000000000083e0000000000000000_19235\"><a href=\"javascript:void(0)\"  role=\"button\" aria-pressed=\"false\" aria-describedby=\"mfn-content-000000000000083e0000000000000000_19235-11\">11<\/a><\/sup><span role=\"tooltip\" class=\"modern-footnotes-footnote__note\" tabindex=\"0\" data-mfn=\"11\">Of course there is complexity with limiting hallucinations. <a href=\"https:\/\/arxiv.org\/pdf\/2312.17115.pdf\">This paper<\/a> talks about some of the downfalls of \u201cout of context\u201d data asks and the hallucinations. That said, perhaps the hallucination if described or reasoned would be helpful \u201ci don\u2019t know but based on this person\u2026&#8221; anyways, this may be a stretch but let me dream.<\/span><\/p>\n\n\n\n<figure class=\"wp-block-image alignwide size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"480\" src=\"https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/devs-1024x480.png\" alt=\"\" class=\"wp-image-19248\" srcset=\"https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/devs-1024x480.png 1024w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/devs-300x141.png 300w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/devs-768x360.png 768w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/devs-770x361.png 770w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/devs-580x272.png 580w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/devs-320x150.png 320w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/devs.png 1280w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\">Who remembers the Devs future prediction machine enabled by Quantum Computing breakthroughs? <\/figcaption><\/figure>\n\n\n\n<h3 class=\"wp-block-heading\">A Note on Scaling Laws &amp; Band-Aids<\/h3>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"576\" src=\"https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/agentllmsflywheel-1024x576.jpg\" alt=\"\" class=\"wp-image-19275\" srcset=\"https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/agentllmsflywheel-1024x576.jpg 1024w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/agentllmsflywheel-300x169.jpg 300w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/agentllmsflywheel-768x432.jpg 768w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/agentllmsflywheel-1536x864.jpg 1536w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/agentllmsflywheel-2048x1152.jpg 2048w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/agentllmsflywheel-1920x1080.jpg 1920w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/agentllmsflywheel-770x433.jpg 770w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/agentllmsflywheel-580x326.jpg 580w, https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/agentllmsflywheel-320x180.jpg 320w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">There is an open question about how to think about Collective Intelligence as it relates to frontier LLM development as we canonically understand it today. Earlier, we talked about a lot of the core approaches to scaling performance as well as adjacent shots on goal to solve LLMs shortfalls. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">My gut tells me that there is likely some sort of symbiosis between these two concepts. Put more specifically, as scaling continues to progress creating better LLMs, which will enable better agents, there will also be a feedback loop of adjacent research that accelerates agent ROI across a variety of use cases. Whether or not this is owned by large AI labs like OpenAI, Anthropic or Deepmind, or we see Collective Intelligence focused AI labs such as <a href=\"https:\/\/sakana.ai\/\">Sakana<\/a> own this, is to be seen. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">There are perhaps some parallels to draw from AVs which saw dogmatic lock in on the core technical approaches, only to have to pivot many years later once they reached limits on either performance or economic realities on their approaches.<sup id=\"mfn-content-000000000000083e0000000000000000_19235-12\" class=\"modern-footnotes-footnote \" data-mfn=\"12\" data-mfn-post-scope=\"000000000000083e0000000000000000_19235\"><a href=\"javascript:void(0)\"  role=\"button\" aria-pressed=\"false\" aria-describedby=\"mfn-content-000000000000083e0000000000000000_19235-12\">12<\/a><\/sup><span role=\"tooltip\" class=\"modern-footnotes-footnote__note\" tabindex=\"0\" data-mfn=\"12\">You can read about this more in <a href=\"https:\/\/www.michaeldempsey.me\/blog\/2020\/07\/29\/inflection-points\/\">On Inflection Points<\/a>. The difference however could be that OpenAI has shown strong malleability in technical approaches, shifting from DRL to Transformers in their lifetime.<\/span><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The innovations that could come through to inflect performance on each of these are somewhat similar across scaling, architectural shifts, and data. However, if we progress towards the approach of trying to bring &#8220;embodiment&#8221; into agents that then navigate complex idea mazes, it&#8217;s likely the nuance is in how one achieves this across the entire stack from bringing in out-of-distribution data from the underlying base models, all the way to how we enable function calling for a given agent, among many other things.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">There is still much to understand here, however it is a worthy discussion as we have already seen many areas that people thought would be standalone business-worthy get subsumed by better research improving shortfalls of frontier LLMs.<sup id=\"mfn-content-000000000000083e0000000000000000_19235-13\" class=\"modern-footnotes-footnote \" data-mfn=\"13\" data-mfn-post-scope=\"000000000000083e0000000000000000_19235\"><a href=\"javascript:void(0)\"  role=\"button\" aria-pressed=\"false\" aria-describedby=\"mfn-content-000000000000083e0000000000000000_19235-13\">13<\/a><\/sup><span role=\"tooltip\" class=\"modern-footnotes-footnote__note\" tabindex=\"0\" data-mfn=\"13\">Hello context window expansion.<\/span><\/p>\n\n\n\n<h2 class=\"wp-block-heading\">CI -> MAD -> AGI -> ASI<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">My original hypothesis was that Collective Intelligence and more specifically Multi-Agent Debate could be what leads us towards a form of AGI across multiple more esoteric, but impressive, tasks. Over time, it became clear that there are many avenues where these could actually propel us to some form of artificial super intelligence (ASI) due to a possible ability to generate novel ideas at a rate that humans cannot, and perhaps navigate the various branches of the future through simulation done by superhuman agents.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Doomers like to say that AI will replace humans. Optimists say AI will enable humans to do more  than ever before. But perhaps what humanity does and what AI do is they bring together a new type of way to explore our ever-growing collective intelligence.<\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p class=\"wp-block-paragraph\">Machine learning reimplements human intelligence. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Language models emulate humanity\u2019s collective intelligence.<\/p>\n<cite><a href=\"https:\/\/www.lesswrong.com\/posts\/pnaZajFFWuXAnetpz\/on-the-future-of-language-models\">On the future of language&nbsp;models<\/a><\/cite><\/blockquote>\n\n\n\n<p class=\"wp-block-paragraph\"><em>Thanks to <a href=\"https:\/\/twitter.com\/kevinakwok\">Kevin Kwok<\/a> for thoughts on this piece<\/em>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>What magical trick makes us intelligent? The trick is that there is no trick. The power of intelligence stems from our vast diversity, not from any single, perfect principle. Marvin Minsky The Frontiers of Increasing AI Performance There has been a lot of work done on pushing the performance of machine learning with the structure [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":19268,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_post_was_ever_published":false},"categories":[278],"tags":[31],"class_list":["post-19235","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-aiml","tag-ai-ml"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.8 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Collective Intelligence, Multi-Agent Debate, &amp; AGI - Michael Dempsey: Blog<\/title>\n<meta name=\"description\" content=\"An in-depth exploration of the frontiers of Collective Intelligence and Multi-Agent Debate, and how these could be the solve for AGI.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.michaeldempsey.me\/blog\/2024\/01\/23\/collective-intelligence-multi-agent-debate-agi\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Collective Intelligence, Multi-Agent Debate, &amp; AGI - Michael Dempsey: Blog\" \/>\n<meta property=\"og:description\" content=\"An in-depth exploration of the frontiers of Collective Intelligence and Multi-Agent Debate, and how these could be the solve for AGI.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.michaeldempsey.me\/blog\/2024\/01\/23\/collective-intelligence-multi-agent-debate-agi\/\" \/>\n<meta property=\"og:site_name\" content=\"Michael Dempsey: Blog\" \/>\n<meta property=\"article:published_time\" content=\"2024-01-23T14:45:10+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-01-23T14:45:13+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/mhdempsey_a_group_of_AI_Agents_debating_in_a_white_futuristic_s_50743731-f5eb-4147-a948-a9c9fe54b37d-1024x574.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1024\" \/>\n\t<meta property=\"og:image:height\" content=\"574\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Michael Dempsey\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Michael Dempsey\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"18 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.michaeldempsey.me\\\/blog\\\/2024\\\/01\\\/23\\\/collective-intelligence-multi-agent-debate-agi\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.michaeldempsey.me\\\/blog\\\/2024\\\/01\\\/23\\\/collective-intelligence-multi-agent-debate-agi\\\/\"},\"author\":{\"name\":\"Michael Dempsey\",\"@id\":\"https:\\\/\\\/www.michaeldempsey.me\\\/blog\\\/#\\\/schema\\\/person\\\/9433ab961aef909d748bebb5eead6589\"},\"headline\":\"Collective Intelligence, Multi-Agent Debate, &#038; AGI\",\"datePublished\":\"2024-01-23T14:45:10+00:00\",\"dateModified\":\"2024-01-23T14:45:13+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.michaeldempsey.me\\\/blog\\\/2024\\\/01\\\/23\\\/collective-intelligence-multi-agent-debate-agi\\\/\"},\"wordCount\":3876,\"image\":{\"@id\":\"https:\\\/\\\/www.michaeldempsey.me\\\/blog\\\/2024\\\/01\\\/23\\\/collective-intelligence-multi-agent-debate-agi\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.michaeldempsey.me\\\/blog\\\/wp-content\\\/uploads\\\/2024\\\/01\\\/mhdempsey_a_group_of_AI_Agents_debating_in_a_white_futuristic_s_50743731-f5eb-4147-a948-a9c9fe54b37d.png\",\"keywords\":[\"AI\\\/ML\"],\"articleSection\":[\"AIML\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.michaeldempsey.me\\\/blog\\\/2024\\\/01\\\/23\\\/collective-intelligence-multi-agent-debate-agi\\\/\",\"url\":\"https:\\\/\\\/www.michaeldempsey.me\\\/blog\\\/2024\\\/01\\\/23\\\/collective-intelligence-multi-agent-debate-agi\\\/\",\"name\":\"Collective Intelligence, Multi-Agent Debate, & AGI - Michael Dempsey: Blog\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.michaeldempsey.me\\\/blog\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.michaeldempsey.me\\\/blog\\\/2024\\\/01\\\/23\\\/collective-intelligence-multi-agent-debate-agi\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.michaeldempsey.me\\\/blog\\\/2024\\\/01\\\/23\\\/collective-intelligence-multi-agent-debate-agi\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.michaeldempsey.me\\\/blog\\\/wp-content\\\/uploads\\\/2024\\\/01\\\/mhdempsey_a_group_of_AI_Agents_debating_in_a_white_futuristic_s_50743731-f5eb-4147-a948-a9c9fe54b37d.png\",\"datePublished\":\"2024-01-23T14:45:10+00:00\",\"dateModified\":\"2024-01-23T14:45:13+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/www.michaeldempsey.me\\\/blog\\\/#\\\/schema\\\/person\\\/9433ab961aef909d748bebb5eead6589\"},\"description\":\"An in-depth exploration of the frontiers of Collective Intelligence and Multi-Agent Debate, and how these could be the solve for AGI.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.michaeldempsey.me\\\/blog\\\/2024\\\/01\\\/23\\\/collective-intelligence-multi-agent-debate-agi\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.michaeldempsey.me\\\/blog\\\/2024\\\/01\\\/23\\\/collective-intelligence-multi-agent-debate-agi\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.michaeldempsey.me\\\/blog\\\/2024\\\/01\\\/23\\\/collective-intelligence-multi-agent-debate-agi\\\/#primaryimage\",\"url\":\"https:\\\/\\\/www.michaeldempsey.me\\\/blog\\\/wp-content\\\/uploads\\\/2024\\\/01\\\/mhdempsey_a_group_of_AI_Agents_debating_in_a_white_futuristic_s_50743731-f5eb-4147-a948-a9c9fe54b37d.png\",\"contentUrl\":\"https:\\\/\\\/www.michaeldempsey.me\\\/blog\\\/wp-content\\\/uploads\\\/2024\\\/01\\\/mhdempsey_a_group_of_AI_Agents_debating_in_a_white_futuristic_s_50743731-f5eb-4147-a948-a9c9fe54b37d.png\",\"width\":2912,\"height\":1632},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.michaeldempsey.me\\\/blog\\\/2024\\\/01\\\/23\\\/collective-intelligence-multi-agent-debate-agi\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.michaeldempsey.me\\\/blog\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Collective Intelligence, Multi-Agent Debate, &#038; AGI\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.michaeldempsey.me\\\/blog\\\/#website\",\"url\":\"https:\\\/\\\/www.michaeldempsey.me\\\/blog\\\/\",\"name\":\"Michael Dempsey: Blog\",\"description\":\"read, listen, speak, write\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.michaeldempsey.me\\\/blog\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.michaeldempsey.me\\\/blog\\\/#\\\/schema\\\/person\\\/9433ab961aef909d748bebb5eead6589\",\"name\":\"Michael Dempsey\",\"sameAs\":[\"http:\\\/\\\/michaeldempsey.me\"],\"url\":\"https:\\\/\\\/www.michaeldempsey.me\\\/blog\\\/author\\\/michaeldempsey_vpwk4i\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Collective Intelligence, Multi-Agent Debate, & AGI - Michael Dempsey: Blog","description":"An in-depth exploration of the frontiers of Collective Intelligence and Multi-Agent Debate, and how these could be the solve for AGI.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.michaeldempsey.me\/blog\/2024\/01\/23\/collective-intelligence-multi-agent-debate-agi\/","og_locale":"en_US","og_type":"article","og_title":"Collective Intelligence, Multi-Agent Debate, & AGI - Michael Dempsey: Blog","og_description":"An in-depth exploration of the frontiers of Collective Intelligence and Multi-Agent Debate, and how these could be the solve for AGI.","og_url":"https:\/\/www.michaeldempsey.me\/blog\/2024\/01\/23\/collective-intelligence-multi-agent-debate-agi\/","og_site_name":"Michael Dempsey: Blog","article_published_time":"2024-01-23T14:45:10+00:00","article_modified_time":"2024-01-23T14:45:13+00:00","og_image":[{"width":1024,"height":574,"url":"https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/mhdempsey_a_group_of_AI_Agents_debating_in_a_white_futuristic_s_50743731-f5eb-4147-a948-a9c9fe54b37d-1024x574.png","type":"image\/png"}],"author":"Michael Dempsey","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Michael Dempsey","Est. reading time":"18 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.michaeldempsey.me\/blog\/2024\/01\/23\/collective-intelligence-multi-agent-debate-agi\/#article","isPartOf":{"@id":"https:\/\/www.michaeldempsey.me\/blog\/2024\/01\/23\/collective-intelligence-multi-agent-debate-agi\/"},"author":{"name":"Michael Dempsey","@id":"https:\/\/www.michaeldempsey.me\/blog\/#\/schema\/person\/9433ab961aef909d748bebb5eead6589"},"headline":"Collective Intelligence, Multi-Agent Debate, &#038; AGI","datePublished":"2024-01-23T14:45:10+00:00","dateModified":"2024-01-23T14:45:13+00:00","mainEntityOfPage":{"@id":"https:\/\/www.michaeldempsey.me\/blog\/2024\/01\/23\/collective-intelligence-multi-agent-debate-agi\/"},"wordCount":3876,"image":{"@id":"https:\/\/www.michaeldempsey.me\/blog\/2024\/01\/23\/collective-intelligence-multi-agent-debate-agi\/#primaryimage"},"thumbnailUrl":"https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/mhdempsey_a_group_of_AI_Agents_debating_in_a_white_futuristic_s_50743731-f5eb-4147-a948-a9c9fe54b37d.png","keywords":["AI\/ML"],"articleSection":["AIML"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.michaeldempsey.me\/blog\/2024\/01\/23\/collective-intelligence-multi-agent-debate-agi\/","url":"https:\/\/www.michaeldempsey.me\/blog\/2024\/01\/23\/collective-intelligence-multi-agent-debate-agi\/","name":"Collective Intelligence, Multi-Agent Debate, & AGI - Michael Dempsey: Blog","isPartOf":{"@id":"https:\/\/www.michaeldempsey.me\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.michaeldempsey.me\/blog\/2024\/01\/23\/collective-intelligence-multi-agent-debate-agi\/#primaryimage"},"image":{"@id":"https:\/\/www.michaeldempsey.me\/blog\/2024\/01\/23\/collective-intelligence-multi-agent-debate-agi\/#primaryimage"},"thumbnailUrl":"https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/mhdempsey_a_group_of_AI_Agents_debating_in_a_white_futuristic_s_50743731-f5eb-4147-a948-a9c9fe54b37d.png","datePublished":"2024-01-23T14:45:10+00:00","dateModified":"2024-01-23T14:45:13+00:00","author":{"@id":"https:\/\/www.michaeldempsey.me\/blog\/#\/schema\/person\/9433ab961aef909d748bebb5eead6589"},"description":"An in-depth exploration of the frontiers of Collective Intelligence and Multi-Agent Debate, and how these could be the solve for AGI.","breadcrumb":{"@id":"https:\/\/www.michaeldempsey.me\/blog\/2024\/01\/23\/collective-intelligence-multi-agent-debate-agi\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.michaeldempsey.me\/blog\/2024\/01\/23\/collective-intelligence-multi-agent-debate-agi\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.michaeldempsey.me\/blog\/2024\/01\/23\/collective-intelligence-multi-agent-debate-agi\/#primaryimage","url":"https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/mhdempsey_a_group_of_AI_Agents_debating_in_a_white_futuristic_s_50743731-f5eb-4147-a948-a9c9fe54b37d.png","contentUrl":"https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/mhdempsey_a_group_of_AI_Agents_debating_in_a_white_futuristic_s_50743731-f5eb-4147-a948-a9c9fe54b37d.png","width":2912,"height":1632},{"@type":"BreadcrumbList","@id":"https:\/\/www.michaeldempsey.me\/blog\/2024\/01\/23\/collective-intelligence-multi-agent-debate-agi\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.michaeldempsey.me\/blog\/"},{"@type":"ListItem","position":2,"name":"Collective Intelligence, Multi-Agent Debate, &#038; AGI"}]},{"@type":"WebSite","@id":"https:\/\/www.michaeldempsey.me\/blog\/#website","url":"https:\/\/www.michaeldempsey.me\/blog\/","name":"Michael Dempsey: Blog","description":"read, listen, speak, write","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.michaeldempsey.me\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.michaeldempsey.me\/blog\/#\/schema\/person\/9433ab961aef909d748bebb5eead6589","name":"Michael Dempsey","sameAs":["http:\/\/michaeldempsey.me"],"url":"https:\/\/www.michaeldempsey.me\/blog\/author\/michaeldempsey_vpwk4i\/"}]}},"jetpack_sharing_enabled":true,"jetpack_featured_media_url":"https:\/\/www.michaeldempsey.me\/blog\/wp-content\/uploads\/2024\/01\/mhdempsey_a_group_of_AI_Agents_debating_in_a_white_futuristic_s_50743731-f5eb-4147-a948-a9c9fe54b37d.png","_links":{"self":[{"href":"https:\/\/www.michaeldempsey.me\/blog\/wp-json\/wp\/v2\/posts\/19235","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.michaeldempsey.me\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.michaeldempsey.me\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.michaeldempsey.me\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.michaeldempsey.me\/blog\/wp-json\/wp\/v2\/comments?post=19235"}],"version-history":[{"count":10,"href":"https:\/\/www.michaeldempsey.me\/blog\/wp-json\/wp\/v2\/posts\/19235\/revisions"}],"predecessor-version":[{"id":19277,"href":"https:\/\/www.michaeldempsey.me\/blog\/wp-json\/wp\/v2\/posts\/19235\/revisions\/19277"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.michaeldempsey.me\/blog\/wp-json\/wp\/v2\/media\/19268"}],"wp:attachment":[{"href":"https:\/\/www.michaeldempsey.me\/blog\/wp-json\/wp\/v2\/media?parent=19235"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.michaeldempsey.me\/blog\/wp-json\/wp\/v2\/categories?post=19235"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.michaeldempsey.me\/blog\/wp-json\/wp\/v2\/tags?post=19235"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}