Have you watched television recently? Stored food in a refrigerator? Accessed the Internet? Played games on your smartphone? Driven in a car? These are all things that billions of people around the world do every day. And while they are produced by different companies using a wide range of technologies, none of them would be possible without the existence of knowledge.
Knowledge, as I have earlier defined it, is the information that humanity has recorded in a medium and improved over time. As a reminder, there are two crucial parts to this definition. The first is ‘recorded in a medium’, which allows information to be shared across time and space. The second is ‘improved over time’, which separates knowledge from information. The improvement is the result of the operation of the critical process, which allows for existing pieces of knowledge to be criticized and alternative pieces to be proposed.
I began this section with examples of everyday technologies that would not exist without knowledge. An even stronger illustration of the power of knowledge is that without it, many of us would not even be here today. As we saw in our discussion of population, Malthus was right about population growth but wrong about its consequences because he did not foresee the development of technological progress powered by improved knowledge.
Let’s look at a specific example of how this process unfolded. Humans breathe air, but for a long time we did not know what it consisted of. Oxygen and nitrogen, the two primary components of air, were not identified as elements until the late eighteenth century. Separately, although manure had been used in agricultural practice for millennia, it was not properly studied until the early nineteenth century. That led us to understand that ammonia, which consists of nitrogen and hydrogen, is a powerful fertilizer. Progress eventually resulted in the Haber process, by which atmospheric nitrogen is converted into a form that can be available to plants. Invented in the early twentieth century, it became crucial to raising agricultural yields globally, thus averting the dire consequences Malthus had envisaged. For most humans today, about half the nitrogen in our bodies has been touched by the Haber process on its way into plants and animals that we subsequently ingest.
My simplified history of the discovery of nitrogen fixation doesn’t capture the many false starts along the way. It seems strange to us now, but at one point a leading theory as to why some materials burn was that they contain ‘phlogiston’ which was thought to be released during combustion. Without the improvement of knowledge over time, we might have remained stuck at that theory, not found oxygen and nitrogen and failed to increase agricultural yields.
When thinking about the power of knowledge, we must remember that our lifetimes are trivial in the timescale of humanity, which in turn is trivial compared to that of the universe. When considering longer timeframes, we should regard all speculative propositions that don’t contravene the laws of physics as possible – a line of thinking inspired by a theoretical foundation for science called constructor theory .
Consider for a moment what knowledge might allow us to do in the future. We might rid ourselves of fossil fuels, cure any disease, take care of every human’s basic needs and travel to other planets in our solar system (organizations like SpaceX and NASA are already working toward this goal ). Eventually we might even travel to the stars. You might think interstellar travel is impossible, but it actually isn’t. Extremely difficult? Yes. Requiring technology that doesn’t yet exist? Yes. But impossible? No. It is definitely not imminent, but it will become possible with the further accretion of knowledge.
We are the only species on Earth that has created knowledge – not just science, but also art. Art allows us to express our hopes and fears, and culture has helped motivate the large-scale coordination and mobilization of human effort. We might think of the technical component of knowledge as underpinning the ‘how’ of our lives and the artistic component the ‘why’. If you have ever doubted the power of art, just think of the many times throughout history when dictators and authoritarian regimes have banned or destroyed works of art.
Knowledge has already made possible something extraordinary: by means of the innovations of the Industrial Age we can, in principle, meet everyone’s needs. But we need to generate additional knowledge to solve the problems we have introduced along the way, such as the climate crisis. New knowledge does not spring forth from a vacuum; instead it emerges from what I call ‘the knowledge loop’, in which someone learns something and creates something new, which is then shared and in turn is the basis for more learning.
The knowledge loop has been around since humans first developed written language, some five thousand years ago. Before that, humans were able to use spoken language, but that limits learning and sharing in terms of both time and space. Since the invention of written language, breakthroughs have accelerated and access to the knowledge loop has broadened. Those include moveable type (around one thousand years ago), the printing press (around five hundred years ago) and more recently the telegraph, radio and television. Now we are in the middle of another fundamental breakthrough: digital technology, which connects all of humanity to the knowledge loop at zero marginal cost and also allows machines to participate in it.
It is easy to underestimate the potential of digital technology to further accelerate and broaden access to the knowledge loop; to many people, it seems as if these innovations have so far under-delivered. As the investor Peter Thiel once complained, ‘We wanted flying cars and all we got was 140 characters.’ In fact, we have made great progress on flying cars since then, in no small part because digital technologies have already helped accelerate the knowledge loop.
The zero marginal cost and universality of digital technologies are already leading to learning, creating and sharing, giving rise to a digital knowledge loop. And as can be seen in the example of YouTube, it holds both amazing promise and great peril.
YouTube has experienced astounding growth since its launch in beta form in 2005. People around the world now upload over 100 hours of video content to the platform every minute. To illustrate just how much content that is, if you were to spend 100 years watching YouTube 24 hours a day, you would be unable to watch all the videos uploaded in a single week. YouTube contains amazing educational content on topics as diverse as gardening and theoretical math. Many of those videos show the promise of the digital knowledge loop, but the peril is also clear: YouTube also contains videos that peddle conspiracies, spread misinformation and even incite hate.
Both the promise and the peril are made possible by the same characteristics of the platform: all the videos are available for free to anyone in the world, and they become available globally the second they are published. Anybody can publish a video, and all you need to access them is an Internet connection and a smartphone. As a result, two to three billion people, almost half of the world’s population, has access to YouTube and can participate in the digital knowledge loop.
These characteristics are found in other systems that similarly show the promise and peril of the digital knowledge loop. Wikipedia, the collectively produced online encyclopedia, is another good example. At its most promising, someone might read an entry and learn the method used by Pythagoras to approximate Pi, before creating an animation that illustrates this method and publishing it on Wikipedia, making it easier for other people to learn. Wikipedia entries result from collaboration and an ongoing revision process. You can also examine both the history of the page and the conversations about it, thanks to a piece of software known as a ‘wiki’ that keeps track of the historical edits . When that process works, it raises the quality of entries over time. But when there is a coordinated effort at manipulation, Wikipedia can spread misinformation instantly and globally.
Wikipedia illustrates another important aspect of the digital knowledge loop: it allows individuals to participate in extremely small ways. If you wish, you can contribute to Wikipedia by fixing a single typo. If ten thousand people fixed one typo every day, that would be 3.65 million typos a year. If we assume that it takes two minutes to discover and fix a typo, it would take nearly fifty people working full-time for a year (2,500 hours) to fix this many typos.
The example of a Wikipedia spelling correction shows the power of small contributions that add up within the digital knowledge loop. Their peril can be seen in social networks such as Twitter and Facebook, where the small contributions are likes and retweets or reposts to one’s friends or followers. While these tiny actions can amplify high-quality content, they can just as easily spread mistakes, rumors and propaganda. These information cascades can have significant consequences, ranging from jokes going viral to the outcomes of elections being affected. They have even led to major outbreaks of violence.
Some platforms make it possible for people to contribute passively to the digital knowledge loop. Waze is a GPS navigation app. It tracks users that seem to be in a car, and the speed at which they are moving. It then passes that information back to its servers, and algorithms figure out where traffic is moving smoothly and where drivers will encounter traffic jams. Waze then proposes alternative routes, taking the traffic into account. If you follow a different route proposed by Waze, you automatically contribute your speed on that detour, a further example of passive contribution. To see the peril of passive contribution, consider Google’s autocomplete for search queries, which are derived from what people frequently search for. As a result, they often reflect existing biases, but they can also amplify them: often, instead of typing out their whole query, users select one of the autocompleted options presented to them.
The promise of the digital knowledge loop is broad access to a rapidly improving body of knowledge; the peril is that it will lead to a post-truth society that is constantly in conflict. Both of these possibilities are enabled by the same characteristics of digital technologies; once again, we can see that technology by itself does not determine the future.
To achieve the promise of the digital knowledge loop and avoid its peril will require a massive societal transition on a par with the two prior ones we have gone through, from the Forager Age to the Agrarian Age and from the Agrarian Age to the Industrial Age. We now need to leave the Industrial Age behind and enter the next one, which I am calling the Knowledge Age. We have based our economies around the job loop, which traps a lot of our attention. We have based our laws governing access to information and computation, as if those were industrial products. We have adopted a range of beliefs that keep us tied to jobs and consumption and are utterly overwhelmed by the new information environment. All of that has to change.
The transition, however, will be difficult because the Industrial Age is a system of many interlocking parts, and systems have a lot of resistance to change. As we saw earlier, simply harnessing digital technology to the existing system results in a hugely uneven distribution of power, income and wealth. And even worse, it tilts the digital knowledge loop away from its promise and towards peril.
The human species is facing problems that we can only overcome if we use digital technology to alleviate rather than worsen attention scarcity. We must the reap promise and limit the perils of digital technology for the knowledge loop. In order to accomplish the transition into the Knowledge Age, we need to make dramatic changes in regulation and self-regulation, and this is what we will examine in Part Four.