Institute Output

“I Have a Theory Too”: The Challenge and Opportunity of Avocational Science
Computational Essay Stephen Wolfram Computational Essay Stephen Wolfram

“I Have a Theory Too”: The Challenge and Opportunity of Avocational Science

Stephen Wolfram

Most physicists term people who send such theories “crackpots”, and either discard their missives or send back derisive responses. I’ve never felt like that was the right thing to do. Somehow I’ve always felt as if there has to be a way to channel that interest and effort into something that would be constructive and fulfilling for all concerned. And maybe, just maybe, I now have at least one idea in that direction.

Read More
What If We Had Bigger Brains? Imagining Minds beyond Ours
Computational Essay Stephen Wolfram Computational Essay Stephen Wolfram

What If We Had Bigger Brains? Imagining Minds beyond Ours

Stephen Wolfram

We humans have perhaps 100 billion neurons in our brains. But what if we had many more? Or what if the AIs we built effectively had many more? What kinds of things might then become possible? At 100 billion neurons, we know, for example, that compositional language of the kind we humans use is possible. At the 100 million or so neurons of a cat, it doesn’t seem to be. But what would become possible with 100 trillion neurons? And is it even something we could imagine understanding? 

Read More
What Can We Learn about Engineering and Innovation from Half a Century of the Game of Life Cellular Automaton?
Computational Essay Stephen Wolfram Computational Essay Stephen Wolfram

What Can We Learn about Engineering and Innovation from Half a Century of the Game of Life Cellular Automaton?

Stephen Wolfram

Things are invented. Things are discovered. And somehow there’s an arc of progress that’s formed. But are there what amount to “laws of innovation” that govern that arc of progress?

There are some exponential and other laws that purport to at least measure overall quantitative aspects of progress (number of transistors on a chip; number of papers published in a year; etc.). But what about all the disparate innovations that make up the arc of progress? Do we have a systematic way to study those?

Read More
Towards a Computational Formalization for Foundations of Medicine
Computational Essay Stephen Wolfram Computational Essay Stephen Wolfram

Towards a Computational Formalization for Foundations of Medicine

Stephen Wolfram

As it’s practiced today, medicine is almost always about particulars: “this has gone wrong; this is how to fix it”. But might it also be possible to talk about medicine in a more general, more abstract way—and perhaps to create a framework in which one can study its essential features without engaging with all of its details?

Read More
On the Nature of Time
Computational Essay Stephen Wolfram Computational Essay Stephen Wolfram

On the Nature of Time

Stephen Wolfram

Time is a central feature of human experience. But what actually is it? In traditional scientific accounts it’s often represented as some kind of coordinate much like space (though a coordinate that for some reason is always systematically increasing for us). But while this may be a useful mathematical description, it’s not telling us anything about what time in a sense “intrinsically is”.

Read More
Foundations of Biological Evolution: More Results & More Surprises
Computational Essay Stephen Wolfram Computational Essay Stephen Wolfram

Foundations of Biological Evolution: More Results & More Surprises

Stephen Wolfram

A few months ago I introduced an extremely simple “adaptive cellular automaton” model that seems to do remarkably well at capturing the essence of what’s happening in biological evolution. But over the past few months I’ve come to realize that the model is actually even richer and deeper than I’d imagined. And here I’m going to describe some of what I’ve now figured out about the model—and about the often-surprising things it implies for the foundations of biological evolution.

Read More
What’s Really Going On in Machine Learning? Some Minimal Models
Computational Essay Stephen Wolfram Computational Essay Stephen Wolfram

What’s Really Going On in Machine Learning? Some Minimal Models

Stephen Wolfram

It’s surprising how little is known about the foundations of machine learning. Yes, from an engineering point of view, an immense amount has been figured out about how to build neural nets that do all kinds of impressive and sometimes almost magical things. But at a fundamental level we still don’t really know why neural nets “work”—and we don’t have any kind of “scientific big picture” of what’s going on inside them.

Read More
Ruliology of the “Forgotten” Code 10
Computational Essay Stephen Wolfram Computational Essay Stephen Wolfram

Ruliology of the “Forgotten” Code 10

Stephen Wolfram

For several years I’d been studying the question of “where complexity comes from”, for example in nature. I’d realized there was something very computational about it (and that had even led me to the concept of computational irreducibility—a term I coined just a few days before June 1, 1984). But somehow I had imagined that “true complexity” must come from something already complex or at least random. Yet here in this picture, plain as anything, complexity was just being “created”, basically from nothing. And all it took was following a very simple rule, starting from a single black cell. 

Read More
Why Does Biological Evolution Work? A Minimal Model for Biological Evolution and Other Adaptive Processes
Research Paper Stephen Wolfram Research Paper Stephen Wolfram

Why Does Biological Evolution Work? A Minimal Model for Biological Evolution and Other Adaptive Processes

Stephen Wolfram

Why does biological evolution work? And, for that matter, why does machine learning work? Both are examples of adaptive processes that surprise us with what they manage to achieve. So what’s the essence of what’s going on? I’m going to concentrate here on biological evolution, though much of what I’ll discuss is also relevant to machine learning—but I’ll plan to explore that in more detail elsewhere.

Read More
Can AI Solve Science?
Computational Essay Stephen Wolfram Computational Essay Stephen Wolfram

Can AI Solve Science?

Stephen Wolfram

Particularly given its recent surprise successes, there’s a somewhat widespread belief that eventually AI will be able to “do everything”, or at least everything we currently do. So what about science? Over the centuries we humans have made incremental progress, gradually building up what’s now essentially the single largest intellectual edifice of our civilization. But despite all our efforts, there are still all sorts of scientific questions that remain. So can AI now come in and just solve all of them?

Read More
Observer Theory
Computational Essay Stephen Wolfram Computational Essay Stephen Wolfram

Observer Theory

Stephen Wolfram

We call it perception. We call it measurement. We call it analysis. But in the end it’s about how we take the world as it is, and derive from it the impression of it that we have in our minds.

Read More
What Is ChatGPT Doing … and Why Does It Work?
Computational Essay Stephen Wolfram Computational Essay Stephen Wolfram

What Is ChatGPT Doing … and Why Does It Work?

Stephen Wolfram

That ChatGPT can automatically generate something that reads even superficially like human-written text is remarkable, and unexpected. But how does it do it? And why does it work? My purpose here is to give a rough outline of what’s going on inside ChatGPT—and then to explore why it is that it can do so well in producing what we might consider to be meaningful text.

Read More
Computational Foundations for the Second Law of Thermodynamics
Research Paper Stephen Wolfram Research Paper Stephen Wolfram

Computational Foundations for the Second Law of Thermodynamics

Stephen Wolfram

Entropy increases. Mechanical work irreversibly turns into heat. The Second Law of thermodynamics is considered one of the great general principles of physical science. But 150 years after it was first introduced, there’s still something deeply mysterious about the Second Law. It almost seems like it’s going to be “provably true”. But one never quite gets there; it always seems to need something extra. Sometimes textbooks will gloss over everything; sometimes they’ll give some kind of “common-sense-but-outside-of-physics argument”. But the mystery of the Second Law has never gone away.

Read More