has there been progress on the p vs. np question? scott aaronson
TRANSCRIPT
![Page 1: Has There Been Progress on the P vs. NP Question? Scott Aaronson](https://reader035.vdocument.in/reader035/viewer/2022062618/551463315503462d4e8b5a06/html5/thumbnails/1.jpg)
Has There Been Progress on the P vs. NP Question?
Scott Aaronson
![Page 2: Has There Been Progress on the P vs. NP Question? Scott Aaronson](https://reader035.vdocument.in/reader035/viewer/2022062618/551463315503462d4e8b5a06/html5/thumbnails/2.jpg)
P vs. NP: I Assume You’ve Heard of It
Class of decision problems solvable in polynomial time by a deterministic Turing machine
P
NP
Class of decision problems for which a YES answer can be verified in polynomial time (given an appropriate witness)
NP-complete
![Page 3: Has There Been Progress on the P vs. NP Question? Scott Aaronson](https://reader035.vdocument.in/reader035/viewer/2022062618/551463315503462d4e8b5a06/html5/thumbnails/3.jpg)
Importance of the P vs. NP Question
• NP problems everywhere: machine learning, AI, biology…• Gödel (in 1956 letter to von Neumann): If P=NP, then “apart from the postulation of axioms, the mental effort of the mathematician could be completely replaced by machine”• One of the seven Clay Millennium Problems (and far and away the most important)
![Page 4: Has There Been Progress on the P vs. NP Question? Scott Aaronson](https://reader035.vdocument.in/reader035/viewer/2022062618/551463315503462d4e8b5a06/html5/thumbnails/4.jpg)
Wait … hasn’t P≠NP already been proved?
My controversial blog-response (from vacation):“If Vinay Deolalikar is awarded the $1,000,000 Clay Millennium
Prize for his proof of P≠NP, then I, Scott Aaronson, will personally supplement his prize by the amount of $200,000.”
Long Story Short- Heroic “rapid response” by computer scientists and mathematicians (including Richard Lipton, Neil Immerman, Ryan Williams, Terry Tao, Timothy Gowers…)
- Communication mostly via blog comments
- After a few days, multiple fatal problems with the proof had emerged
- Deolalikar himself hasn’t retracted anything, but my condo seems safe…
![Page 5: Has There Been Progress on the P vs. NP Question? Scott Aaronson](https://reader035.vdocument.in/reader035/viewer/2022062618/551463315503462d4e8b5a06/html5/thumbnails/5.jpg)
How can you tell if a claimed P≠NP proof is wrong (without spending too much time on it)?
0. Proof invokes Nazis, Jesus Christ, the author’s parents…1. Lower bound argument for 3SAT would work equally
well for problems known to be in P (2SAT, XORSAT)2. No “easier” lower bounds proved along the way3. Known results not encompassed as special cases4. No coherent plan of attack5. Proof is “nonlinear spaghetti”: no hierarchical structure,
lemmas aren’t well-isolated, important concepts used before being defined…
6. Argument runs afoul of one or more formal barriers (about which more later)
![Page 6: Has There Been Progress on the P vs. NP Question? Scott Aaronson](https://reader035.vdocument.in/reader035/viewer/2022062618/551463315503462d4e8b5a06/html5/thumbnails/6.jpg)
A Depressing Possibility…From the standpoint of P vs. NP, the last 50 years of theoretical computer science have taken us around in circles and been a complete waste of time.
Rest of the talk:
We might be nowhere close to a proof, but at least the depressing possibility doesn’t hold!
We’ve found (and continue to find) nontrivial insights that will play a role in the solution, assuming there is one.
![Page 7: Has There Been Progress on the P vs. NP Question? Scott Aaronson](https://reader035.vdocument.in/reader035/viewer/2022062618/551463315503462d4e8b5a06/html5/thumbnails/7.jpg)
Achievement 1: Increased Confidence That P vs. NP Was The
Right Question To Ask
![Page 8: Has There Been Progress on the P vs. NP Question? Scott Aaronson](https://reader035.vdocument.in/reader035/viewer/2022062618/551463315503462d4e8b5a06/html5/thumbnails/8.jpg)
The Unreasonable Robustness of PA half-century of speculation about alternative computational models has taken us only slightly beyond P
Would-be PNP provers: don’t get discouraged!
“But can’t soap bubbles solve the Minimum Steiner Tree problem in an instant, rendering P vs. NP irrelevant?”
Spin glasses, folding proteins, DNA computers, analog computers, even probabilistic and quantum computers still seem unable to solve all of NP in polynomial time
![Page 9: Has There Been Progress on the P vs. NP Question? Scott Aaronson](https://reader035.vdocument.in/reader035/viewer/2022062618/551463315503462d4e8b5a06/html5/thumbnails/9.jpg)
Achievement 2: Half a Century of Experience with Efficient
Computation, Increasing One’s Confidence That PNP
![Page 10: Has There Been Progress on the P vs. NP Question? Scott Aaronson](https://reader035.vdocument.in/reader035/viewer/2022062618/551463315503462d4e8b5a06/html5/thumbnails/10.jpg)
PPDynamic Programming
Linear Programming
Semidefinite/Convex Programming
#P Problems with Miraculous Cancellation
Determinant, counting planar perfect matchings, 3-regular-planar-mod-7-SAT…
#P Problems with Miraculous Positivity
Test
Matching, Littlewood-Richardson coefficients…
Polynomial Identity Testing (assuming P=BPP)
Matrix Group Membership
(modulo discrete log)
Polynomial Factoring
Trivial Problems
![Page 11: Has There Been Progress on the P vs. NP Question? Scott Aaronson](https://reader035.vdocument.in/reader035/viewer/2022062618/551463315503462d4e8b5a06/html5/thumbnails/11.jpg)
Experimental Complexity Theory
We now have a pretty detailed “statistical physics understanding” of when and where NP-complete problems become hard
[Achlioptas, Ricci-Tersenghi 2006] Known heuristic algorithms fail when a large connected cluster of solutions “melts” into exponentially many disconnected pieces
![Page 12: Has There Been Progress on the P vs. NP Question? Scott Aaronson](https://reader035.vdocument.in/reader035/viewer/2022062618/551463315503462d4e8b5a06/html5/thumbnails/12.jpg)
Claim: Had we been physicists, we would’ve long ago declared PNP a law of
nature
When people say: “What if P=NP? What if there’s an n10000 algorithm for SAT? Or an nlogloglog(n) algorithm?”
Feynman apparently had trouble accepting that P vs. NP was an open problem at all!
Response: What if the aliens killed JFK to keep him from discovering that algorithm?
![Page 13: Has There Been Progress on the P vs. NP Question? Scott Aaronson](https://reader035.vdocument.in/reader035/viewer/2022062618/551463315503462d4e8b5a06/html5/thumbnails/13.jpg)
Achievement 3: Knowing What A Nontrivial Lower Bound Looks Like
![Page 14: Has There Been Progress on the P vs. NP Question? Scott Aaronson](https://reader035.vdocument.in/reader035/viewer/2022062618/551463315503462d4e8b5a06/html5/thumbnails/14.jpg)
So What Does One Look Like?
Time-space tradeoffs for SAT
Monotone lower bound for CLIQUE [Razborov]
Lower bounds for constant-depth circuits [FSS, Ajtai, RS]
Lower bounds on proof complexity
nlog(n) lower bound on multilinear formula size [Raz]
Lower bounds for specific algorithms (DPLL, GSAT…)
Bounds on spectral gaps for NP-complete problems [DMV, FGG]
Circuit lower bounds for PP, MAEXP, etc. [BFT, Vinodchandran, Santhanam]
Circuit lower bounds based on algebraic degree
[Strassen, Mulmuley…]
![Page 15: Has There Been Progress on the P vs. NP Question? Scott Aaronson](https://reader035.vdocument.in/reader035/viewer/2022062618/551463315503462d4e8b5a06/html5/thumbnails/15.jpg)
Metaquestion: Given how short these results fall of proving PNP, can we infer anything from them about what a proof of PNP would look like?
Yes! Any proof of PNP will have to contain most of the known lower bounds as special cases
Analogy: We don’t have a quantum theory of gravity, but the fact that it has to contain the existing theories (QM and GR) as limiting cases constrains it pretty severely
This provides another explanation for why PNP is so hard, as well as a criterion for evaluating proposed approaches
![Page 16: Has There Been Progress on the P vs. NP Question? Scott Aaronson](https://reader035.vdocument.in/reader035/viewer/2022062618/551463315503462d4e8b5a06/html5/thumbnails/16.jpg)
Achievement 4: Formal Barriers
![Page 17: Has There Been Progress on the P vs. NP Question? Scott Aaronson](https://reader035.vdocument.in/reader035/viewer/2022062618/551463315503462d4e8b5a06/html5/thumbnails/17.jpg)
Relativization [BGS’75]: Any proof of PNP (or even much weaker results) will need to use something specific about NP-complete problems—something that wouldn’t be true in a fantasy universe where P and NP machines could both solve PSPACE-complete problems for free
Algebrization [AW’08]: Any proof of PNP (or even much weaker results) will need to use something specific about NP-complete problems, besides the extendibility to low-degree polynomials used in IP=PSPACE and other famous non-relativizing results
Natural Proofs [RR’97]: Any proof of PNP will need to use some specific property of NP-complete problems, which couldn’t be exploited to certify a random Boolean function as hard(For otherwise, we could turn the proof around and use it to break pseudorandom generators—thereby solving many of the very same problems we were trying to prove intractable!)
The known barriers, in one sentence each
![Page 18: Has There Been Progress on the P vs. NP Question? Scott Aaronson](https://reader035.vdocument.in/reader035/viewer/2022062618/551463315503462d4e8b5a06/html5/thumbnails/18.jpg)
P EXP [Hartmanis-Stearns]
PARITY AC0 [FSS, Ajtai]
MAEXP P/poly [BFT]
RELATIVIZATION
NATURAL PROOFS
ALGEBRIZATION
P NP
![Page 19: Has There Been Progress on the P vs. NP Question? Scott Aaronson](https://reader035.vdocument.in/reader035/viewer/2022062618/551463315503462d4e8b5a06/html5/thumbnails/19.jpg)
Achievement 5: Connections to “Real” Math
![Page 20: Has There Been Progress on the P vs. NP Question? Scott Aaronson](https://reader035.vdocument.in/reader035/viewer/2022062618/551463315503462d4e8b5a06/html5/thumbnails/20.jpg)
The Blum-Cucker-Shub-Smale Model
One can define analogues of P and NP over an arbitrary field F
When F is finite (e.g., F=F2), we recover the usual P vs. NP question
When F=R or F=C, we get an interesting new question with a “mathier” feel
All three cases (F=F2, F=R, and F=C) are open, and no implications are known among them
But the continuous versions (while ridiculously hard themselves) seem likely to be “easier” than the discrete version
![Page 21: Has There Been Progress on the P vs. NP Question? Scott Aaronson](https://reader035.vdocument.in/reader035/viewer/2022062618/551463315503462d4e8b5a06/html5/thumbnails/21.jpg)
Even Simpler: PERMANENT vs. DETERMINANT
[Valiant 70’s]: Given an nn matrix A, suppose you can’t write per(A) as det(B), where B is a poly(n)poly(n) matrix of linear combinations of the entries of A. Then AlgNCAlg#P.
This is important! It reduces a “P vs. NP-like” complexity question to algebraic geometry—a subject about which there are yellow books.
nS
n
iiiaA
1,sgndet
nS
n
iiiaA
1,per
![Page 22: Has There Been Progress on the P vs. NP Question? Scott Aaronson](https://reader035.vdocument.in/reader035/viewer/2022062618/551463315503462d4e8b5a06/html5/thumbnails/22.jpg)
Mulmuley’s Geometric Complexity Theory (GCT) Program:“The String Theory of Computer Science”
To each (real) complexity class C, one can associate a (real) algebraic variety XC
X#P(n) = “Orbit closure” of the nn Permanent function, under invertible linear transformations
of the entries
XNC(m) = “Orbit closure” of the mm Determinant
function, for some m=poly(n)
Dream: Show that X#P(n) has “too little
symmetry” to be embedded into
XNC(m). This would imply
AlgNCAlg#P.
![Page 23: Has There Been Progress on the P vs. NP Question? Scott Aaronson](https://reader035.vdocument.in/reader035/viewer/2022062618/551463315503462d4e8b5a06/html5/thumbnails/23.jpg)
Mulmuley’s GCT Program:The String Theory of Computer Science
But where do we get any new leverage?
Proposal: Exploit the “exceptional” nature of the Permanent and Determinant functions—the fact that these functions can be uniquely characterized by their symmetries—to reduce the embeddability problem to a problem in representation theory
(Which merely requires a generalization of a generalization of a generalization of the Riemann Hypothesis over finite fields)
Indeed, we already knew from Relativization / Algebrization / Natural Proofs that we’d have to exploit some special properties of the Permanent and Determinant, besides their being low-degree polynomials
![Page 24: Has There Been Progress on the P vs. NP Question? Scott Aaronson](https://reader035.vdocument.in/reader035/viewer/2022062618/551463315503462d4e8b5a06/html5/thumbnails/24.jpg)
Metaquestion: Why should P NP be provable at all?
Indeed, people have speculated since the 70s about its possible independence from set theory—see [A.’03]
If P NP is a “universal statement about mathematics,” then why shouldn’t the proof require an infinite number of mathematical ideas?
More concretely: if the proof needs to “know” that MATCHING is in P, LINEAR PROGRAMMING is in P, etc., what doesn’t it need to know is in P?
GCT suggests one possible answer: the proof would only need to know about “exceptional” problems in P (e.g., problems characterized by their symmetries)
![Page 25: Has There Been Progress on the P vs. NP Question? Scott Aaronson](https://reader035.vdocument.in/reader035/viewer/2022062618/551463315503462d4e8b5a06/html5/thumbnails/25.jpg)
ConclusionsA proof of PNP might have to be the greatest synthesis of mathematical ideas ever (but don’t let that discourage you)
“Obvious” starting point is PERMANENT vs. DETERMINANT
My prediction: Progress will come not by ignoring the last half-century of complexity theory and starting afresh, but by subsuming the many disparate facts we already know into something terrifyingly bigger
If nothing else, this provides a criterion for evaluating proposed P vs. NP attempts,
like the one we saw this summer