on obtaining a polynomial as a projection of another polynomial
DESCRIPTION
On obtaining a polynomial as a projection of another polynomial. Neeraj Kayal Microsoft Research. A dream. Conjecture #1: The determinantal complexity of the permanent is superpolynomial Conjecture #2: The arithmetic complexity of matrix multiplication is - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: On obtaining a polynomial as a projection of another polynomial](https://reader036.vdocument.in/reader036/viewer/2022062411/56816739550346895ddbebf9/html5/thumbnails/1.jpg)
On obtaining a polynomial as a projection of another
polynomial
Neeraj KayalMicrosoft Research
![Page 2: On obtaining a polynomial as a projection of another polynomial](https://reader036.vdocument.in/reader036/viewer/2022062411/56816739550346895ddbebf9/html5/thumbnails/2.jpg)
A dream
• Conjecture #1: The determinantal complexity of the permanent is superpolynomial
• Conjecture #2: The arithmetic complexity of matrix multiplication is
• Conjecture #3: The depth three complexity of the permanent is
![Page 3: On obtaining a polynomial as a projection of another polynomial](https://reader036.vdocument.in/reader036/viewer/2022062411/56816739550346895ddbebf9/html5/thumbnails/3.jpg)
Projections of polynomials
• Definition (Valiant): An n-variate polynomial is said to be a projection of an m-variate polynomial if
for some matrix A and vector . That is ,
where the ’s are affine functions. (Affine function : ) We will say that such a projection is invertible if is invertible.
![Page 4: On obtaining a polynomial as a projection of another polynomial](https://reader036.vdocument.in/reader036/viewer/2022062411/56816739550346895ddbebf9/html5/thumbnails/4.jpg)
Some families of polynomials
• Determinant:
• Permanent:
• Sum of Products:
![Page 5: On obtaining a polynomial as a projection of another polynomial](https://reader036.vdocument.in/reader036/viewer/2022062411/56816739550346895ddbebf9/html5/thumbnails/5.jpg)
Some families of polynomials• Trace of Matrix Multiplication
where X, Y and Z are matrices
• Sum of powers:
• Elementary Symmetric Polynomial:
][
dn, :POWni
dix
)(Trace:MMn ZYX
dSnS Si
ixYM||],[
dn, :S
![Page 6: On obtaining a polynomial as a projection of another polynomial](https://reader036.vdocument.in/reader036/viewer/2022062411/56816739550346895ddbebf9/html5/thumbnails/6.jpg)
The dream
• Conjecture #1: The determinantal complexity of the permanent is superpolynomial
• Conjecture #2: The arithmetic complexity of matrix multiplication is
• Conjecture #3: The depth three complexity of the permanent is
![Page 7: On obtaining a polynomial as a projection of another polynomial](https://reader036.vdocument.in/reader036/viewer/2022062411/56816739550346895ddbebf9/html5/thumbnails/7.jpg)
The dream
• Conjecture #1: If is a projection of then m is superpolynomial in n.
• Conjecture #2: The arithmetic complexity of matrix multiplication is
• Conjecture #3: The depth three complexity of the permanent is
![Page 8: On obtaining a polynomial as a projection of another polynomial](https://reader036.vdocument.in/reader036/viewer/2022062411/56816739550346895ddbebf9/html5/thumbnails/8.jpg)
The dream
• Conjecture #1: If is a projection of then m is superpolynomial in n.
• Conjecture #2: can be expressed as a projection of for m =
• Conjecture #3: The depth three complexity of the permanent is
![Page 9: On obtaining a polynomial as a projection of another polynomial](https://reader036.vdocument.in/reader036/viewer/2022062411/56816739550346895ddbebf9/html5/thumbnails/9.jpg)
The dream
• Conjecture #1: If is a projection of then m is superpolynomial in n.
• Conjecture #2: can be expressed as a projection of for m =
• Conjecture #3: If is a projection of then .
![Page 10: On obtaining a polynomial as a projection of another polynomial](https://reader036.vdocument.in/reader036/viewer/2022062411/56816739550346895ddbebf9/html5/thumbnails/10.jpg)
A computational problem
• POLY_PROJECTION: Given polynomials and , determine if is a projection of and if so find A and b such that
![Page 11: On obtaining a polynomial as a projection of another polynomial](https://reader036.vdocument.in/reader036/viewer/2022062411/56816739550346895ddbebf9/html5/thumbnails/11.jpg)
Some conventions
• We consider polynomials over , the field of complex numbers.
• Polynomials are encoded as arithmetic circuits (unless mentioned otherwise).
![Page 12: On obtaining a polynomial as a projection of another polynomial](https://reader036.vdocument.in/reader036/viewer/2022062411/56816739550346895ddbebf9/html5/thumbnails/12.jpg)
Unfortunately …
Theorem: POLY_PROJECTION is NP-complete.
![Page 13: On obtaining a polynomial as a projection of another polynomial](https://reader036.vdocument.in/reader036/viewer/2022062411/56816739550346895ddbebf9/html5/thumbnails/13.jpg)
A more modest ambition
• Given a polynomial and an integer n determine if is a projection of say .
• Given a polynomial and integers n,d determine if is a projection of .
![Page 14: On obtaining a polynomial as a projection of another polynomial](https://reader036.vdocument.in/reader036/viewer/2022062411/56816739550346895ddbebf9/html5/thumbnails/14.jpg)
A conjecture
Conjecture (Scott Aaronson): A random low rank projection of is indistinguishable from a truly random polynomial.
More precisely, if are random m-variate affine functions then is indistuinguishable from a random m-variate polynomial of degree n.
![Page 15: On obtaining a polynomial as a projection of another polynomial](https://reader036.vdocument.in/reader036/viewer/2022062411/56816739550346895ddbebf9/html5/thumbnails/15.jpg)
POLY_EQUIVALENCE: Given polynomials and , determine if for some invertible matrix .
Theorem (Agrawal-Saxena): POLY_EQUIVALENCE is at least as hard as graph isomorphism.
(Probably much harder than graph isomorphism.)
Polynomial Equivalence
![Page 16: On obtaining a polynomial as a projection of another polynomial](https://reader036.vdocument.in/reader036/viewer/2022062411/56816739550346895ddbebf9/html5/thumbnails/16.jpg)
• Given a polynomial and an integer n determine if is equivalent to .
• Given a polynomial and integers n,d determine if is equivalent to .
Lowering our sights further
![Page 17: On obtaining a polynomial as a projection of another polynomial](https://reader036.vdocument.in/reader036/viewer/2022062411/56816739550346895ddbebf9/html5/thumbnails/17.jpg)
Polynomial Equivalence Results
Theorem #1: There is an efficient randomized algorithm that determines if a given polynomial is an invertible projection of .
Theorem #2: There is an efficient randomized algorithm that determines if a given polynomial is an invertible projection of .
![Page 18: On obtaining a polynomial as a projection of another polynomial](https://reader036.vdocument.in/reader036/viewer/2022062411/56816739550346895ddbebf9/html5/thumbnails/18.jpg)
Invertible Projections
Theorem #3: There is an efficient randomized algorithm that determines if a given polynomial is an invertible projection of .
Theorem #4: There is an efficient randomized algorithm that determines if a given polynomial is an invertible projection of .
![Page 19: On obtaining a polynomial as a projection of another polynomial](https://reader036.vdocument.in/reader036/viewer/2022062411/56816739550346895ddbebf9/html5/thumbnails/19.jpg)
Invertible ProjectionsTheorem #3: There is an efficient randomized algorithm that determines if a given polynomial is an invertible projection of .
Theorem #4: There is an efficient randomized algorithm that determines if a given polynomial is an invertible projection of .
… and so on for the other families of polynomials
![Page 20: On obtaining a polynomial as a projection of another polynomial](https://reader036.vdocument.in/reader036/viewer/2022062411/56816739550346895ddbebf9/html5/thumbnails/20.jpg)
PreliminariesFact: Given polynomials in randomized polynomial time we can determine a basis of the vector space
}0...:),...,,{(: 1121 mmm
m ffCV
Fact: Given an n-variate polynomial , in randomized polynomial time we can find an invertible matrix A such that has fewer than n variables, if such an exists.
![Page 21: On obtaining a polynomial as a projection of another polynomial](https://reader036.vdocument.in/reader036/viewer/2022062411/56816739550346895ddbebf9/html5/thumbnails/21.jpg)
Equivalence to Problem restatement: Given an n-variate polynomial of degree d, determine if there exist n linearly independent affine functions such that
dn
ddxf ...)( 21
![Page 22: On obtaining a polynomial as a projection of another polynomial](https://reader036.vdocument.in/reader036/viewer/2022062411/56816739550346895ddbebf9/html5/thumbnails/22.jpg)
Introducing the Hessian
Definition: The hessian of an n-variate polynomial g is the following matrix:
ggg
gggggg
xH
nnnn
n
n
f
21
22
212
1212
1
:)(
Property: If then
(here g is a shorthand for the second order derivative )
![Page 23: On obtaining a polynomial as a projection of another polynomial](https://reader036.vdocument.in/reader036/viewer/2022062411/56816739550346895ddbebf9/html5/thumbnails/23.jpg)
Using the HessianProperty: If then
In particular and
Fact:
2
22
21
00
0000
)1()(,
dn
d
d
POW
x
xx
ddxHdn
![Page 24: On obtaining a polynomial as a projection of another polynomial](https://reader036.vdocument.in/reader036/viewer/2022062411/56816739550346895ddbebf9/html5/thumbnails/24.jpg)
Using the Hessian
In particular, if
dn
ddxf ...)( 21
In particular, then
222
21))(( d
ndd
f cxHDET
This gives the algorithm for equivalence to
![Page 25: On obtaining a polynomial as a projection of another polynomial](https://reader036.vdocument.in/reader036/viewer/2022062411/56816739550346895ddbebf9/html5/thumbnails/25.jpg)
Equivalence to Problem restatement: Given an n-variate polynomial of degree d, determine if there exist n linearly independent affine functions such that
),...,,()( 21, ndnSYMxf
Fact: is a multilinear polynomial, so
].[ allfor 0,2 niSYM dni
Fact: All the other second-order partial derivatives of are linearly independent.
![Page 26: On obtaining a polynomial as a projection of another polynomial](https://reader036.vdocument.in/reader036/viewer/2022062411/56816739550346895ddbebf9/html5/thumbnails/26.jpg)
Outline of Algorithm
Input: A polynomial 1. Compute all the second order partial derivatives of .
2. Compute all the linear dependencies between these second order partials of f.
3. This gives us a linear space of second order differential operators which vanish at f.
4. A second order differential operator naturally corresponds to a matrix. Find a basis of the corresponding linear space of matrices consisting of rank one matrices.
![Page 27: On obtaining a polynomial as a projection of another polynomial](https://reader036.vdocument.in/reader036/viewer/2022062411/56816739550346895ddbebf9/html5/thumbnails/27.jpg)
Equivalence to Problem restatement: Given an -variate polynomial of degree n, determine if there exist n linearly independent affine functions such that
),...,,()( 221 nnPERMxf
Fact: The group of symmetries of is continuous.
The following approach was suggested by Mulmuley and Sohoni.
![Page 28: On obtaining a polynomial as a projection of another polynomial](https://reader036.vdocument.in/reader036/viewer/2022062411/56816739550346895ddbebf9/html5/thumbnails/28.jpg)
Symmetries of
nnnn
n
nnnn
n
n
xxx
xxxxxx
PERM
xxx
xxxxxx
PERM
21
211
211
211
11211
21
22221
11211
Fact: If we take to be aribtarily close to 1 then we get a matrix A arbitarily close to identity such that
)()( xPERMxAPERM nn
![Page 29: On obtaining a polynomial as a projection of another polynomial](https://reader036.vdocument.in/reader036/viewer/2022062411/56816739550346895ddbebf9/html5/thumbnails/29.jpg)
Symmetries of
Let be a formal variable with . Then there exist nontrivial matrices A such that
)())1(( xPERMxAPERM nn
Fact: For any polynomial , the set of matrices A such that
forms a vector space. )())1(( xfxAf
Fact: For a given , a basis for this space can be computed in random polynomial time.
![Page 30: On obtaining a polynomial as a projection of another polynomial](https://reader036.vdocument.in/reader036/viewer/2022062411/56816739550346895ddbebf9/html5/thumbnails/30.jpg)
Outline of Algorithm
Input: A polynomial 1. Compute a basis for the space of matrices A satisfying .
2. Let the basis be . These matrices act on an dimensional vector space V.
3. Find all subspaces such that for all .
4. Infer the appropriate equivalence of and from the 1-dimensional invariant subspaces U.
![Page 31: On obtaining a polynomial as a projection of another polynomial](https://reader036.vdocument.in/reader036/viewer/2022062411/56816739550346895ddbebf9/html5/thumbnails/31.jpg)
That’s all fine, but what about POLY_PROJECTION?
Theorem (Kaltofen): Projections of can be reconstructed efficiently. (This is just polynomial factoring)
Theorem (follows quickly from the work of Kleppe): Given a univariate polynomial of degree d and an integer s, we can efficiently compute ’s and ’s (if they exist) such that
dss
dd bxabxabxaxf )(...)()()( 2211
![Page 32: On obtaining a polynomial as a projection of another polynomial](https://reader036.vdocument.in/reader036/viewer/2022062411/56816739550346895ddbebf9/html5/thumbnails/32.jpg)
Scott’s conjecture
Conjecture (Scott Aaronson): If are random m-variate affine functions then is indistuinguishable from a random m-variate polynomial of degree n.
In other words, solving random instances of projections of is conjecturally hard.
![Page 33: On obtaining a polynomial as a projection of another polynomial](https://reader036.vdocument.in/reader036/viewer/2022062411/56816739550346895ddbebf9/html5/thumbnails/33.jpg)
Digression: Background of Scott’s conjecture
Observation: All the known bound proofs (for projections of a family of polynomials ) follow the following strategy:
Step 1. Find an “efficiently computable” property P that is satisfied by projections of small polynomials from .
Step 2. (Relatively easy) Find an explicit polynomial not having the property P.
![Page 34: On obtaining a polynomial as a projection of another polynomial](https://reader036.vdocument.in/reader036/viewer/2022062411/56816739550346895ddbebf9/html5/thumbnails/34.jpg)
Example: Mignon and Ressayre
Theorem (Mignon and Ressayre): If is a projection of then m is at least .
Lemma: Let be a projection of . Then for any zero of ,
maH f 2))((Rank
![Page 35: On obtaining a polynomial as a projection of another polynomial](https://reader036.vdocument.in/reader036/viewer/2022062411/56816739550346895ddbebf9/html5/thumbnails/35.jpg)
Example: Projections of
Lemma (implicit in Grigoriev-Karpinski): Let be a projection of . Then the set of all possible partial derivatives of contain at most linearly independent polynomials.
![Page 36: On obtaining a polynomial as a projection of another polynomial](https://reader036.vdocument.in/reader036/viewer/2022062411/56816739550346895ddbebf9/html5/thumbnails/36.jpg)
Consequences of Scott’s conjecture
• If the conjecture is true then no current proof technique will yield superpolynomial formula size lower bound.
• If the conjecture is false then we would have obtained a good handle on the determinant versus permanent conjecture.
![Page 37: On obtaining a polynomial as a projection of another polynomial](https://reader036.vdocument.in/reader036/viewer/2022062411/56816739550346895ddbebf9/html5/thumbnails/37.jpg)
Probing a little deeper
• For families of polynomials such as we have lower bounds.
• Given , where the ’s are m-variate affine functions randomly chosen, can we efficiently recover the ’s?
![Page 38: On obtaining a polynomial as a projection of another polynomial](https://reader036.vdocument.in/reader036/viewer/2022062411/56816739550346895ddbebf9/html5/thumbnails/38.jpg)
POLY_PROJECTION on the average
Theorem: Projections of can be reconstructed efficiently on the average.
Theorem: For bounded n, projections of can be reconstructed efficiently on the average.
![Page 39: On obtaining a polynomial as a projection of another polynomial](https://reader036.vdocument.in/reader036/viewer/2022062411/56816739550346895ddbebf9/html5/thumbnails/39.jpg)
Summary• POLY_PROJECTION and POLY_EQUIVALENCE are
difficult computational problems in general.
• Empirically, for most families of polynomials that we actually care about and/or encounter in practice, we can solve POLY_EQUIVALENCE efficiently.
• Empirically, efficient average-case algorithms for POLY_PROJECTION of some family seem to be closely related to lower bounds for projections of .
![Page 40: On obtaining a polynomial as a projection of another polynomial](https://reader036.vdocument.in/reader036/viewer/2022062411/56816739550346895ddbebf9/html5/thumbnails/40.jpg)
Conclusion: An easier(?) open problem
Conjecture (Amir Shpilka): If is a projection of then .
THE END