python - 求解 SVM 对偶时 CVXPY 错误 "Cannot multiply two non-constants"

Question

我正在尝试使用 CVXPY 解决 SVM 对偶问题。

Python代码如下:

import numpy as np
import cvxpy as cvx

# note: X and Y are numpy arrays generated for testing purpose
# calculating guassian kernal
def kg(a, b, theta=1):
    sim = np.exp( -0.5 * np.dot(a, b) / (theta ** 2))
    return sim

# generating kernal matrix
def k_mat(x, k_func=kg):
    m = x.shape[0]
    mat = np.zeros((m, m))
    for i in range(m):
        for j in range(m):
            mat[i, j] = k_func(x[i, :], x[j, :])
    return mat

k=k_mat(X)

# setup parameters
a = cvx.Variable(m)
C = cvx.Parameter(sign="positive")
C.value = 0.01

# start convex optimization
obj = cvx.Maximize(cvx.sum_entries(a) - \
      0.5 * cvx.mul_elemwise(Y, a).T * k * cvx.mul_elemwise(Y, a))
constraints = [a>=0, a<=C, cvx.sum_entries(Y, a)==0]
prob = cvx.Problem(obj, constraints)

prob.solve()
print(a.value)

我收到错误:

Traceback (most recent call last):
  File "/Library/Frameworks/Python.framework/Versions/3.5/lib/python3.5/site-packages/IPython/core/interactiveshell.py", line 3066, in run_code
    exec(code_obj, self.user_global_ns, self.user_ns)
  File "<ipython-input-44-d3b220364629>", line 4, in <module>
    obj = cvx.Maximize(cvx.sum_entries(a) - 0.5 * cvx.mul_elemwise(Y, a).T * k * cvx.mul_elemwise(Y, a))
  File "/Library/Frameworks/Python.framework/Versions/3.5/lib/python3.5/site-packages/cvxpy/expressions/expression.py", line 43, in cast_op
    return binary_op(self, other)
  File "/Library/Frameworks/Python.framework/Versions/3.5/lib/python3.5/site-packages/cvxpy/expressions/expression.py", line 224, in __mul__
    raise DCPError("Cannot multiply two non-constants.")
cvxpy.error.DCPError: Cannot multiply two non-constants.

cvxpy 似乎不支持核矩阵的二次型优化。但是我看到人们在 Matlab 中使用 cvx 解决了本演示文稿第 13(35) 页上的相同问题:

http://users.isy.liu.se/en/rt/schon/CourseMLlund/le5.pdf

我是 cvx 的新手。请帮我纠正这个。谢谢。

Answer 1

找到解决方案。

问题 1

我犯了一个愚蠢的错误，错误的高斯核定义，应该是:

def kg(a, b, theta=1):
    sim = np.exp(np.dot((a - b), (a - b)) / (2 * theta ** 2))
    return sim

问题2

正确的二次型应该是。 (我真的希望 cvx 公式与 numpy 约定兼容)

cvx.quad_form(cvx.mul_elemwise(Y, a), k)