ruby-on-rails - Googlebot 在 Rails 4.1 上导致无效的跨域请求 (COR)

Question

如何防止 Google 在抓取网站时导致此错误？我对关闭“protect_from_forgery”不感兴趣，除非这样做是安全的。

[fyi] method=GET path=/users format=*/* controller=users action=show status=200 duration=690.32 view=428.25 db=253.06 time=  host= user= user_agent=Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) session= params={""} ()
[hmm] Security warning: an embedded <script> tag on another site requested protected JavaScript. If you know what you're doing, go ahead and disable forgery protection on this action to permit cross-origin JavaScript embedding. (pid:)
[fyi] method=GET path=/users/123/flag format=*/* controller=users action=flag status=500 error='ActionController::InvalidCrossOriginRequest:Security warning: an embedded <script> tag on another site requested protected JavaScript. If you know what you're doing, go ahead and disable forgery protection on this action to permit cross-origin JavaScript embedding.' duration=26.50 time= host= user= user_agent= session= params= (pid)
[omg] ActionController::InvalidCrossOriginRequest (Security warning: an embedded <script> tag on another site requested protected JavaScript. If you know what you're doing, go ahead and disable forgery protection on this action to permit cross-origin JavaScript embedding.):
actionpack (4.1.4) lib/action_controller/metal/request_forgery_protection.rb:217:in `verify_same_origin_request'

Controller 响应于此

respond_to do |format|
    format.js { render template: 'users/flag', layout: "some_layout" }
end

我无法重新创建该错误，并且当我通过浏览器执行此操作时似乎可以正常工作

到目前为止，我已经查看了以下资源，但大多数似乎建议只是盲目地转向 CSRF 或没有得到答复。

Using layout specific javascript in comfy leads to InvalidCrossOriginRequest

Invalid Cross Origin Request After Upgrading to Rails 4.1

How to avoid ActionController::InvalidCrossOriginRequest exception?

Googlebot asks for png and then my whole Heroku site crashes. What is going on?

https://github.com/rails/rails/pull/13345

http://myownpirateradio.com/tag/rails-authentication-token/

https://gist.github.com/aishek/8535082

Why does Google prepend while(1); to their JSON responses?

http://www.tsheffler.com/blog/?p=428

http://edgeapi.rubyonrails.org/classes/ActionController/RequestForgeryProtection.html

澄清:
该操作应受到 CSRF 的保护，但我想防止 Google 对其进行抓取或在抓取页面时产生错误。即。)我希望误报安全警告消失，而不会真正影响我的安全功能。

Answer 1

Googlebot 使用“*/*”( http://apidock.com/rails/Mime )格式，应用程序呈现 js，因为它是唯一可用的内容。由于它是远程的，它正确地导致无效的 COR。

这可以使用以下方法重现:

curl -H "Accept: */*" https://www.example.com/users/123/flag

解决方法是让蜘蛛爬行的 html 回退资源:

respond_to do |format|
  format.html { render template: 'users/flag' }
  format.js { render template: 'users/flag', layout: "some_layout" }
end