java - 如何从谷歌驱动器读取大文件到 gae blobstore

标签 java google-app-engine google-drive-api blobstore

这是我目前用于将文件从 google drive 读取到 google app engine 的 blobstore 的代码。

private BlobKey getBlobKey(File f, DriveObject driveObject)
            throws IOException, MalformedURLException { 

        Drive service = ((GoogleDrive) driveObject).getService();

        byte[] buffer = new byte[(int) f.getFileSize().intValue()];
        GenericUrl url = new GenericUrl(f.getDownloadUrl());
        HttpResponse response = service.getRequestFactory()
                    .buildGetRequest(url).execute();

        InputStream is = response.getContent();

        FileService fileService = FileServiceFactory.getFileService();
        AppEngineFile file = null;
        boolean lock = true;
        try {
            file = fileService.createNewBlobFile("application/zip");
            FileWriteChannel writeChannel = fileService.openWriteChannel(
                        file, lock);

            int len;
            while ((len = is.read(buffer)) >= 0) {
            ByteBuffer bb = ByteBuffer.wrap(buffer, 0, len);
            writeChannel.write(bb);
            }
            writeChannel.closeFinally();

        } catch (IOException e) {
                // TODO Auto-generated catch block
            e.printStackTrace();
        }

            BlobKey bk = fileService.getBlobKey(file);

        return bk;
    }

这适用于小文件,但如果文件大于 ~25MB,则会出错。有没有更好的方法来完成我想做的事情?

这是我看到的错误

Uncaught exception from servlet
com.google.appengine.api.urlfetch.ResponseTooLargeException: The response from url https://doc-0o-bs-docs.googleusercontent.com/docs/securesc/97o44sjeam7f23b1flie9m3qqidhrago/97q4akk8bmpub24itqhclo1vakjusu84/1368259200000/14350098165097390874/14350098165097390874/0ByS2XCxCEzq-NUVuajAwWGVoR1U?h=16653014193614665626&e=download&gd=true was too large.
    at com.google.appengine.api.urlfetch.URLFetchServiceImpl.convertApplicationException(URLFetchServiceImpl.java:132)
    at com.google.appengine.api.urlfetch.URLFetchServiceImpl.fetch(URLFetchServiceImpl.java:43)
    at com.google.apphosting.utils.security.urlfetch.URLFetchServiceStreamHandler$Connection.fetchResponse(URLFetchServiceStreamHandler.java:417)
    at com.google.apphosting.utils.security.urlfetch.URLFetchServiceStreamHandler$Connection.getInputStream(URLFetchServiceStreamHandler.java:296)
    at com.google.apphosting.utils.security.urlfetch.URLFetchServiceStreamHandler$Connection.getResponseCode(URLFetchServiceStreamHandler.java:149)
    at com.google.api.client.http.javanet.NetHttpResponse.<init>(NetHttpResponse.java:37)
    at com.google.api.client.http.javanet.NetHttpRequest.execute(NetHttpRequest.java:95)
    at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:980)

我应该补充一点

Drive service = ((GoogleDrive) driveObject).getService();

返回

new Drive.Builder(httpTransport, jsonFactory, cred)
            .build()

最佳答案

您可以从云端硬盘分块下载文件。使用 Range下载请求中的 header ,如 Google Drive documentation 中所述.

Range: bytes=500-999

关于java - 如何从谷歌驱动器读取大文件到 gae blobstore,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/16495827/

相关文章:

google-app-engine - Google 任务队列 JSON API 事务

google-app-engine - 如何在页面刷新时使 Angular 2 路由与 App Engine 一起工作?

google-api - 是否可以通过 API 删除授权?

java - 在 Google 云端硬盘中下载文件时,文件暂时移动错误

google-drive-api - 我不知道谷歌驱动器如何显示我的网站

java - 显式声明默认 Java 类序列化方法的原因是什么?

java - 无法使用新的 readObject()/writeObject() 方法反序列化对象

java - 我的 JPanel 拒绝聚焦

java - 如何将 Dataset 转换为 JavaPairRDD?

google-app-engine - Golang lua-script 就像在 GAE 上运行