java - Elastic Search Scroll API 无限循环滚动

Question

我试图根据批处理获取数据。为此写了下面的代码

final Scroll scroll = new Scroll(TimeValue.timeValueMillis(1L));
SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder().query(boolQuery)
                    .sort(FieldSortBuilder.DOC_FIELD_NAME, SortOrder.DESC).size(10000);

SearchRequest req = new SearchRequest("logs");
req.scroll(scroll);
req.source(searchSourceBuilder);
SearchResponse searchResponse = client.search(req, RequestOptions.DEFAULT);
scrollId = searchResponse.getScrollId();
SearchHit[] resultsHits = searchResponse.getHits().getHits();
logger.info("scrollId:{}",scrollId);
while (resultsHits != null && resultsHits.length > 0) {
   SearchScrollRequest searchScrollRequest = new SearchScrollRequest(scrollId);
   searchScrollRequest.scroll(scroll);
   SearchResponse response = client.scroll(searchScrollRequest,RequestOptions.DEFAULT);
   scrollId = response.getScrollId();
   resultsHits = searchResponse.getHits().getHits();

   logger.info("scrollId:{}",scrollId);
   logger.info("resultHits:{}",resultsHits.length);
 }

但是上面的代码正在无限循环中运行。不明白我错过了什么。

Answer 1

您在 while 循环中使用 searchResponse，而不是使用 SearchResponse response = client.scroll(searchScrollRequest,RequestOptions) 中的 response 。默认); 这就是你在无限循环中运行的原因。

更改为:

SearchResponse response = client.scroll(searchScrollRequest,RequestOptions.DEFAULT);
scrollId = response.getScrollId();
resultsHits = response.getHits().getHits();

希望这有帮助