问题

我编写了一段代码，用于在IMDB上查找一些电影名称，但例如我搜索“哈利·波特”时，可能会找到多部电影。我想要使用多线程，但我对这个领域了解不多。

我正在使用策略设计模式来在更多的网站中搜索，例如在其中一个方法中，我有以下代码：

for (Element element : elements) {
    String searchedUrl = element.select("a").attr("href");
    String movieName = element.select("h2").text();
    if (movieName.matches(patternMatcher)) {
        Result result = new Result();
        result.setName(movieName);
        result.setLink(searchedUrl);
        result.setTitleProp(super.imdbConnection(movieName));
        System.out.println(movieName + " " + searchedUrl);
        resultList.add(result);
    }
}

对于每个元素（即电影名称），它会在 super.imdbConnection(movieName) 行创建一个新的连接，以查找评分和其他信息。

问题是，我希望所有的连接都同时进行，因为在找到5-6部电影时，该过程将花费比预期更长的时间。

我不是在寻求代码，我想要一些想法。我考虑过创建一个实现了Runnable接口的内部类，并在其中使用它，但我觉得没有什么意义。

如何重写这个循环以使用多线程？

我正在使用Jsoup进行解析，Element 和 Elements 来自该库。

            for (Element element : elements) {
            String searchedUrl = element.select("a").attr("href");
            String movieName = element.select("h2").text();
            if (movieName.matches(patternMatcher)) {
                Result result = new Result();
                result.setName(movieName);
                result.setLink(searchedUrl);
                result.setTitleProp(super.imdbConnection(movieName));
                System.out.println(movieName + " " + searchedUrl);
                resultList.add(result);
            }
        }

答案1

得分: 2

以下是翻译好的代码部分：

第一部分：

// 最简单的方法是使用 `parallelStream()`
List<Result> resultList = elements.parallelStream()
                                  .map(e -> {
                                      String searchedUrl = element.select("a").attr("href");
                                      String movieName = element.select("h2").text();

                                      if (movieName.matches(patternMatcher)) {
                                          Result result = new Result();
                                          result.setName(movieName);
                                          result.setLink(searchedUrl);
                                          result.setTitleProp(super.imdbConnection(movieName));
                                          
                                          System.out.println(movieName + " " + searchedUrl);

                                          return result;
                                      } else {
                                          return null;
                                      }
                                  }).filter(Objects::nonNull)
                                  .collect(Collectors.toList());

第二部分：

List<Element> elements = new ArrayList<>();

// 创建一个返回 `Callable` 实现的函数
// 输入: Element
// 输出: Callable<Result>
Function<Element, Callable<Result>> scrapFunction = (element) -> new Callable<Result>() {

    @Override
    public Result call() throws Exception {
        String searchedUrl = element.select("a").attr("href");
        String movieName = element.select("h2").text();
        if (movieName.matches(patternMatcher)) {
            Result result = new Result();
            result.setName(movieName);
            result.setLink(searchedUrl);
            result.setTitleProp(super.imdbConnection(movieName));
            
            System.out.println(movieName + " " + searchedUrl);

            return result;
        } else {
            return null;
        }
    }
};

// 创建一个固定大小的线程池
ExecutorService executor = Executors.newFixedThreadPool(elements.size());

// 提交一个 Callable<Result> 任务给每个 Element
// 使用 scrapFunction.apply(...)
List<Future<Result>> futures = elements.stream()
                                        .map(e -> executor.submit(scrapFunction.apply(e)))
                                        .collect(Collectors.toList());

// 从 Callable<Result> 中收集所有结果
List<Result> resultList = futures.stream()
                                .map(e -> {
                                    try {
                                        return e.get();
                                    } catch (Exception ignored) {
                                        return null;
                                    }
                                }).filter(Objects::nonNull)
                                .collect(Collectors.toList());

请注意，代码中的HTML选择器和方法调用没有被翻译，保持原文不变。

List<Result> resultList = elements.parallelStream()
.map(e -> {
String searchedUrl = element.select("a").attr("href");
String movieName = element.select("h2").text();
if(movieName.matches(patternMatcher)){
Result result = new Result();
result.setName(movieName);
result.setLink(searchedUrl);
result.setTitleProp(super.imdbConnection(movieName));
System.out.println(movieName + " " + searchedUrl);
return result;
}else{
return null;
}
}).filter(Objects::nonNull)
.collect(Collectors.toList());

List<Element> elements = new ArrayList<>();
//create a function which returns an implementation of `Callable`
//input: Element
//output: Callable<Result>
Function<Element, Callable<Result>> scrapFunction = (element) -> new Callable<Result>() {
@Override
public Result call() throws Exception{
String searchedUrl = element.select("a").attr("href");
String movieName = element.select("h2").text();
if(movieName.matches(patternMatcher)){
Result result = new Result();
result.setName(movieName);
result.setLink(searchedUrl);
result.setTitleProp(super.imdbConnection(movieName));
System.out.println(movieName + " " + searchedUrl);
return result;
}else{
return null;
}
}
};
//create a fixed pool of threads
ExecutorService executor = Executors.newFixedThreadPool(elements.size());
//submit a Callable<Result> for every Element
//by using scrapFunction.apply(...)
List<Future<Result>> futures = elements.stream()
.map(e -> executor.submit(scrapFunction.apply(e)))
.collect(Collectors.toList());
//collect all results from Callable<Result>
List<Result> resultList = futures.stream()
.map(e -> {
try{
return e.get();
}catch(Exception ignored){
return null;
}
}).filter(Objects::nonNull)
.collect(Collectors.toList());