如何使用Elasticsearch搜索多语言项。

huangapple
go评论89阅读模式
英文:

How to search multi-language items with elasticsearch

问题

Here's the translation of the provided text:

"我有一个使用Globalization Gem的Rails API应用程序。

我有一个Article模型，其中包含id、created_at和updated_at，这个模型有一个article_translations表，其中包含title_en和title_ar，正文和摘要同样适用。

我设置了Elasticsearch，但只能使用一种语言。

这是我的关注文件：

  1. # frozen_string_literal: true
  3. module Searchable
  4.   extend ActiveSupport::Concern
  6.   included do
  7.     include Elasticsearch::Model
  8.     include Elasticsearch::Model::Callbacks
  10.     mapping do
  11.       # 也尝试使用
  12.       # indexes :title, type: :text
  14.       indexes :title_en, type: :text
  15.       indexes :body_en, type: :text
  16.       indexes :excerpt_en, type: :text
  17.       indexes :title_ar, type: :text
  18.       indexes :body_ar, type: :text
  19.       indexes :excerpt_ar, type: :text
  20.     end
  22.     def self.search(query)
  23.       # 构建并运行搜索
  24.       params = {
  25.         query: {
  26.           bool: {
  27.             should: [
  28.               { match: { title: { query: query, boost: 8, fuzziness: "AUTO" } }},
  29.               { match: { body: { query: query, boost: 6, fuzziness: "AUTO" } }},
  30.               { match: { excerpt: { query: query, boost: 4, fuzziness: "AUTO" } }},
  31.             ]
  32.           }
  33.         },
  34.       }
  36.       self.__elasticsearch__.search(params)
  37.     end
  38.   end
  39. end

现在当我使用Article.search('MyQuery')时，它只搜索一种语言，这种语言是在运行Article.import(force: true)时设置的。

所以，如果我运行上述命令，将I18n.locale = :en，它将索引英文数据，对于阿拉伯文也是一样的。

由于在这里Globalization的工作方式如下：
Article.first.title将返回带有英语区域设置的.title_en和带有阿拉伯区域设置的.title_ar，这是由用户设置的，当然，我们不添加_en或_ar，只是title。

如果我想要索引两种语言以便在发送查询时能够同时搜索title_en和title_ar，该怎么办？

这是创建的索引：

如何使用Elasticsearch搜索多语言项。

在添加title_en和title_ar之后，如下图所示，但导入后被忽略：

如何使用Elasticsearch搜索多语言项。

提前致谢

英文:

So I have rails API app which uses Globalization Gem

I have and Article model which has id, created_at and updated_at, and this model has article_translations table which contains title_en and title_ar same applies for body and except

I set up Elasticsearch and it's working but with one language only

this is my concern file

  1. # frozen_string_literal: true
  3. module Searchable
  4.   extend ActiveSupport::Concern
  6.   included do
  7.     include Elasticsearch::Model
  8.     include Elasticsearch::Model::Callbacks
  10.     mapping do
  11.       # Also tried using
  12.       # indexes :title, type: :text
  14.       indexes :title_en, type: :text
  15.       indexes :body_en, type: :text
  16.       indexes :excerpt_en, type: :text
  17.       indexes :title_ar, type: :text
  18.       indexes :body_ar, type: :text
  19.       indexes :excerpt_ar, type: :text
  20.     end
  22.     def self.search(query)
  23.       # build and run search
  24.       params = {
  25.         query: {
  26.           bool: {
  27.             should: [
  28.               { match: { title: { query: query, boost: 8, fuzziness: "AUTO" } }},
  29.               { match: { body: { query: query, boost: 6, fuzziness: "AUTO" } }},
  30.               { match: { excerpt: { query: query, boost: 4, fuzziness: "AUTO" } }},
  31.             ]
  32.           }
  33.         },
  34.       }
  36.       self.__elasticsearch__.search(params)
  37.     end
  38.   end
  39. end

Now when i use Article.search('MyQuery') it searches only on one language, the language which was set when Article.import(force: true) ran

So if i ran the above command which I18n.locale = :en it will index the english data, same for arabic

Since Globalization here works as following
Article.first.title will return .title_en with english locale and .title_ar with arabic locale which is set by user, of course we don't add the _en or the _ar, just title

what if i want to index both languages to be able to search in both title_en and title_ar when i send a query ?

Here is the index created

如何使用Elasticsearch搜索多语言项。

and this is after adding title_en & title_ar but they are ignored after importing

如何使用Elasticsearch搜索多语言项。

Thanks in advance

答案1

得分: 0

Sure, here is the translated content:

"最终，我做到了！"

"我不确定这是否是最佳方式，但现在它正如预期般运作，支持两种语言 :)"

  1. module Searchable
  2.   extend ActiveSupport::Concern
  4.   included do
  5.     include Elasticsearch::Model
  6.     include Elasticsearch::Model::Callbacks
  8.     # 我不再需要这个了，因为
  9.     # 它在 as_indexed_json 方法上被覆盖了
  10.     #
  11.     # mapping do
  12.     #   indexes :title, type: :text
  13.     #   indexes :title_en, type: :text
  14.     #   indexes :body_en, type: :text
  15.     #   indexes :excerpt_en, type: :text
  16.     #   indexes :title_ar, type: :text
  17.     #   indexes :body_ar, type: :text
  18.     #   indexes :excerpt_ar, type: :text
  19.     # end
  21.     def self.search(query)
  22.       # 构建并运行搜索
  23.       params = {
  24.         query: {
  25.           bool: {
  26.             should: [
  27.               { match: { title_en: { query: query, boost: 8, fuzziness: "AUTO" } }},
  28.               { match: { title_ar: { query: query, boost: 8, fuzziness: "AUTO" } }},
  29.               { match: { body_en: { query: query, boost: 6, fuzziness: "AUTO" } }},
  30.               { match: { body_ar: { query: query, boost: 6, fuzziness: "AUTO" } }},
  31.               { match: { excerpt_en: { query: query, boost: 4, fuzziness: "AUTO" } }},
  32.               { match: { excerpt_ar: { query: query, boost: 4, fuzziness: "AUTO" } }}
  33.             ]
  34.           }
  35.         },
  36.       }
  38.       self.__elasticsearch__.search(params)
  39.     end
  41.     def as_indexed_json(options = nil)
  42.       self.as_json(
  43.         only: %i[title_en title_ar body_en body_ar excerpt_en excerpt_ar],
  44.         methods: %i[title_en title_ar body_en body_ar excerpt_en excerpt_ar]
  45.       )
  46.     end
  47.   end
  48. end
英文:

Finally i did it!

I'm not sure if it's the best way to do it or not but now it's working as it should with both languages 如何使用Elasticsearch搜索多语言项。

  1. module Searchable
  2.   extend ActiveSupport::Concern
  4.   included do
  5.     include Elasticsearch::Model
  6.     include Elasticsearch::Model::Callbacks
  8.     # I Don't need this anymore because
  9.     # it's overridden on the as_indexed_json method
  10.     #
  11.     # mapping do
  12.     #   indexes :title, type: :text
  13.     #   indexes :title_en, type: :text
  14.     #   indexes :body_en, type: :text
  15.     #   indexes :excerpt_en, type: :text
  16.     #   indexes :title_ar, type: :text
  17.     #   indexes :body_ar, type: :text
  18.     #   indexes :excerpt_ar, type: :text
  19.     # end
  21.     def self.search(query)
  22.       # build and run search
  23.       params = {
  24.         query: {
  25.           bool: {
  26.             should: [
  27.               { match: { title_en: { query: query, boost: 8, fuzziness: "AUTO" } }},
  28.               { match: { title_ar: { query: query, boost: 8, fuzziness: "AUTO" } }},
  29.               { match: { body_en: { query: query, boost: 6, fuzziness: "AUTO" } }},
  30.               { match: { body_ar: { query: query, boost: 6, fuzziness: "AUTO" } }},
  31.               { match: { excerpt_en: { query: query, boost: 4, fuzziness: "AUTO" } }},
  32.               { match: { excerpt_ar: { query: query, boost: 4, fuzziness: "AUTO" } }}
  33.             ]
  34.           }
  35.         },
  36.       }
  38.       self.__elasticsearch__.search(params)
  39.     end
  41.     def as_indexed_json(options = nil)
  42.       self.as_json(
  43.         only: %i[title_en title_ar body_en body_ar excerpt_en excerpt_ar],
  44.         methods: %i[title_en title_ar body_en body_ar excerpt_en excerpt_ar]
  45.       )
  46.     end
  47.   end
  48. end

huangapple
  • 本文由 发表于 2023年5月22日 06:07:48
  • 转载请务必保留本文链接：https://go.coder-hub.com/76302118.html
  • elasticsearch
  • ruby-on-rails
匿名

发表评论

匿名网友

:?: :razz: :sad: :evil: :!: :smile: :oops: :grin: :eek: :shock: :???: :cool: :lol: :mad: :twisted: :roll: :wink: :idea: :arrow: :neutral: :cry: :mrgreen:

确定