[ https://issues.apache.org/jira/browse/SPARK-25232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16592802#comment-16592802 ]
Liang-Chi Hsieh commented on SPARK-25232: ----------------------------------------- This looks to me more like a specific datasource that can support full text search, e.g., Lucene or Elasticsearch. I think this can be a spark package instead. > Support Full-Text Search in Spark SQL > ------------------------------------- > > Key: SPARK-25232 > URL: https://issues.apache.org/jira/browse/SPARK-25232 > Project: Spark > Issue Type: New Feature > Components: SQL > Affects Versions: 2.3.1 > Reporter: Lijie Xu > Priority: Major > > Full-text search (i.e., keyword search) is widely used in search engines and > relational databases such as MATCH() ... AGAINST operator in MySQL > (https://dev.mysql.com/doc/en/fulltext-search.html), Text query in Oracle > (https://docs.oracle.com/cd/B28359_01/text.111/b28303/query.htm#g1016054), > and text search in PostgreSQL > (https://www.postgresql.org/docs/9.5/static/textsearch.html). However, it is > not natively supported in Spark SQL. We propose an approach to implement this > full-text search in Spark SQL. > Our proposed approach is detailed at > [https://github.com/JerryLead/Misc/blob/master/FullTextSearch/Full-text-issue-2018.pdf] > and the prototype is available at > [https://github.com/bigdata-iscas/SparkFullTextQuery/tree/like_explorer] -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org