Free and Open, Distributed, RESTful Search Engine

Related tags

Searchjavasearch-engineelasticsearch
Overview

Elasticsearch

Elasticsearch is the distributed, RESTful search and analytics engine at the heart of the Elastic Stack. You can use Elasticsearch to store, search, and manage data for:

  • Logs

  • Metrics

  • A search backend

  • Application monitoring

  • Endpoint security

... and more!

To learn more about Elasticsearch’s features and capabilities, see our product page.

Get started

The simplest way to set up Elasticsearch is to create a managed deployment with Elasticsearch Service on Elastic Cloud.

If you prefer to install and manage Elasticsearch yourself, you can download the latest version from elastic.co/downloads/elasticsearch.

For more installation options, see the Elasticsearch installation documentation.

Upgrade

To upgrade from an earlier version of Elasticsearch, see the Elasticsearch upgrade documentation.

Build from source

Elasticsearch uses Gradle for its build system.

To build a distribution for your local OS and print its output location upon completion, run:

./gradlew localDistro

To build a distribution for another platform, run the related command:

./gradlew :distribution:archives:linux-tar:assemble
./gradlew :distribution:archives:darwin-tar:assemble
./gradlew :distribution:archives:windows-zip:assemble

To build distributions for all supported platforms, run:

./gradlew assemble

Distributions are output to distributions/archives.

To run the test suite, see TESTING.

Documentation

For the complete Elasticsearch documentation visit elastic.co.

For information about our documentation processes, see the docs README.

Contribute

For contribution guidelines, see CONTRIBUTING.

Questions? Problems? Suggestions?

  • To report a bug or request a feature, create a GitHub Issue. Please ensure someone else hasn’t created an issue for the same topic.

  • Need help using Elasticsearch? Reach out on the Elastic Forum or Slack. A fellow community member or Elastic engineer will be happy to help you out.

You might also like...
This project is a sample demo of Arxiv search related to AI/ML Papers built using Streamlit, sentence-transformers and Faiss.
This project is a sample demo of Arxiv search related to AI/ML Papers built using Streamlit, sentence-transformers and Faiss.

This project is a sample demo of Arxiv search related to AI/ML Papers built using Streamlit, sentence-transformers and Faiss.

Karn Deb 49 Oct 30, 2022
Google Project: Search and auto-complete sentences within given input text files, manipulating data with complex data-structures.
Google Project: Search and auto-complete sentences within given input text files, manipulating data with complex data-structures.

Auto-Complete Google Project In this project there is an implementation for one feature of Google's search engines - AutoComplete. Autocomplete, or wo

Hadassah Engel 10 Jun 20, 2022
Full-text multi-table search application for Django. Easy to install and use, with good performance.

django-watson django-watson is a fast multi-model full-text search plugin for Django. It is easy to install and use, and provides high quality search

Dave Hall 1.1k Jan 3, 2023
txtai executes machine-learning workflows to transform data and build AI-powered semantic search applications.
txtai executes machine-learning workflows to transform data and build AI-powered semantic search applications.

txtai executes machine-learning workflows to transform data and build AI-powered semantic search applications.

NeuML 3.1k Dec 31, 2022
🔍 Messages Searcher is make for search custom message in all channels in guild and dm.
🔍 Messages Searcher is make for search custom message in all channels in guild and dm.

🔍 Messages Searcher is make for search custom message in all channels in guild and dm.

Kaneki 33 Dec 31, 2022
Inverted index creation and query search mechanism on Wikipedia pages.

WikiPedia Search Engine Step 1 : Installing Requirements Install "stemming" module for python using pip. Step 2 : Parsing the Data To parse the data,

Piyush Atri 1 Nov 27, 2021
ForFinder is a search tool for folder and files
ForFinder is a search tool for folder and files

ForFinder is a search tool for folder and files. You can use that when you Source Code Analysis at your project's local files or other projects that you are download. Enter a root path and keyword to ForFinder.

Çağrı Aliş 7 Oct 25, 2022
Modular search for Django

Haystack Author: Daniel Lindsley Date: 2013/07/28 Haystack provides modular search for Django. It features a unified, familiar API that allows you to

Haystack Search 3.4k Jan 4, 2023
Full text search for flask.

flask-msearch Installation To install flask-msearch: pip install flask-msearch # when MSEARCH_BACKEND = "whoosh" pip install whoosh blinker # when MSE

honmaple 197 Dec 29, 2022
Comments
  • Redundant Code at line 73 in the source file MembersInjectorStore.java

    Redundant Code at line 73 in the source file MembersInjectorStore.java

    Elasticsearch Version

    master branch

    Installed Plugins

    No response

    Java Version

    bundled

    OS Version

    no

    Problem Description

    Redundant Code at line 73 in the source file MembersInjectorStore.java

    Steps to Reproduce

    no

    Logs (if relevant)

    No response

    >bug needs:triage 
    opened by liweixiesysu 0
  • Some (not all) elasticsearch snapshot indices failing to write to azure blob with I/O error

    Some (not all) elasticsearch snapshot indices failing to write to azure blob with I/O error

    Elasticsearch Version

    7.17.8

    Installed Plugins

    repository-azure

    Java Version

    bundled

    OS Version

    Linux elasticsearch-master-0 5.4.0-1086-azure #91~18.04.1-Ubuntu SMP Thu Jun 23 20:33:05 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux

    Problem Description

    Elasticsearch running on kubernetes, installed via helm.

    Snapshot repo has been added and pointing to azure blob. Around 1/3 of the indices are failing when running the snapshot with the following error:

    INTERNAL_SERVER_ERROR: UncategorizedExecutionException[Failed execution]; nested: ExecutionException[java.io.IOException: Unable to write blob indices/8FpoPDnXTWi4UEwmpsTqPA/0/__uTMAzEiZQAGT5uSvunSJiw]; nested: IOException[Unable to write blob indices/8FpoPDnXTWi4UEwmpsTqPA/0/__uTMAzEiZQAGT5uSvunSJiw]; nested: ReactiveException[java.io.IOException: null: NIOFSIndexInput(path="/usr/share/elasticsearch/data/nodes/0/indices/a8W12fUDQPerYspC0uCgXA/0/index/_kup.fdt")]; nested: IOException[null: NIOFSIndexInput(path="/usr/share/elasticsearch/data/nodes/0/indices/a8W12fUDQPerYspC0uCgXA/0/index/_kup.fdt")]; nested: ClosedChannelException

    This smells to me like an azure issue however posting here first to try and get some kind of confirmation or consensus before I reach out to them.

    Steps to Reproduce

    add azure blob snapshot repo, create snapshot policy to capture everything, run policy

    Logs (if relevant)

    No response

    >bug needs:triage 
    opened by danfinn 0
  • NodeClient#executeLocally always executes action on the calling thread

    NodeClient#executeLocally always executes action on the calling thread

    Not sure if this is a bug or not but I found it surprising and think it's worthy of discussion. REST actions all run on a transport thread and typically call some method on a Client which ends up calling NodeClient#executeLocally and ultimately running a transport action on the local node. However AFAICT there's nowhere in this call stack which forks onto a different thread, even if the transport action would fork off onto a different thread when handling a transport request received from elsewhere.

    I mean this kinda makes sense, it's the TransportService that tracks which handlers fork where, and calls into the NodeClient bypass the TransportService, but still it seems like a potential source of inappropriate work on transport threads.

    Is that a known thing? Am I wrong to be surprised about this? (or indeed am I wrong about this behaviour?) Not much time to investigate further now so I'm opening this to make sure we discuss it.

    :Distributed/Network team-discuss Team:Distributed 
    opened by DaveCTurner 1
  • Improve scalability of BroadcastReplicationActions

    Improve scalability of BroadcastReplicationActions

    BroadcastReplicationAction derivatives (POST /<indices>/_refresh and POST /<indices>/_flush) are pretty inefficient when targeting high shard counts due to how TransportBroadcastReplicationAction works:

    • It computes the list of all target shards up-front on the calling (transport) thread.

    • It eagerly sends one request for every target shard in a tight loop on the calling (transport) thread.

    • It accumulates responses in a CopyOnWriteArrayList which takes quadratic work to populate, even though nothing reads this list until it's fully populated.

    • It then mostly discards the accumulated responses, keeping only the total number of shards, the number of successful shards, and a list of any failures.

    • Each failure is wrapped up in a ReplicationResponse.ShardInfo.Failure but then unwrapped at the end to be re-wrapped in a DefaultShardOperationFailedException.

    This commit fixes all this:

    • It avoids allocating a list of all target shards, instead iterating over the target indices and generating shard IDs on the fly.

    • ~The computation of the list of shards, and the sending of the per-shard requests, now happens on the relevant threadpool (REFRESH or FLUSH) rather than a transport thread.~ see https://github.com/elastic/elasticsearch/issues/92730

    • The per-shard requests are now throttled, with a meaningful yet fairly generous concurrency limit of #(data nodes) * 10.

    • Rather than accumulating the full responses for later processing we track the counts and failures directly.

    • The failures are tracked in a regular ArrayList, avoiding the accidentally-quadratic complexity.

    • The failures are tracked in their final form, skipping the unwrap-and-rewrap step at the end.

    Relates #77466

    >bug :Distributed/Network v8.7.0 
    opened by DaveCTurner 1
Releases(v8.5.3)

  • v8.5.3(Dec 8, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.5/release-notes-8.5.3.html

    Source code(tar.gz)
    Source code(zip)

  • v7.17.8(Dec 8, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/7.17/release-notes-7.17.8.html

    Source code(tar.gz)
    Source code(zip)

  • v8.5.2(Nov 22, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.5/release-notes-8.5.2.html

    Source code(tar.gz)
    Source code(zip)

  • v8.5.1(Nov 15, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.5/release-notes-8.5.1.html

    Source code(tar.gz)
    Source code(zip)

  • v8.5.0(Nov 1, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.5/release-notes-8.5.0.html

    Source code(tar.gz)
    Source code(zip)

  • v7.17.7(Oct 25, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/7.17/release-notes-7.17.7.html

    Source code(tar.gz)
    Source code(zip)

  • v8.4.3(Oct 5, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.4/release-notes-8.4.3.html

    Source code(tar.gz)
    Source code(zip)

  • v8.4.2(Sep 20, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.4/release-notes-8.4.2.html

    Source code(tar.gz)
    Source code(zip)

  • v8.4.1(Aug 30, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.4/release-notes-8.4.1.html

    Source code(tar.gz)
    Source code(zip)

  • v8.4.0(Aug 24, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.4/release-notes-8.4.0.html

    Source code(tar.gz)
    Source code(zip)

  • v7.17.6(Aug 24, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/7.17/release-notes-7.17.6.html

    Source code(tar.gz)
    Source code(zip)

  • v8.3.3(Jul 28, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.3/release-notes-8.3.3.html

    Source code(tar.gz)
    Source code(zip)

  • v8.3.2(Jul 7, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.3/release-notes-8.3.2.html

    Source code(tar.gz)
    Source code(zip)

  • v8.3.1(Jun 30, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.3/release-notes-8.3.1.html

    Source code(tar.gz)
    Source code(zip)

  • v8.3.0(Jun 28, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.3/release-notes-8.3.0.html

    Source code(tar.gz)
    Source code(zip)

  • v7.17.5(Jun 28, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/7.17/release-notes-7.17.5.html

    Source code(tar.gz)
    Source code(zip)

  • v8.2.3(Jun 14, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.2/release-notes-8.2.3.html

    Source code(tar.gz)
    Source code(zip)

  • v8.2.2(May 26, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.2/release-notes-8.2.2.html

    Source code(tar.gz)
    Source code(zip)

  • v8.2.1(May 24, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.2/release-notes-8.2.1.html

    Source code(tar.gz)
    Source code(zip)

  • v7.17.4(May 24, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/7.17/release-notes-7.17.4.html

    Source code(tar.gz)
    Source code(zip)

  • v8.2.0(May 3, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.2/release-notes-8.2.0.html

    Source code(tar.gz)
    Source code(zip)

  • v8.1.3(Apr 20, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.1/release-notes-8.1.3.html

    Source code(tar.gz)
    Source code(zip)

  • v7.17.3(Apr 20, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/7.17/release-notes-7.17.3.html

    Source code(tar.gz)
    Source code(zip)

  • v8.1.2(Mar 31, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.1/release-notes-8.1.2.html

    Source code(tar.gz)
    Source code(zip)

  • v7.17.2(Mar 31, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/7.17/release-notes-7.17.2.html

    Source code(tar.gz)
    Source code(zip)

  • v8.1.1(Mar 22, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.1/release-notes-8.1.1.html

    Source code(tar.gz)
    Source code(zip)

  • v8.1.0(Mar 8, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.1/release-notes-8.1.0.html

    Source code(tar.gz)
    Source code(zip)

  • v8.0.1(Mar 1, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.0/release-notes-8.0.1.html

    Source code(tar.gz)
    Source code(zip)

  • v7.17.1(Feb 28, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/7.17/release-notes-7.17.1.html

    Source code(tar.gz)
    Source code(zip)

  • v8.0.0(Feb 10, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.0/release-notes-8.0.0.html

    Source code(tar.gz)
    Source code(zip)
Owner
elastic
elastic
GitHub Repository https://www.elastic.co/products/elasticsearch
A web search server for ParlAI, including Blenderbot2.

Description A web search server for ParlAI, including Blenderbot2. Querying the server: The server reacting correctly: Uses html2text to strip the mar

Jules Gagnon-Marchand 119 Jan 06, 2023
An image inline search telegram bot.

Image-Search-Bot An image inline search telegram bot. Note: Use Telegram picture bot. That is better. Not recommending to deploy this bot. Made with P

Fayas Noushad 24 Oct 21, 2022
High level Python client for Elasticsearch

Elasticsearch DSL Elasticsearch DSL is a high-level library whose aim is to help with writing and running queries against Elasticsearch. It is built o

elastic 3.6k Dec 30, 2022
PwnWiki Telegram database searching bot

pwtgbot PwnWiki Telegram database searching bot. Screenshots How it looks like in the terminal when running How it looks like in Telegram Run Directly

K4YT3X 3 Jan 25, 2022
基于RSSHUB阅读器实现的获取P站排行和P站搜图，使用时需使用代理

基于RSSHUB阅读器实现的获取P站排行和P站搜图

34 Dec 05, 2022
Google Drive file searcher

Google Drive file searcher

Hafitz Setya 25 Dec 09, 2022
Image search service based on imgsmlr extension of PostgreSQL. Support image search by image.

imgsmlr-server Image search service based on imgsmlr extension of PostgreSQL. Support image search by image. This is a sample application of imgsmlr.

jie 45 Dec 12, 2022
Google Search Engine Results Pages (SERP) in locally, no API key, no signup required

Local SERP Google Search Engine Results Pages (SERP) in locally, no API key, no signup required Make sure the chromedriver and required package are in

theblackcat102 4 Jun 29, 2021
This is a Telegram Bot written in Python for searching data on Google Drive.

This is a Telegram Bot written in Python for searching data on Google Drive. Supports multiple Shared Drives (TDs). Manual Guide for deploying the bot

Levi 158 Dec 27, 2022
txtai executes machine-learning workflows to transform data and build AI-powered semantic search applications.

txtai executes machine-learning workflows to transform data and build AI-powered semantic search applications.

NeuML 3.1k Dec 31, 2022
Eland is a Python Elasticsearch client for exploring and analyzing data in Elasticsearch with a familiar Pandas-compatible API.

Python Client and Toolkit for DataFrames, Big Data, Machine Learning and ETL in Elasticsearch

elastic 463 Dec 30, 2022
ElasticSearch ODM (Object Document Mapper) for Python - pip install esengine

esengine - The Elasticsearch Object Document Mapper esengine is an ODM (Object Document Mapper) it maps Python classes in to Elasticsearch index/doc_t

SEEK International AI 109 Nov 22, 2022
Super Simple Similarities Service

Super Simple Similarities Service

vincent d warmerdam 95 Dec 25, 2022
Senginta is All in one Search Engine Scrapper for used by API or Python Module. It's Free!

Senginta is All in one Search Engine Scrapper. With traditional scrapping, Senginta can be powerful to get result from any Search Engine, and convert to Json. Now support only for Google Product Sear

33 Nov 21, 2022
A library for fast import of Windows NT Registry(REGF) into Elasticsearch.

A library for fast import of Windows NT Registry(REGF) into Elasticsearch.

S.Nakano 3 Apr 01, 2022
A sentence search engine that fetches examples from trusted news/media organisations. Great for writing better English.

A sentence search engine that fetches examples from trusted news/media websites. Great for improving writing & speaking better English.

Stephen Appiah 1 Apr 04, 2022
A fast, efficiency python package for searching and getting search results with many different search engines

search A fast, efficiency python package for searching and getting search results with many different search engines. Installation To install the pack

Neurs 0 Oct 06, 2022
esguard provides a Python decorator that waits for processing while monitoring the load of Elasticsearch.

esguard esguard provides a Python decorator that waits for processing while monitoring the load of Elasticsearch. Quick Start You need to launch elast

po3rin 5 Dec 08, 2021
A simple tool for searching images inside a local folder with text/image input using CLIP

clip-search (WIP) A simple tool for searching images inside a local folder with text/image input using CLIP 10 results for "a blonde woman" in a folde

5 Dec 25, 2022
solrpy is a Python client for Solr

solrpy solrpy is a Python client for Solr, an enterprise search server built on top of Lucene. solrpy allows you to add documents to a Solr instance,

Jiho Persy Lee 37 Jul 22, 2021