Free and Open, Distributed, RESTful Search Engine

Related tags

Searchjavasearch-engineelasticsearch
Overview

Elasticsearch

Elasticsearch is the distributed, RESTful search and analytics engine at the heart of the Elastic Stack. You can use Elasticsearch to store, search, and manage data for:

  • Logs

  • Metrics

  • A search backend

  • Application monitoring

  • Endpoint security

... and more!

To learn more about Elasticsearch’s features and capabilities, see our product page.

Get started

The simplest way to set up Elasticsearch is to create a managed deployment with Elasticsearch Service on Elastic Cloud.

If you prefer to install and manage Elasticsearch yourself, you can download the latest version from elastic.co/downloads/elasticsearch.

For more installation options, see the Elasticsearch installation documentation.

Upgrade

To upgrade from an earlier version of Elasticsearch, see the Elasticsearch upgrade documentation.

Build from source

Elasticsearch uses Gradle for its build system.

To build a distribution for your local OS and print its output location upon completion, run:

./gradlew localDistro

To build a distribution for another platform, run the related command:

./gradlew :distribution:archives:linux-tar:assemble
./gradlew :distribution:archives:darwin-tar:assemble
./gradlew :distribution:archives:windows-zip:assemble

To build distributions for all supported platforms, run:

./gradlew assemble

Distributions are output to distributions/archives.

To run the test suite, see TESTING.

Documentation

For the complete Elasticsearch documentation visit elastic.co.

For information about our documentation processes, see the docs README.

Contribute

For contribution guidelines, see CONTRIBUTING.

Questions? Problems? Suggestions?

  • To report a bug or request a feature, create a GitHub Issue. Please ensure someone else hasn’t created an issue for the same topic.

  • Need help using Elasticsearch? Reach out on the Elastic Forum or Slack. A fellow community member or Elastic engineer will be happy to help you out.

You might also like...
This project is a sample demo of Arxiv search related to AI/ML Papers built using Streamlit, sentence-transformers and Faiss.
This project is a sample demo of Arxiv search related to AI/ML Papers built using Streamlit, sentence-transformers and Faiss.

This project is a sample demo of Arxiv search related to AI/ML Papers built using Streamlit, sentence-transformers and Faiss.

Karn Deb 49 Oct 30, 2022
Google Project: Search and auto-complete sentences within given input text files, manipulating data with complex data-structures.
Google Project: Search and auto-complete sentences within given input text files, manipulating data with complex data-structures.

Auto-Complete Google Project In this project there is an implementation for one feature of Google's search engines - AutoComplete. Autocomplete, or wo

Hadassah Engel 10 Jun 20, 2022
Full-text multi-table search application for Django. Easy to install and use, with good performance.

django-watson django-watson is a fast multi-model full-text search plugin for Django. It is easy to install and use, and provides high quality search

Dave Hall 1.1k Jan 3, 2023
txtai executes machine-learning workflows to transform data and build AI-powered semantic search applications.
txtai executes machine-learning workflows to transform data and build AI-powered semantic search applications.

txtai executes machine-learning workflows to transform data and build AI-powered semantic search applications.

NeuML 3.1k Dec 31, 2022
🔍 Messages Searcher is make for search custom message in all channels in guild and dm.
🔍 Messages Searcher is make for search custom message in all channels in guild and dm.

🔍 Messages Searcher is make for search custom message in all channels in guild and dm.

Kaneki 33 Dec 31, 2022
Inverted index creation and query search mechanism on Wikipedia pages.

WikiPedia Search Engine Step 1 : Installing Requirements Install "stemming" module for python using pip. Step 2 : Parsing the Data To parse the data,

Piyush Atri 1 Nov 27, 2021
ForFinder is a search tool for folder and files
ForFinder is a search tool for folder and files

ForFinder is a search tool for folder and files. You can use that when you Source Code Analysis at your project's local files or other projects that you are download. Enter a root path and keyword to ForFinder.

Çağrı Aliş 7 Oct 25, 2022
Modular search for Django

Haystack Author: Daniel Lindsley Date: 2013/07/28 Haystack provides modular search for Django. It features a unified, familiar API that allows you to

Haystack Search 3.4k Jan 4, 2023
Full text search for flask.

flask-msearch Installation To install flask-msearch: pip install flask-msearch # when MSEARCH_BACKEND = "whoosh" pip install whoosh blinker # when MSE

honmaple 197 Dec 29, 2022
Comments
  • Redundant Code at line 73 in the source file MembersInjectorStore.java

    Redundant Code at line 73 in the source file MembersInjectorStore.java

    Elasticsearch Version

    master branch

    Installed Plugins

    No response

    Java Version

    bundled

    OS Version

    no

    Problem Description

    Redundant Code at line 73 in the source file MembersInjectorStore.java

    Steps to Reproduce

    no

    Logs (if relevant)

    No response

    >bug needs:triage 
    opened by liweixiesysu 0
  • Some (not all) elasticsearch snapshot indices failing to write to azure blob with I/O error

    Some (not all) elasticsearch snapshot indices failing to write to azure blob with I/O error

    Elasticsearch Version

    7.17.8

    Installed Plugins

    repository-azure

    Java Version

    bundled

    OS Version

    Linux elasticsearch-master-0 5.4.0-1086-azure #91~18.04.1-Ubuntu SMP Thu Jun 23 20:33:05 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux

    Problem Description

    Elasticsearch running on kubernetes, installed via helm.

    Snapshot repo has been added and pointing to azure blob. Around 1/3 of the indices are failing when running the snapshot with the following error:

    INTERNAL_SERVER_ERROR: UncategorizedExecutionException[Failed execution]; nested: ExecutionException[java.io.IOException: Unable to write blob indices/8FpoPDnXTWi4UEwmpsTqPA/0/__uTMAzEiZQAGT5uSvunSJiw]; nested: IOException[Unable to write blob indices/8FpoPDnXTWi4UEwmpsTqPA/0/__uTMAzEiZQAGT5uSvunSJiw]; nested: ReactiveException[java.io.IOException: null: NIOFSIndexInput(path="/usr/share/elasticsearch/data/nodes/0/indices/a8W12fUDQPerYspC0uCgXA/0/index/_kup.fdt")]; nested: IOException[null: NIOFSIndexInput(path="/usr/share/elasticsearch/data/nodes/0/indices/a8W12fUDQPerYspC0uCgXA/0/index/_kup.fdt")]; nested: ClosedChannelException

    This smells to me like an azure issue however posting here first to try and get some kind of confirmation or consensus before I reach out to them.

    Steps to Reproduce

    add azure blob snapshot repo, create snapshot policy to capture everything, run policy

    Logs (if relevant)

    No response

    >bug needs:triage 
    opened by danfinn 0
  • NodeClient#executeLocally always executes action on the calling thread

    NodeClient#executeLocally always executes action on the calling thread

    Not sure if this is a bug or not but I found it surprising and think it's worthy of discussion. REST actions all run on a transport thread and typically call some method on a Client which ends up calling NodeClient#executeLocally and ultimately running a transport action on the local node. However AFAICT there's nowhere in this call stack which forks onto a different thread, even if the transport action would fork off onto a different thread when handling a transport request received from elsewhere.

    I mean this kinda makes sense, it's the TransportService that tracks which handlers fork where, and calls into the NodeClient bypass the TransportService, but still it seems like a potential source of inappropriate work on transport threads.

    Is that a known thing? Am I wrong to be surprised about this? (or indeed am I wrong about this behaviour?) Not much time to investigate further now so I'm opening this to make sure we discuss it.

    :Distributed/Network team-discuss Team:Distributed 
    opened by DaveCTurner 1
  • Improve scalability of BroadcastReplicationActions

    Improve scalability of BroadcastReplicationActions

    BroadcastReplicationAction derivatives (POST /<indices>/_refresh and POST /<indices>/_flush) are pretty inefficient when targeting high shard counts due to how TransportBroadcastReplicationAction works:

    • It computes the list of all target shards up-front on the calling (transport) thread.

    • It eagerly sends one request for every target shard in a tight loop on the calling (transport) thread.

    • It accumulates responses in a CopyOnWriteArrayList which takes quadratic work to populate, even though nothing reads this list until it's fully populated.

    • It then mostly discards the accumulated responses, keeping only the total number of shards, the number of successful shards, and a list of any failures.

    • Each failure is wrapped up in a ReplicationResponse.ShardInfo.Failure but then unwrapped at the end to be re-wrapped in a DefaultShardOperationFailedException.

    This commit fixes all this:

    • It avoids allocating a list of all target shards, instead iterating over the target indices and generating shard IDs on the fly.

    • ~The computation of the list of shards, and the sending of the per-shard requests, now happens on the relevant threadpool (REFRESH or FLUSH) rather than a transport thread.~ see https://github.com/elastic/elasticsearch/issues/92730

    • The per-shard requests are now throttled, with a meaningful yet fairly generous concurrency limit of #(data nodes) * 10.

    • Rather than accumulating the full responses for later processing we track the counts and failures directly.

    • The failures are tracked in a regular ArrayList, avoiding the accidentally-quadratic complexity.

    • The failures are tracked in their final form, skipping the unwrap-and-rewrap step at the end.

    Relates #77466

    >bug :Distributed/Network v8.7.0 
    opened by DaveCTurner 1
Releases(v8.5.3)

  • v8.5.3(Dec 8, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.5/release-notes-8.5.3.html

    Source code(tar.gz)
    Source code(zip)

  • v7.17.8(Dec 8, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/7.17/release-notes-7.17.8.html

    Source code(tar.gz)
    Source code(zip)

  • v8.5.2(Nov 22, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.5/release-notes-8.5.2.html

    Source code(tar.gz)
    Source code(zip)

  • v8.5.1(Nov 15, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.5/release-notes-8.5.1.html

    Source code(tar.gz)
    Source code(zip)

  • v8.5.0(Nov 1, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.5/release-notes-8.5.0.html

    Source code(tar.gz)
    Source code(zip)

  • v7.17.7(Oct 25, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/7.17/release-notes-7.17.7.html

    Source code(tar.gz)
    Source code(zip)

  • v8.4.3(Oct 5, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.4/release-notes-8.4.3.html

    Source code(tar.gz)
    Source code(zip)

  • v8.4.2(Sep 20, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.4/release-notes-8.4.2.html

    Source code(tar.gz)
    Source code(zip)

  • v8.4.1(Aug 30, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.4/release-notes-8.4.1.html

    Source code(tar.gz)
    Source code(zip)

  • v8.4.0(Aug 24, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.4/release-notes-8.4.0.html

    Source code(tar.gz)
    Source code(zip)

  • v7.17.6(Aug 24, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/7.17/release-notes-7.17.6.html

    Source code(tar.gz)
    Source code(zip)

  • v8.3.3(Jul 28, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.3/release-notes-8.3.3.html

    Source code(tar.gz)
    Source code(zip)

  • v8.3.2(Jul 7, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.3/release-notes-8.3.2.html

    Source code(tar.gz)
    Source code(zip)

  • v8.3.1(Jun 30, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.3/release-notes-8.3.1.html

    Source code(tar.gz)
    Source code(zip)

  • v8.3.0(Jun 28, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.3/release-notes-8.3.0.html

    Source code(tar.gz)
    Source code(zip)

  • v7.17.5(Jun 28, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/7.17/release-notes-7.17.5.html

    Source code(tar.gz)
    Source code(zip)

  • v8.2.3(Jun 14, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.2/release-notes-8.2.3.html

    Source code(tar.gz)
    Source code(zip)

  • v8.2.2(May 26, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.2/release-notes-8.2.2.html

    Source code(tar.gz)
    Source code(zip)

  • v8.2.1(May 24, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.2/release-notes-8.2.1.html

    Source code(tar.gz)
    Source code(zip)

  • v7.17.4(May 24, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/7.17/release-notes-7.17.4.html

    Source code(tar.gz)
    Source code(zip)

  • v8.2.0(May 3, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.2/release-notes-8.2.0.html

    Source code(tar.gz)
    Source code(zip)

  • v8.1.3(Apr 20, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.1/release-notes-8.1.3.html

    Source code(tar.gz)
    Source code(zip)

  • v7.17.3(Apr 20, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/7.17/release-notes-7.17.3.html

    Source code(tar.gz)
    Source code(zip)

  • v8.1.2(Mar 31, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.1/release-notes-8.1.2.html

    Source code(tar.gz)
    Source code(zip)

  • v7.17.2(Mar 31, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/7.17/release-notes-7.17.2.html

    Source code(tar.gz)
    Source code(zip)

  • v8.1.1(Mar 22, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.1/release-notes-8.1.1.html

    Source code(tar.gz)
    Source code(zip)

  • v8.1.0(Mar 8, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.1/release-notes-8.1.0.html

    Source code(tar.gz)
    Source code(zip)

  • v8.0.1(Mar 1, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.0/release-notes-8.0.1.html

    Source code(tar.gz)
    Source code(zip)

  • v7.17.1(Feb 28, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/7.17/release-notes-7.17.1.html

    Source code(tar.gz)
    Source code(zip)

  • v8.0.0(Feb 10, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.0/release-notes-8.0.0.html

    Source code(tar.gz)
    Source code(zip)
Owner
elastic
elastic
GitHub Repository https://www.elastic.co/products/elasticsearch
Jina allows you to build deep learning-powered search-as-a-service in just minutes

Cloud-native neural search framework for any kind of data

Jina AI 17k Dec 31, 2022
txtai executes machine-learning workflows to transform data and build AI-powered semantic search applications.

txtai executes machine-learning workflows to transform data and build AI-powered semantic search applications.

NeuML 3.1k Dec 31, 2022
Wagtail CLIP allows you to search your Wagtail images using natural language queries.

Wagtail CLIP allows you to search your Wagtail images using natural language queries.

Matt Segal 10 Dec 21, 2022
Free and Open, Distributed, RESTful Search Engine

Elasticsearch Elasticsearch is the distributed, RESTful search and analytics engine at the heart of the Elastic Stack. You can use Elasticsearch to st

elastic 62.4k Jan 08, 2023
Pythonic search engine based on PyLucene.

Lupyne is a search engine based on PyLucene, the Python extension for accessing Java Lucene. Lucene is a relatively low-level toolkit, and PyLucene wr

A. Coady 83 Jan 02, 2023
Senginta is All in one Search Engine Scrapper for used by API or Python Module. It's Free!

Senginta is All in one Search Engine Scrapper. With traditional scrapping, Senginta can be powerful to get result from any Search Engine, and convert to Json. Now support only for Google Product Sear

33 Nov 21, 2022
A web search server for ParlAI, including Blenderbot2.

Description A web search server for ParlAI, including Blenderbot2. Querying the server: The server reacting correctly: Uses html2text to strip the mar

Jules Gagnon-Marchand 119 Jan 06, 2023
A simple tool for searching images inside a local folder with text/image input using CLIP

clip-search (WIP) A simple tool for searching images inside a local folder with text/image input using CLIP 10 results for "a blonde woman" in a folde

5 Dec 25, 2022
🔍 Messages Searcher is make for search custom message in all channels in guild and dm.

🔍 Messages Searcher is make for search custom message in all channels in guild and dm.

Kaneki 33 Dec 31, 2022
cve-search - a tool to perform local searches for known vulnerabilities

cve-search cve-search is a tool to import CVE (Common Vulnerabilities and Exposures) and CPE (Common Platform Enumeration) into a MongoDB to facilitat

cve-search 2k Jan 01, 2023
A library for fast parse & import of Windows Prefetch into Elasticsearch.

prefetch2es Fast import of Windows Prefetch(.pf) into Elasticsearch. prefetch2es uses C library libscca. Usage When using from the commandline interfa

S.Nakano 5 Nov 24, 2022
Es-schema - Common Data Schemas for Elasticsearch

Common Data Schemas for Elasticsearch The Common Data Schema for Elasticsearch i

Tim Schnell 2 Jan 25, 2022
Eland is a Python Elasticsearch client for exploring and analyzing data in Elasticsearch with a familiar Pandas-compatible API.

Python Client and Toolkit for DataFrames, Big Data, Machine Learning and ETL in Elasticsearch

elastic 463 Dec 30, 2022
User-friendly, tiny source code searcher written by pure Python.

User-friendly, tiny source code searcher written in pure Python. Example Usages Cat is equivalent in the regular expression as '^Cat$' bor class Cat

Furkan Onder 106 Nov 02, 2022
Pysolr — Python Solr client

pysolr pysolr is a lightweight Python client for Apache Solr. It provides an interface that queries the server and returns results based on the query.

Haystack Search 626 Dec 01, 2022
GitScanner is a script to make it easy to search for Exposed Git through an advanced Google search.

GitScanner Legal disclaimer Usage of GitScanner for attacking targets without prior mutual consent is illegal. It is the end user's responsibility to

Kaio Gomes 3 Oct 28, 2022
Simple algorithm search engine like google in python using function

Mini-Search-Engine-Like-Google I have created the simple algorithm search engine like google in python using function. I am matching every word with w

Sachin Vinayak Dabhade 5 Sep 24, 2021
Full text search for flask.

flask-msearch Installation To install flask-msearch: pip install flask-msearch # when MSEARCH_BACKEND = "whoosh" pip install whoosh blinker # when MSE

honmaple 197 Dec 29, 2022
Google Drive file searcher

Google Drive file searcher

Hafitz Setya 25 Dec 09, 2022
A sphinx extension for designing beautiful, screen-size responsive web components.

sphinx-design A sphinx extension for designing beautiful, view size responsive web components. Created with inspiration from Bootstrap (v5), Material

Executable Books 109 Jan 01, 2023