87 points by search_engine_dev 6 months ago flag hide 27 comments
username1 6 months ago next
Interesting project! I've been looking for a lightweight search engine for my personal website. Would it be possible to run this on a small VPS?
author 6 months ago next
Yes, it should be possible to run this on a small VPS with at least 1GB of RAM and 2 CPU cores. I'll add some documentation on how to deploy this engine to a VPS.
username2 6 months ago prev next
Nice work! Have you considered open-sourcing the code?
author 6 months ago next
Yes, I plan to open source the code once I've completed some additional testing and added some documentation. Stay tuned!
username3 6 months ago prev next
How does the indexing process work? Is it real-time or does it take some time to index new content?
author 6 months ago next
Currently, the indexing process is not real-time, as it takes some time to process and index new content. I'm planning to add real-time indexing in the future release.
username4 6 months ago prev next
How does the relevancy scoring of search results work?
author 6 months ago next
The relevancy scoring of search results is based on the standard TF-IDF algorithm with some additional customizations to improve the relevancy for specific use-cases.
username5 6 months ago prev next
What programming language is this built in?
author 6 months ago next
This search engine is built using Rust programming language which provides excellent concurrency, memory safety and low-level system interactions.
username6 6 months ago prev next
I'm curious about the storage engine used in this project. Can you share some details about that?
author 6 months ago next
Of course! The search engine is using a custom-built storage engine based on the LSM-tree data structure for fast and efficient data storage and retrieval.
username7 6 months ago prev next
Looks very promising, can't wait to see the code open-sourced. Good luck with your project!
username8 6 months ago prev next
This is really impressive! How much traffic can this engine handle?
author 6 months ago next
This engine is designed for small-scale to medium-scale websites and blogs, with the capacity to handle up to tens of thousands of daily searches.
username9 6 months ago prev next
How easy is it to configure this search engine for my specific use-case?
author 6 months ago next
There is a configuration file where you can specify the details of your website or blog and customize the search engine to work best for you.
username10 6 months ago prev next
Is this better than using an off-the-shelf search engine solution like Elasticsearch?
author 6 months ago next
For small to medium-scale websites, this engine can provide similar performance to off-the-shelf solutions while offering better control and customizability, with a smaller footprint.
username11 6 months ago prev next
I like the idea of a lightweight search engine, but I'm worried about bloating my codebase with unnecessary dependencies.
author 6 months ago next
This search engine is designed to be a standalone service, which means you only need to include some lightweight Rust libraries in your codebase and can depend on the search engine as a microservice.
username12 6 months ago prev next
How does the search engine handle synonyms or ambiguous words?
author 6 months ago next
The engine has support for a custom dictionary that includes synonyms and other special handling rules, which can be configured to improve search results and provide better relevance.
username13 6 months ago prev next
I like the lightweight approach, how does it compare to Algolia?
author 6 months ago next
This engine is designed for more customizable and open-source search engine solution compared to Algolia with smaller footprint and less monthly costs.
username14 6 months ago prev next
I'm considering building a new search into my application, is this a good fit for me?
author 6 months ago next
Sure, this engine might be a good fit if you're looking for a lightweight, highly-configurable search solution for small-scale to medium-scale applications.