OwnSearch | IT Svit
All Portfolio Projects

OwnSearch

Overview

Create a crawler (spider) bot that can be used for specific purposes, related to data collection.

Solution

We developed a lightweight web crawler based on Python with a simple web interface that can be used to automatically build search index for any particular website.

Benefits:

  • Free
  • Fast
  • Low hardware requirements
  • Portable
  • Built-in web server
  • Built-in web interface

Technologies

Python, asyncio, aiohttp

Links
GitHub - OwnSearch
The web interface page with search results
Built-in webserver with a page showing search results