5b5c6ec70e
Newtorrents fetcher downloads from itorrents. Fixes #35 Fetcher can scan current torrents.csv file. Fixes #40 |
||
---|---|---|
new_torrents_fetcher | ||
scripts | ||
server | ||
.dockerignore | ||
.gitignore | ||
Dockerfile | ||
LICENSE | ||
README.md | ||
docker-compose.yml | ||
search.sh |
README.md
Torrents.csv
Torrents.csv
is a collaborative repository of torrents, consisting of a single, searchable torrents.csv
file. Its initially populated with a January 2017 backup of the pirate bay, and new torrents are periodically added from various torrents sites. It comes with a self-hostable Torrents.csv webserver, a command line search, and a folder scanner to add torrents.
Torrents.csv
will only store torrents with at least one seeder to keep the file small, will be periodically purged of non-seeded torrents, and sorted by infohash.
To request more torrents, or add your own, go here.
Made with Rust, ripgrep, Actix, Inferno, Typescript.
Webserver
Torrents.csv
comes with a simple webserver. Demo Server
Requirements
- Rust
- Yarn
Running
git clone https://gitlab.com/dessalines/torrents.csv
cd torrents.csv/scripts
./webserver.sh
and goto http://localhost:8080
If running on a different host, run export TORRENTS_CSV_ENDPOINT=http://whatever.com
to change the hostname.
Docker
git clone https://gitlab.com/dessalines/torrents.csv
cd torrents.csv
docker-compose up
Command Line Searching
Requirements
Running
git clone https://gitlab.com/dessalines/torrents.csv
cd torrents.csv
./search.sh "bleh season 1"
bleh season 1 (1993-)
seeders: 33
size: 13GiB
link: magnet:?xt=urn:btih:INFO_HASH_HERE
Uploading / Adding Torrents from a Directory
An upload, consists of making a pull request after running the scan_torrents.sh
script, which adds torrents from a directory you choose to the .csv
file, after checking that they aren't already there, and that they have seeders.
Requirements
- Torrent-Tracker-Health Dessalines branch
npm i -g dessalines/torrent-tracker-health
- jq command line JSON parser
Running
Click here to fork this repo.
git clone https://gitlab.com/[MY_USER]/torrents.csv
cd torrents.csv/scripts
./scan_torrents.sh MY_TORRENTS_DIR # `MY_TORRENTS_DIR` is `~/.local/share/data/qBittorrent/BT_backup/` for qBittorrent on linux, but you can search for where your torrents are stored for your client.
git commit -am "Adding [MY_USER] torrents"
git push
Then click here to do a pull/merge request to my branch.
Web scraping torrents
Torrents.csv
has a Rust
repository for scraping new and top torrents from some torrent sites in the new_torrents_fetcher
folder. It currently only has skytorrents, but more will be added later.
Requirements
- Rust
Running
git clone https://gitlab.com/dessalines/torrents.csv
cd torrents.csv/scripts
./update.sh
How the .csv file looks
infohash;name;size_bytes;created_unix;seeders;leechers;completed;scraped_date
# torrents here...