Go to file
Dessalines 5b5c6ec70e Adding Clap parser.
Newtorrents fetcher downloads from itorrents. Fixes #35
Fetcher can scan current torrents.csv file. Fixes #40
2019-01-25 11:31:42 -08:00
new_torrents_fetcher Adding Clap parser. 2019-01-25 11:31:42 -08:00
scripts Using new tracker health for torrent scanner. Fixes #34 2019-01-24 14:45:18 -08:00
server Moving set_env to fusebox task. Fixes #30. 2018-12-25 15:19:16 -08:00
.dockerignore Fixing up docker a little bit 2018-12-02 22:19:03 -07:00
.gitignore Converting webserver to sqlite version for speed. Fixes #23 2018-12-02 02:16:31 -07:00
Dockerfile Fixing up docker a little bit. #19. 2018-12-10 12:15:46 -07:00
LICENSE Script mostly working. 2018-10-04 13:23:57 -07:00
README.md erroneous commit. 2018-12-23 10:40:49 -08:00
docker-compose.yml Fixing up docker a little bit. #19. 2018-12-10 12:15:46 -07:00
search.sh Import of TPB Jan 2017 backup. Updating search and add scripts. Adding prune.sh 2018-10-07 22:43:12 -07:00

README.md

Torrents.csv

Demo Server

Torrents.csv is a collaborative repository of torrents, consisting of a single, searchable torrents.csv file. Its initially populated with a January 2017 backup of the pirate bay, and new torrents are periodically added from various torrents sites. It comes with a self-hostable Torrents.csv webserver, a command line search, and a folder scanner to add torrents.

Torrents.csv will only store torrents with at least one seeder to keep the file small, will be periodically purged of non-seeded torrents, and sorted by infohash.

img

To request more torrents, or add your own, go here.

Made with Rust, ripgrep, Actix, Inferno, Typescript.

Webserver

Torrents.csv comes with a simple webserver. Demo Server

Requirements

  • Rust
  • Yarn

Running

git clone https://gitlab.com/dessalines/torrents.csv
cd torrents.csv/scripts
./webserver.sh

and goto http://localhost:8080

If running on a different host, run export TORRENTS_CSV_ENDPOINT=http://whatever.com to change the hostname.

Docker

git clone https://gitlab.com/dessalines/torrents.csv
cd torrents.csv
docker-compose up

Command Line Searching

Requirements

Running

git clone https://gitlab.com/dessalines/torrents.csv
cd torrents.csv
./search.sh "bleh season 1"
bleh season 1 (1993-)
	seeders: 33
	size: 13GiB
	link: magnet:?xt=urn:btih:INFO_HASH_HERE

Uploading / Adding Torrents from a Directory

An upload, consists of making a pull request after running the scan_torrents.sh script, which adds torrents from a directory you choose to the .csv file, after checking that they aren't already there, and that they have seeders.

Requirements

Running

Click here to fork this repo.

git clone https://gitlab.com/[MY_USER]/torrents.csv
cd torrents.csv/scripts
./scan_torrents.sh MY_TORRENTS_DIR # `MY_TORRENTS_DIR` is `~/.local/share/data/qBittorrent/BT_backup/` for qBittorrent on linux, but you can search for where your torrents are stored for your client.
git commit -am "Adding [MY_USER] torrents"
git push

Then click here to do a pull/merge request to my branch.

Web scraping torrents

Torrents.csv has a Rust repository for scraping new and top torrents from some torrent sites in the new_torrents_fetcher folder. It currently only has skytorrents, but more will be added later.

Requirements

  • Rust

Running

git clone https://gitlab.com/dessalines/torrents.csv
cd torrents.csv/scripts
./update.sh

How the .csv file looks

infohash;name;size_bytes;created_unix;seeders;leechers;completed;scraped_date
# torrents here...

Sources for new torrents