diff --git a/README.md b/README.md index 3e92142..ca549a4 100644 --- a/README.md +++ b/README.md @@ -4,11 +4,13 @@ [Demo Server](https://torrents-csv.ml) -`Torrents.csv` is a *collaborative* repository of torrents, consisting of a single, searchable `torrents.csv` file. Its initially populated with a January 2017 backup of the pirate bay, and new torrents are periodically added from various torrents sites. It comes with a self-hostable [Torrents.csv webserver](https://torrents-csv.ml), a command line search, and a folder scanner to add torrents. +`Torrents.csv` is a *collaborative* repository of torrents and their files, consisting of a searchable `torrents.csv`, and `torrent_files.json`. With it you can search for torrents, or files within torrents. It aims to be a universal file system for popular data. + +Its initially populated with a January 2017 backup of the pirate bay, and new torrents are periodically added from various torrents sites. It comes with a self-hostable [Torrents.csv webserver](https://torrents-csv.ml), a command line search, and a folder scanner to add torrents, and their files. `Torrents.csv` will only store torrents with at least one seeder to keep the file small, will be periodically purged of non-seeded torrents, and sorted by infohash. -![img](https://i.imgur.com/GJQE3Xi.png) +![img](https://i.imgur.com/yTFuwpv.png) To request more torrents, or add your own, go [here](https://gitlab.com/dessalines/torrents.csv/issues). @@ -61,7 +63,7 @@ bleh season 1 (1993-) ## Uploading / Adding Torrents from a Directory -An *upload*, consists of making a pull request after running the `scan_torrents.sh` script, which adds torrents from a directory you choose to the `.csv` file, after checking that they aren't already there, and that they have seeders. +An *upload*, consists of making a pull request after running the `scan_torrents.sh` script, which adds torrents from a directory you choose to the `.csv` file, after checking that they aren't already there, and that they have seeders. It also adds their files to `torrent_files.json`. ### Requirements @@ -86,7 +88,7 @@ Then [click here](https://gitlab.com/dessalines/torrents.csv/merge_requests/new) ## Web scraping torrents -`Torrents.csv` has a `Rust` repository for scraping new and top torrents from some torrent sites in the `new_torrents_fetcher` folder. It currently only has skytorrents, but more will be added later. +`Torrents.csv` has a `Rust` repository for scraping new and top torrents from some torrent sites in the `new_torrents_fetcher` folder. It currently scrapes skytorrents, magnetdl, and leetx. ### Requirements @@ -107,7 +109,17 @@ infohash;name;size_bytes;created_unix;seeders;leechers;completed;scraped_date # torrents here... ``` -## Sources for new torrents -- https://www.skytorrents.lol/top100 -- https://1337x.to/top-100 -- https://1337x.to/trending +## How the torrent_files.json looks + +``` +{ + "012ae083ec82bf911f4fe503b9f6df1effaad9ac": [ + { + "i": 0, // the index + "p": "File 1", // the path + "l": 88546036A // the size in bytes + }, + ... + ] +} +``` diff --git a/server/service/src/main.rs b/server/service/src/main.rs index 1e927fd..bbda70f 100644 --- a/server/service/src/main.rs +++ b/server/service/src/main.rs @@ -13,6 +13,7 @@ use std::ops::Deref; use rusqlite::{Connection, NO_PARAMS}; fn main() { + println!("Access me at http://localhost:8080"); server::new(|| { App::new() .route("/service/search", http::Method::GET, search)