torrents.csv/README.md

# Torrents.csv

`Torrents.csv` is a vetted database of torrents, consisting of a single, searchable `torrents.csv` file.

## Searching
To find torrents run `./search.sh "frasier s01"`
```
Frasier S01-S11 (1993-)
	seeders: 33
	size: 13GiB
	link: magnet:?xt=urn:btih:3cc5142d0d139bcc9ea9925239a142770b98cf74
```

To add your own torrents, run `./add_torrents.sh MY_TORRENTS_DIR`

## Uploading

An *upload*, consists of making a pull request after running the `add_torrents.sh` script, which adds torrents from a directory to the `.csv` file, after checking that they aren't already there, and that they have seeders.

[Click here](https://gitlab.com/dessalines/torrents.csv/forks/new) to fork this repo.
```sh
git clone https://gitlab.com/[MY_USER]/torrents.csv
cd torrents.csv
./add_torrents.sh MY_TORRENTS_DIR # `MY_TORRENTS_DIR` is `~/.local/share/data/qBittorrent/BT_backup/` for qBittorrent on linux, but you can search for where your torrents are stored for your client.
git commit -am "Adding my torrents"
git push
```

Then [click here](https://gitlab.com/dessalines/torrents.csv/merge_requests/new) to do a pull/merge request to my branch.

## How the file looks
```sh
infohash;name;size_bytes;created_unix;seeders;leechers;completed;scraped_date
# torrents here...
```

## Requirements

### Searching
- [ripgrep](https://github.com/BurntSushi/ripgrep)

### Uploading
- [Torrent tracker scraper](https://github.com/ZigmundVonZaun/torrent-tracker-scraper)
- [Transmission-cli](https://github.com/ZigmundVonZaun/torrent-tracker-scraper)
- [Human Friendly](https://humanfriendly.readthedocs.io/en/latest/readme.html#command-line)


## Other info

`Torrents.csv` will only store torrents with at least one seeder to keep the file small, and will be periodically purged of non-seeded torrents, and sorted by seeders descending.

Its initially populated with a January 2017 backup of the pirate bay, but eventually scripts will be written that pull in new torrents daily. 

## Potential sources for new torrents
- https://www.skytorrents.lol/top100
- https://1337x.to/top-100
- https://1337x.to/trending
Renaming to torrents.csv 2018-10-04 23:33:33 +00:00			`# Torrents.csv`
Initial commit 2018-10-03 17:12:12 +00:00
Renaming to torrents.csv 2018-10-04 23:33:33 +00:00			`Torrents.csv` is a vetted database of torrents, consisting of a single, searchable `torrents.csv` file.
Initial commit 2018-10-03 17:12:12 +00:00
Adding humanized size output to search. Fixes #1 2018-10-06 06:58:09 +00:00			`## Searching`
			To find torrents run `./search.sh "frasier s01"`
			```
			`Frasier S01-S11 (1993-)`
			`seeders: 33`
Import of TPB Jan 2017 backup. Updating search and add scripts. Adding prune.sh 2018-10-08 05:43:12 +00:00			`size: 13GiB`
Adding humanized size output to search. Fixes #1 2018-10-06 06:58:09 +00:00			`link: magnet:?xt=urn:btih:3cc5142d0d139bcc9ea9925239a142770b98cf74`
			```
Script mostly working. 2018-10-04 20:23:57 +00:00
Fix instructions. 2018-10-05 06:48:51 +00:00			To add your own torrents, run `./add_torrents.sh MY_TORRENTS_DIR`

Adding humanized size output to search. Fixes #1 2018-10-06 06:58:09 +00:00			`## Uploading`

			An upload, consists of making a pull request after running the `add_torrents.sh` script, which adds torrents from a directory to the `.csv` file, after checking that they aren't already there, and that they have seeders.
Fix instructions. 2018-10-05 06:48:51 +00:00
			`[Click here](https://gitlab.com/dessalines/torrents.csv/forks/new) to fork this repo.`
Changing delimiter to ; Adding a find.sh script 2018-10-04 23:24:56 +00:00			```sh
Renaming to torrents.csv 2018-10-04 23:33:33 +00:00			`git clone https://gitlab.com/[MY_USER]/torrents.csv`
			`cd torrents.csv`
Changing delimiter to ; Adding a find.sh script 2018-10-04 23:24:56 +00:00			./add_torrents.sh MY_TORRENTS_DIR # `MY_TORRENTS_DIR` is `~/.local/share/data/qBittorrent/BT_backup/` for qBittorrent on linux, but you can search for where your torrents are stored for your client.
			`git commit -am "Adding my torrents"`
			`git push`
			```
Script mostly working. 2018-10-04 20:23:57 +00:00
Renaming to torrents.csv 2018-10-04 23:33:33 +00:00			`Then [click here](https://gitlab.com/dessalines/torrents.csv/merge_requests/new) to do a pull/merge request to my branch.`
Script mostly working. 2018-10-04 20:23:57 +00:00
Changing delimiter to ; Adding a find.sh script 2018-10-04 23:24:56 +00:00			`## How the file looks`
			```sh
			`infohash;name;size_bytes;created_unix;seeders;leechers;completed;scraped_date`
			`# torrents here...`
			```
Initial commit 2018-10-03 17:12:12 +00:00
Import of TPB Jan 2017 backup. Updating search and add scripts. Adding prune.sh 2018-10-08 05:43:12 +00:00			`## Requirements`

			`### Searching`
			`- [ripgrep](https://github.com/BurntSushi/ripgrep)`

			`### Uploading`
			`- [Torrent tracker scraper](https://github.com/ZigmundVonZaun/torrent-tracker-scraper)`
			`- [Transmission-cli](https://github.com/ZigmundVonZaun/torrent-tracker-scraper)`
			`- [Human Friendly](https://humanfriendly.readthedocs.io/en/latest/readme.html#command-line)`


Adding humanized size output to search. Fixes #1 2018-10-06 06:58:09 +00:00			`## Other info`

			`Torrents.csv` will only store torrents with at least one seeder to keep the file small, and will be periodically purged of non-seeded torrents, and sorted by seeders descending.
Initial commit 2018-10-03 17:12:12 +00:00
Import of TPB Jan 2017 backup. Updating search and add scripts. Adding prune.sh 2018-10-08 05:43:12 +00:00			`Its initially populated with a January 2017 backup of the pirate bay, but eventually scripts will be written that pull in new torrents daily.`

			`## Potential sources for new torrents`
			`- https://www.skytorrents.lol/top100`
			`- https://1337x.to/top-100`
			`- https://1337x.to/trending`