local-sandbox
/
dnd-beyond-scrape
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
35 Commits
1 Branch
1 Tag
47 KiB
Shell 100%
 
Go to file
bel 04acc7ff4f woo 2022-07-04 11:51:58 -06:00
.gitignore gitinreo 2022-06-26 16:16:02 -06:00
README.md readme 2022-06-27 19:06:43 -06:00
deps.txt cush 2022-06-26 23:22:24 -06:00
meilisearch.sh meili scripting 2021-12-15 15:35:30 -07:00
scrape.sh woo 2022-07-04 11:51:58 -06:00
to_meili.sh update to meili for new scrape format 2022-07-03 21:18:20 -06:00
url.txt poc 2021-12-14 21:45:55 -07:00

README.md

dnd beyond scrape

  • run SEED=123 bash scrape.sh
  • see cached files, cookie, output in $TMPDIR/scrape.$SEED
  • may have to replace Cookie: in scrape.sh if expired

Todo

  • fix tables to pre-formatted
  • download and localize images (webp!)