anything-llm/collector/scripts
Sean Hatfield 7edfccaf9a
Adding url uploads to document picker (#375)
* WIP adding url uploads to document picker

* fix manual script for uploading url to custom-documents

* fix metadata for url scraping

* wip url parsing

* update how async link scraping works

* docker-compose defaults added
no autocomplete on URLs

---------

Co-authored-by: timothycarambat <rambat1010@gmail.com>
2023-11-16 17:15:01 -08:00
..
watch normalize parser struct for all file types (#321) 2023-11-01 16:44:02 -07:00
__init__.py inital commit 2023-06-03 19:28:07 -07:00
gitbook.py Franzbischoff document improvements (#241) 2023-09-18 16:21:37 -07:00
link_utils.py Adding url uploads to document picker (#375) 2023-11-16 17:15:01 -08:00
link.py Adding url uploads to document picker (#375) 2023-11-16 17:15:01 -08:00
medium_utils.py inital commit 2023-06-03 19:28:07 -07:00
medium.py Docker support (#34) 2023-06-13 11:26:11 -07:00
sitemap.py dockerfile cleanup; enforce text LF line endings (#81) 2023-06-17 20:18:01 -07:00
substack_utils.py Add id to all metadata to prevent errors in frontend document picker (#378) 2023-11-16 14:36:26 -08:00
substack.py Docker support (#34) 2023-06-13 11:26:11 -07:00
twitter.py Add id to all metadata to prevent errors in frontend document picker (#378) 2023-11-16 14:36:26 -08:00
utils.py inital commit 2023-06-03 19:28:07 -07:00
youtube.py Docker support (#34) 2023-06-13 11:26:11 -07:00
yt_utils.py Add id to all metadata to prevent errors in frontend document picker (#378) 2023-11-16 14:36:26 -08:00