Achim D. Brucker 3ed43f036d | ||
---|---|---|
ExtensionCrawler | ||
.gitignore | ||
LICENSE | ||
README.md | ||
crawler | ||
crawler.py | ||
crx-tool.py | ||
discover_extensions.py | ||
parse_sitemap | ||
permstats.py |
README.md
ExtensionCrawler
A collection of utilities for downloading and analyzing browser extension from the Chrome Web store.
crawler.py
: A crawler for extensions from the Chrome Web Store. Callingcrawler.py
will downloads 200 extensions from all categories into a folderdownloaded
in the current directory. In case an extension has already been downloaded, the script skips it.permstats.py
: A tool for generating statistical data from the crawled extensions.crx-tool.py
: A tool for analyzing and extracting*.crx
files (i.e., Chrome extensions). Callingcrx-tool.py <extension>.crx
will check the integrity of the extension.
All utilities are written in Python 3.x. The following non-standard modules might be required:
- requests (
apt-get install python3-requests
) - dateutil (
apt-get install python3-dateutil
) - jsmin (
apt-get install python3-jsmin
)
Team
License
This project is licensed under the GPL 3.0 (or any later version).