A Python crawler for extensions from the Chrome Web Store.
Go to file
Michael Herzberg 4c01b95f69 Added ratingValue and ratingCount to db. 2017-07-05 14:23:45 +01:00
ExtensionCrawler Added ratingValue and ratingCount to db. 2017-07-05 14:23:45 +01:00
scripts Added two scripts. 2017-06-22 19:41:11 +01:00
.gitignore Added .swp file to gitignore. 2017-06-20 08:09:40 +01:00
LICENSE initial commit 2016-09-08 20:43:35 +02:00
README.md Removed outdated description. 2017-01-28 13:34:50 +00:00
crawler Added missing parallel parameter to second call of update_extensions. 2017-06-21 15:26:48 +01:00
create_db Make db path configurable. 2017-06-22 17:46:18 +01:00
crx-tool Renaming. 2017-03-19 16:34:45 +00:00

README.md

ExtensionCrawler

A collection of utilities for downloading and analyzing browser extension from the Chrome Web store.

  • crawler: A crawler for extensions from the Chrome Web Store.
  • permstats.py: A tool for generating statistical data from the crawled extensions.
  • crx-tool.py: A tool for analyzing and extracting *.crx files (i.e., Chrome extensions). Calling crx-tool.py <extension>.crx will check the integrity of the extension.

All utilities are written in Python 3.x. The following non-standard modules might be required:

  • requests (apt-get install python3-requests)
  • dateutil (apt-get install python3-dateutil)
  • jsmin (apt-get install python3-jsmin)

Team

License

This project is licensed under the GPL 3.0 (or any later version).