Commit Graph

915 Commits

Author SHA1 Message Date
Michael Herzberg 615b8f46a3 Fixed mysql caching. 2017-10-07 21:01:14 +01:00
Achim D. Brucker c8999eff2a Reformatting. 2017-10-07 21:00:17 +01:00
Achim D. Brucker cd3eef31d8 Limit parallel download to 24 and report ERRORs after download. 2017-10-07 19:31:43 +01:00
Achim D. Brucker d8e1132771 Bug fix: exitid file analysis. 2017-10-07 18:31:25 +01:00
Achim D. Brucker 2bfbd047ee Bug fix: tar file analysis. 2017-10-07 18:19:35 +01:00
Achim D. Brucker 8ab2652f7d Basic implementation of output-decoration levels 0,1, and 2. 2017-10-07 14:03:29 +01:00
Michael Herzberg 2abc386f48 Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler 2017-10-06 20:13:16 +01:00
Michael Herzberg 6372c62336 Removed sorting again. 2017-10-06 20:13:08 +01:00
Achim D. Brucker 1ee76d9817 Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler 2017-10-06 19:36:12 +01:00
Achim D. Brucker eb5abe6d9b Implemented option for colorized output. 2017-10-06 19:35:11 +01:00
Achim D. Brucker 937f14bed5 Fixed tarfile name. 2017-10-06 18:36:24 +01:00
Achim D. Brucker ac76c8c1e4 Reformatting. 2017-10-06 18:33:56 +01:00
Achim D. Brucker c1750838f1 Added support for tar files. 2017-10-06 18:33:35 +01:00
Achim D. Brucker ec1d0bddbb Added crx filename to path and added command line options for selection date range. 2017-10-06 16:56:56 +01:00
Achim D. Brucker 41f7c3f082 Refactoring: support filenames with c-style comments check in own function. 2017-10-06 16:14:32 +01:00
Achim D. Brucker cf977bade5 Restored crx file support. 2017-10-06 16:02:33 +01:00
Achim D. Brucker 5dde0a79c4 Restored basic functionalty for single files. 2017-10-06 15:47:59 +01:00
Michael Herzberg d6869455a8 Sort extension ids before processing. 2017-10-06 12:12:49 +01:00
Michael Herzberg d05194b9bb Group cached commits for efficiency. 2017-10-06 12:08:21 +01:00
Achim D. Brucker ff8023073f Added support for -n and -N. 2017-10-05 22:33:08 +01:00
Michael Herzberg 2cb56edd9b Adjusted retries for create-db. 2017-10-05 11:14:59 +01:00
Michael Herzberg 87af0019b4 Catch mysql exception. 2017-10-05 11:00:19 +01:00
Michael Herzberg 55ec6ac5b8 Hopefully fixed singularity locale setting. 2017-10-04 23:17:36 +01:00
Michael Herzberg 980f143859 Changed name of singularity image file. 2017-10-04 23:17:06 +01:00
Achim D. Brucker cfaa7ec21e Added compute_tasks. 2017-10-04 22:06:17 +01:00
Michael Herzberg 6ba73c2ed9 Changed autocommit behaviour. 2017-10-04 20:56:47 +01:00
Achim D. Brucker 4b5685bf5c Further refinement of command line interface. 2017-10-03 21:08:09 +01:00
Achim D. Brucker 404ed0b3d6 Added efault for archive directory. 2017-10-02 20:28:57 +01:00
Achim D. Brucker 36a139e4ff Added verbose mode. 2017-10-02 20:23:45 +01:00
Achim D. Brucker b8a4770d60 Reformatting. 2017-10-01 08:39:44 +01:00
Achim D. Brucker 583d77f0b1 Updated proposed command line arguments. 2017-09-30 07:26:38 +01:00
Achim D. Brucker d92407e444 Fixed strings_groups. 2017-09-29 05:46:25 +01:00
Achim D. Brucker f3a9bd559a First proposal for user interface using argparse. 2017-09-28 06:13:03 +01:00
Achim D. Brucker a7ff2cc466 Inital setup (not yet functional) using argparse. 2017-09-27 23:24:45 +01:00
Michael Herzberg f37e19f46a Updated grepper. 2017-09-27 14:05:16 +01:00
Achim D. Brucker 2cfeb9b88c Fixed help message. 2017-09-26 09:55:46 +01:00
Achim D. Brucker 1ab03735b5 Added simple runscript. 2017-09-26 09:43:05 +01:00
Achim D. Brucker fd98147fbf Add ExtensionCrawler directory to PATH (instead of linking selected binaires to /usr/local/bin). 2017-09-26 09:13:31 +01:00
Achim D. Brucker f0399fc73f Updated image name(s). 2017-09-26 08:56:00 +01:00
Achim D. Brucker 82a6472bc4 Include default archive directory (or link to external archive directory). 2017-09-26 08:55:09 +01:00
Achim D. Brucker b8381fc879 Added command line options for overwriting existing image (--force) and including a clone of the CDNJS repository (--cdnjs). 2017-09-26 08:20:49 +01:00
Achim D. Brucker 32c88a543b Updated debian mirror. 2017-09-26 00:06:00 +01:00
Achim D. Brucker d7624a37d7 Add cdnjs repository if image ends with -cdnjs.img. 2017-09-26 00:01:03 +01:00
Achim D. Brucker b8267a75cc Renamed singularity image and modularized build script. 2017-09-25 22:44:20 +01:00
Achim D. Brucker 486b6fac49 Changed locales to en_US and install python3-jsbeautifier from Debian. 2017-09-25 22:42:29 +01:00
Achim D. Brucker 4c177900ea Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler 2017-09-23 22:54:51 +01:00
Achim D. Brucker 7fd244d502 Reformatting 2017-09-23 22:41:04 +01:00
Michael Herzberg ed57613894 Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler 2017-09-22 13:09:23 +01:00
Michael Herzberg 3b6eda8dff Fixed missing backslash. 2017-09-22 13:09:15 +01:00
Achim D. Brucker 1c02631443 Various minor improvements. 2017-09-22 08:44:10 +01:00