Commit Graph

677 Commits

Author SHA1 Message Date
Achim D. Brucker f0399fc73f Updated image name(s). 2017-09-26 08:56:00 +01:00
Achim D. Brucker 82a6472bc4 Include default archive directory (or link to external archive directory). 2017-09-26 08:55:09 +01:00
Achim D. Brucker b8381fc879 Added command line options for overwriting existing image (--force) and including a clone of the CDNJS repository (--cdnjs). 2017-09-26 08:20:49 +01:00
Achim D. Brucker 32c88a543b Updated debian mirror. 2017-09-26 00:06:00 +01:00
Achim D. Brucker d7624a37d7 Add cdnjs repository if image ends with -cdnjs.img. 2017-09-26 00:01:03 +01:00
Achim D. Brucker b8267a75cc Renamed singularity image and modularized build script. 2017-09-25 22:44:20 +01:00
Achim D. Brucker 486b6fac49 Changed locales to en_US and install python3-jsbeautifier from Debian. 2017-09-25 22:42:29 +01:00
Achim D. Brucker 4c177900ea Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler 2017-09-23 22:54:51 +01:00
Achim D. Brucker 7fd244d502 Reformatting 2017-09-23 22:41:04 +01:00
Michael Herzberg ed57613894 Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler 2017-09-22 13:09:23 +01:00
Michael Herzberg 3b6eda8dff Fixed missing backslash. 2017-09-22 13:09:15 +01:00
Achim D. Brucker 1c02631443 Various minor improvements. 2017-09-22 08:44:10 +01:00
Achim D. Brucker e63a13ae09 Bug fix: decompression. 2017-09-22 08:42:02 +01:00
Achim D. Brucker 8cca933d83 Added initial logging setup. 2017-09-22 08:01:09 +01:00
Achim D. Brucker da11d49f76 Skip extensiosn with no crx file. 2017-09-22 00:55:49 +01:00
Achim D. Brucker 037949e556 Report extid containing files that have content matching specified regesp. 2017-09-22 00:39:54 +01:00
Achim D. Brucker 0b011bedf8 Fixed typo. 2017-09-22 00:18:16 +01:00
Achim D. Brucker 11574fe783 Ignore empty files. 2017-09-22 00:15:46 +01:00
Achim D. Brucker 2344d2ac97 Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler 2017-09-21 23:35:25 +01:00
Achim D. Brucker ed4a8f65be Implemented analysis of groups/chunks of extensions from archive. 2017-09-21 23:35:19 +01:00
Achim D. Brucker e07cd21cfc Basic support for tar files and extensions ids. 2017-09-21 22:23:50 +01:00
Achim D. Brucker 712bfff805 Reformating. 2017-09-21 21:12:00 +01:00
Achim D. Brucker c24f4c4f9e Refactoring and new feature: -b option for beautifying JavaScript code. 2017-09-21 21:11:16 +01:00
Michael Herzberg 97f752881b Added extension id file support and increased memory for create-db job to 4G. 2017-09-21 20:09:00 +01:00
Michael Herzberg 854ca1f9f5 Added extfind util. 2017-09-21 15:40:20 +01:00
Michael Herzberg 115f7668ba Added jsbeautifier dependency for grepper. 2017-09-21 11:05:19 +01:00
Achim D. Brucker e340264c47 Extended help message. 2017-09-20 17:52:51 +01:00
Achim D. Brucker 794bdfccfc Stub for handling tar archives. 2017-09-20 17:48:03 +01:00
Michael Herzberg 99ded090d4 Add time to sge scripts. 2017-09-20 17:13:52 +01:00
Michael Herzberg 8955661e43 Also use singularity for grepper scripts. 2017-09-20 15:19:30 +01:00
Michael Herzberg f43d0734fc Fixed locales. 2017-09-20 13:32:47 +01:00
Michael Herzberg 50446b7fb2 Added missing variable 2017-09-20 11:58:56 +01:00
Michael Herzberg 93f7c2823b Added missing utf-8 encoding for python. 2017-09-20 11:48:51 +01:00
Michael Herzberg 543c8d7fc8 Added singularity image for create-db. 2017-09-20 11:37:57 +01:00
Achim D. Brucker e4245ed1dd Reformatting. 2017-09-20 10:03:14 +01:00
Achim D. Brucker a63dd53e45 Refactoring. 2017-09-20 10:02:02 +01:00
Achim D. Brucker 0cb0a4226d Added option for passing a list with libs to update. 2017-09-20 07:57:14 +01:00
Michael Herzberg 9a356630ba cd into basedir before executing sharc job. 2017-09-19 17:13:59 +01:00
Michael Herzberg 4712e15249 Fixed autocommit bug. 2017-09-19 17:09:35 +01:00
Achim D. Brucker 5bd7a70813 Added missing help text for -a. 2017-09-19 10:11:56 +01:00
Achim D. Brucker f642f44ea8 Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler 2017-09-19 10:08:35 +01:00
Achim D. Brucker 6ffa08282f Added archive/basedir command line argument. 2017-09-19 10:08:05 +01:00
Achim D. Brucker 50a7ba8a91 Minor refactoring. 2017-09-19 10:02:46 +01:00
Achim D. Brucker 4f84c5626d Minor refactoring. 2017-09-19 09:16:32 +01:00
Michael Herzberg 98a2d69ebb This time actually disable annoying HTTPS log messages. 2017-09-18 13:41:54 +01:00
Michael Herzberg cee90ececc Moved urllib logger config. 2017-09-18 12:59:52 +01:00
Achim D. Brucker 061622f588 Refactoring: stub of new main analysis method. 2017-09-18 09:09:00 +01:00
Achim D. Brucker aadbc5aa0c Refactoring: removed unused variables. 2017-09-18 00:35:35 +01:00
Achim D. Brucker 50b91d3a35 Renaming jsFilename -> filename. 2017-09-18 00:30:55 +01:00
Achim D. Brucker 15704a3c10 Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler 2017-09-17 19:06:52 +01:00