Commit Graph

552 Commits

Author SHA1 Message Date
Michael Herzberg abd9605ebc Use python3.5 for all files. 2017-09-01 14:12:05 +01:00
Michael Herzberg cbcb3bc3b0 Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler 2017-09-01 13:30:57 +01:00
Michael Herzberg 5c24608c4d Added --max-discover <N> option to limit the number of new extensions. 2017-09-01 13:30:42 +01:00
Achim D. Brucker 258269abb6 Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler 2017-09-01 12:14:53 +01:00
Achim D. Brucker 8289d50d38 Download all extensions in parallel and later do a second download for a subset including forums/reviews. 2017-09-01 12:14:39 +01:00
Michael Herzberg b5fd382ab8 Use utf8mb4 for mysql connections. 2017-09-01 12:11:37 +01:00
Achim D. Brucker 53f080ba36 Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler 2017-09-01 12:02:17 +01:00
Achim D. Brucker 22264fb9e0 Changed download order: first download parallel all extensions without forum/review download, then download extensions with forums. 2017-09-01 12:02:12 +01:00
Michael Herzberg 62c353f647 Removed crawling restriction to 10 extids. 2017-09-01 10:42:21 +01:00
Michael Herzberg 21a7741f0c Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler 2017-09-01 08:15:36 +01:00
Michael Herzberg 05ffdc6e24 Added explicit utf-8 request to mysql connector. 2017-09-01 08:15:22 +01:00
Achim D. Brucker 9446c20d01 Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler 2017-08-31 23:45:00 +01:00
Achim D. Brucker 883e7ddcd8 Report details of matches. 2017-08-31 23:44:51 +01:00
Michael Herzberg e06d3f4ac4 Reduced timeout and fixed logging. 2017-08-31 23:01:05 +01:00
Achim D. Brucker b63791bdb4 Reformatting. 2017-08-31 21:50:12 +01:00
Achim D. Brucker e0db2a5f47 Added detection details. 2017-08-31 08:43:19 +01:00
Achim D. Brucker 2831362584 JSON prettify. 2017-08-31 08:27:53 +01:00
Achim D. Brucker d52b2bab13 Sorted jQuery entries wrt version number. 2017-08-31 08:22:24 +01:00
Achim D. Brucker 2437606ab2 Fixed markdown. 2017-08-30 23:25:49 +01:00
Achim D. Brucker 47b2cb6d9a Fixed merge conflict. 2017-08-30 23:22:09 +01:00
Achim D. Brucker 168ec3bf36 Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler 2017-08-30 22:57:47 +01:00
Achim D. Brucker bd944c0b9d jQuery 3.x information added. 2017-08-30 22:57:41 +01:00
Michael Herzberg ccf43de3d0 Pad process id to 6 chars. 2017-08-30 20:05:17 +01:00
Michael Herzberg 906d81ab86 Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler 2017-08-30 19:59:33 +01:00
Michael Herzberg 4145f88a94 MySQL wait +/- 20%. 2017-08-30 19:59:15 +01:00
Achim D. Brucker e70cf5d28f Bug fix: missing hex decoding of md5/sha1 hashes. 2017-08-30 19:25:58 +01:00
Michael Herzberg 8bab1c0fac Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler 2017-08-30 18:55:20 +01:00
Michael Herzberg b76eef12d5 Added randomized delay for MySQL. 2017-08-30 18:55:13 +01:00
Achim D. Brucker 3c9ccb4da9 Merge with upstream. 2017-08-30 17:18:31 +01:00
Achim D. Brucker 31ffa42a77 Initial commit: strings for JavaScript on stereoids. 2017-08-30 17:15:51 +01:00
Michael Herzberg bde59c5040 Fixed crx_etag select bug and some logging. 2017-08-30 16:32:36 +01:00
Achim D. Brucker b70272596f Renamed rx-jsdecompose -> crx-jsinventory to make purpose more descriptive. 2017-08-30 16:14:29 +01:00
Michael Herzberg b024f5b6d5 Don't zip log files. 2017-08-30 16:04:02 +01:00
Michael Herzberg cbd2dea820 Removed everything related to sqlite and updated README. 2017-08-30 15:38:04 +01:00
Michael Herzberg c7a808db3f Don't process replies if there are none. 2017-08-30 15:15:12 +01:00
Michael Herzberg 5f234d8539 Improved logging. 2017-08-30 15:12:54 +01:00
Michael Herzberg 12c111ca11 Once more, make mysql the default. Also, increased timeout. 2017-08-30 12:13:25 +01:00
Michael Herzberg 9b8a693a5f Changed logging a little bit. 2017-08-30 12:12:57 +01:00
Michael Herzberg f8c8382919 Merge. 2017-08-30 11:42:12 +01:00
Michael Herzberg 6a9a1cda63 Moved crx logging to where crx will actually be parsed. 2017-08-30 11:29:30 +01:00
Michael Herzberg c7e36cec81 Exclude archive dir when pushing to sharc. 2017-08-30 10:11:25 +01:00
Michael Herzberg 405ab32ffd zip log files 2017-08-30 10:09:15 +01:00
Michael Herzberg d99142f8d0 Added and changed a few columns. 2017-08-30 10:07:06 +01:00
Achim D. Brucker d6d43cfb0a Bug fix: printing of detection method. 2017-08-30 09:56:35 +01:00
Achim D. Brucker 3269a4900c Bug fix: printing of file name in Javascript mode. 2017-08-30 09:56:19 +01:00
Achim D. Brucker b5b6a17ee5 Support analysis of crx files and plain JavaScript files. 2017-08-30 09:11:55 +01:00
Achim D. Brucker cacdf1f727 Refactoring. 2017-08-30 08:28:39 +01:00
Achim D. Brucker 85d6ec084d Bug fix: missing detection method for empty files. 2017-08-30 08:24:16 +01:00
Achim D. Brucker d7120fad45 Bug fix: update char if loops reads another char (next_char). This avoids missing an escape character or a newline. 2017-08-30 01:43:18 +01:00
Achim D. Brucker 9be998efd1 Ignore vscode workspace configuration. 2017-08-30 00:52:47 +01:00