Commit Graph

859 Commits

Author SHA1 Message Date
Achim D. Brucker 39490ca490 Enforce block type to be code if it is not a comment. 2017-10-11 10:20:09 +01:00
Achim D. Brucker 91e0180151 Fixed indentation. 2017-10-11 09:46:39 +01:00
Achim D. Brucker a077d7e8b2 Fixed typo. 2017-10-11 09:43:54 +01:00
Achim D. Brucker dbdaa772dc Fixed typo. 2017-10-11 09:41:51 +01:00
Achim D. Brucker a4926aed19 Only store relative path for library files. 2017-10-11 09:22:27 +01:00
Achim D. Brucker 8dd745f826 Classify normalized detection as 'very likely library'. 2017-10-11 09:14:22 +01:00
Achim D. Brucker ee7ce8b446 Report stored library filename of detected libraries. 2017-10-11 08:48:20 +01:00
Achim D. Brucker 478500d797 Additional logging. 2017-10-11 08:38:36 +01:00
Achim D. Brucker 8c43fadfdb Basic implementation: check_md5_normalized(...). 2017-10-11 00:48:04 +01:00
Achim D. Brucker 154118cf50 Basic implementation: check_md5_decompressed(...). 2017-10-11 00:44:15 +01:00
Achim D. Brucker c6e5cb8511 Basic implementation: md5 checksum based library detection. 2017-10-11 00:40:06 +01:00
Achim D. Brucker c910e68575 Bug fix: counting of ERRORs. 2017-10-10 23:07:48 +01:00
Achim D. Brucker 518372c6f2 Fixed library/version computation for sub-tasks. 2017-10-10 23:02:21 +01:00
Achim D. Brucker 61010a6a01 Bug fix: library identification for multi-task jobs. 2017-10-10 22:16:46 +01:00
Achim D. Brucker 9ddddc50c4 Initial commit. 2017-10-10 20:32:30 +01:00
Achim D. Brucker 0a4fb222e9 Fixed links and access permissions. 2017-10-10 20:26:44 +01:00
Michael Herzberg 715b89f805 Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler 2017-10-10 18:55:48 +01:00
Michael Herzberg 63ae8ac4a7 Added missing fields for cdnjs and introduced new crxfile and libdet tables. 2017-10-10 18:55:28 +01:00
Achim D. Brucker 2f7fcd005a Increased number of parallel runs. 2017-10-10 17:19:27 +01:00
Michael Herzberg 6632cd0ded Added database update for cdnjs. 2017-10-10 15:35:02 +01:00
Michael Herzberg d1f8de19c1 Surpess log messages from requests lib. 2017-10-10 15:11:03 +01:00
Michael Herzberg 048990e8f8 Turned dbbackend into a package. 2017-10-10 15:10:41 +01:00
Michael Herzberg 301ad23d4c Use new review etc. table structure. 2017-10-09 17:18:01 +01:00
Michael Herzberg 08353665c1 Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler 2017-10-09 13:57:08 +01:00
Michael Herzberg 2b1e55c7ec Fixed import. 2017-10-09 13:56:22 +01:00
Achim D. Brucker 0b7c4bbcad Bug fix: print line ranges n case of machting joint string literals. 2017-10-09 11:59:44 +01:00
Achim D. Brucker ae8ea47ab8 Bug fix: printing of code blocks in case of string literal matches. 2017-10-09 11:57:57 +01:00
Achim D. Brucker aa143b2724 Sort ERRORs by time stamp. 2017-10-09 11:50:11 +01:00
Achim D. Brucker 88b8a1791c Added summary reporting. 2017-10-09 08:45:06 +01:00
Michael Herzberg 300a8c905a Only log last mysql exception as error, rest as warning. 2017-10-08 20:57:25 +01:00
Achim D. Brucker d166815852 Install python3-tabulate from Debian archive. 2017-10-08 17:17:41 +01:00
Achim D. Brucker 25c37d83c1 Silently correct 'name use count' exception from libmagic (caused by a but in the magic Python module). 2017-10-08 15:18:58 +01:00
Achim D. Brucker 97e5bbd16d Improved help text for output decoration. 2017-10-08 14:08:44 +01:00
Achim D. Brucker fabdca2ed0 Bug fix: classification of comments in decorated output. 2017-10-08 13:20:00 +01:00
Achim D. Brucker 45c2d062fe Reformatting. 2017-10-08 13:11:30 +01:00
Achim D. Brucker eedf1d5543 Removed debug output. 2017-10-08 13:11:08 +01:00
Achim D. Brucker 8dfbb1ce3a Naive approach for joining string literals (all literals in one code block are joined in a brute force manner). 2017-10-08 13:06:40 +01:00
Achim D. Brucker 1963a20b69 Report starting positions of string literals. 2017-10-08 12:03:50 +01:00
Achim D. Brucker 22a5ae7996 Only print matching string literals. 2017-10-08 11:38:24 +01:00
Achim D. Brucker b30d70f4cc Bug fix: colorize string literal matches. 2017-10-08 11:27:55 +01:00
Achim D. Brucker 5d81103092 Added string literals to decorated output. 2017-10-08 11:23:13 +01:00
Achim D. Brucker c253c775d0 Improved decorated output. 2017-10-08 10:30:40 +01:00
Michael Herzberg e06b7977fa Merge branch 'master' into production 2017-10-07 21:03:33 +01:00
Michael Herzberg b605f81313 Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler 2017-10-07 21:02:19 +01:00
Michael Herzberg 615b8f46a3 Fixed mysql caching. 2017-10-07 21:01:14 +01:00
Achim D. Brucker c8999eff2a Reformatting. 2017-10-07 21:00:17 +01:00
Achim D. Brucker cd3eef31d8 Limit parallel download to 24 and report ERRORs after download. 2017-10-07 19:31:43 +01:00
Achim D. Brucker d8e1132771 Bug fix: exitid file analysis. 2017-10-07 18:31:25 +01:00
Achim D. Brucker 2bfbd047ee Bug fix: tar file analysis. 2017-10-07 18:19:35 +01:00
Achim D. Brucker 8ab2652f7d Basic implementation of output-decoration levels 0,1, and 2. 2017-10-07 14:03:29 +01:00