Commit Graph

831 Commits

Author SHA1 Message Date
Achim D. Brucker 9031a5cbb5 Added log file. 2017-10-17 06:50:48 +01:00
Achim D. Brucker 37ebd510c9 Reformatting. 2017-10-16 09:47:14 +01:00
Achim D. Brucker 4ee9c51ef7 Reformatting. 2017-10-16 09:42:43 +01:00
Achim D. Brucker fc33abb7a6 Fixed logging. 2017-10-16 09:35:53 +01:00
Achim D. Brucker 8780eb8f2f Added further logging output (info). 2017-10-16 05:36:59 +01:00
Achim D. Brucker bbfbbed35a Identify ressource/media files using the file library. 2017-10-15 15:34:45 +01:00
Achim D. Brucker f22c234267 Initial commit. 2017-10-15 14:06:20 +01:00
Michael Herzberg afe137ba36 Integrated last_crx_etag into last_crx. 2017-10-14 19:59:46 +01:00
Achim D. Brucker 8dbf867183 Added command line option to avoid use of external database. 2017-10-14 19:23:51 +01:00
Achim D. Brucker 64bc9bd90d Make use of data base with md5 sums optional. 2017-10-14 19:17:37 +01:00
Michael Herzberg ea800da613 Create new thread after 100 extensions. 2017-10-13 15:54:29 +01:00
Achim D. Brucker 03b08db905 Bug fix: download all extension in parallel mode. 2017-10-13 10:35:51 +01:00
Michael Herzberg f51bcfbf46 Use con object from db.py. 2017-10-12 16:01:45 +01:00
Achim D. Brucker 1e412226ee Bug fix: use raw strings for regexps to simplify regexps. 2017-10-12 06:35:52 +01:00
Achim D. Brucker cd9a40438b Bug fix: reporting of matching file names in crx files. 2017-10-12 06:19:42 +01:00
Achim D. Brucker b3240c48ef Bug fix: error reporting. 2017-10-12 00:05:21 +01:00
Achim D. Brucker b7bed2a341 Bug fix: log of corupted tar archives. 2017-10-12 00:01:41 +01:00
Achim D. Brucker 21d9b66fd0 Implemented case insentive match (command line option). 2017-10-11 22:41:54 +01:00
Achim D. Brucker 1b8fc1d45d Ensure that default for parallelization is 1. 2017-10-11 21:44:06 +01:00
Achim D. Brucker d3b7dea4d8 Added dectection based on file sizes after stripping white spaces. 2017-10-11 20:18:15 +01:00
Achim D. Brucker 10a80e2861 Compute size size after stripping. 2017-10-11 20:16:33 +01:00
Achim D. Brucker 7eb3955db5 Increase base size of cdnjs image. 2017-10-11 10:37:57 +01:00
Achim D. Brucker 39490ca490 Enforce block type to be code if it is not a comment. 2017-10-11 10:20:09 +01:00
Achim D. Brucker 91e0180151 Fixed indentation. 2017-10-11 09:46:39 +01:00
Achim D. Brucker a077d7e8b2 Fixed typo. 2017-10-11 09:43:54 +01:00
Achim D. Brucker dbdaa772dc Fixed typo. 2017-10-11 09:41:51 +01:00
Achim D. Brucker a4926aed19 Only store relative path for library files. 2017-10-11 09:22:27 +01:00
Achim D. Brucker 8dd745f826 Classify normalized detection as 'very likely library'. 2017-10-11 09:14:22 +01:00
Achim D. Brucker ee7ce8b446 Report stored library filename of detected libraries. 2017-10-11 08:48:20 +01:00
Achim D. Brucker 478500d797 Additional logging. 2017-10-11 08:38:36 +01:00
Achim D. Brucker 8c43fadfdb Basic implementation: check_md5_normalized(...). 2017-10-11 00:48:04 +01:00
Achim D. Brucker 154118cf50 Basic implementation: check_md5_decompressed(...). 2017-10-11 00:44:15 +01:00
Achim D. Brucker c6e5cb8511 Basic implementation: md5 checksum based library detection. 2017-10-11 00:40:06 +01:00
Achim D. Brucker c910e68575 Bug fix: counting of ERRORs. 2017-10-10 23:07:48 +01:00
Achim D. Brucker 518372c6f2 Fixed library/version computation for sub-tasks. 2017-10-10 23:02:21 +01:00
Achim D. Brucker 61010a6a01 Bug fix: library identification for multi-task jobs. 2017-10-10 22:16:46 +01:00
Achim D. Brucker 9ddddc50c4 Initial commit. 2017-10-10 20:32:30 +01:00
Achim D. Brucker 0a4fb222e9 Fixed links and access permissions. 2017-10-10 20:26:44 +01:00
Michael Herzberg 715b89f805 Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler 2017-10-10 18:55:48 +01:00
Michael Herzberg 63ae8ac4a7 Added missing fields for cdnjs and introduced new crxfile and libdet tables. 2017-10-10 18:55:28 +01:00
Achim D. Brucker 2f7fcd005a Increased number of parallel runs. 2017-10-10 17:19:27 +01:00
Michael Herzberg 6632cd0ded Added database update for cdnjs. 2017-10-10 15:35:02 +01:00
Michael Herzberg d1f8de19c1 Surpess log messages from requests lib. 2017-10-10 15:11:03 +01:00
Michael Herzberg 048990e8f8 Turned dbbackend into a package. 2017-10-10 15:10:41 +01:00
Michael Herzberg 301ad23d4c Use new review etc. table structure. 2017-10-09 17:18:01 +01:00
Michael Herzberg 08353665c1 Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler 2017-10-09 13:57:08 +01:00
Michael Herzberg 2b1e55c7ec Fixed import. 2017-10-09 13:56:22 +01:00
Achim D. Brucker 0b7c4bbcad Bug fix: print line ranges n case of machting joint string literals. 2017-10-09 11:59:44 +01:00
Achim D. Brucker ae8ea47ab8 Bug fix: printing of code blocks in case of string literal matches. 2017-10-09 11:57:57 +01:00
Achim D. Brucker aa143b2724 Sort ERRORs by time stamp. 2017-10-09 11:50:11 +01:00