Commit Graph

888 Commits

Author SHA1 Message Date
Achim D. Brucker 9f5d8f9b9e Added logs during creation of db connection. 2017-10-18 08:35:27 +01:00
Achim D. Brucker 6851223a6d Fixed log file name. 2017-10-18 08:35:04 +01:00
Achim D. Brucker 85b7f01751 Bug fix: name of log file. 2017-10-17 18:14:33 +01:00
Achim D. Brucker 2dc8408b6b Bug fix: added ARCHIVE. 2017-10-17 17:44:13 +01:00
Achim D. Brucker df2a3778de Bug fix: variable. 2017-10-17 15:42:03 +01:00
Achim D. Brucker 14da483046 Even more logging. 2017-10-17 15:17:29 +01:00
Achim D. Brucker 887f8ec3d2 Create backup if image before updating it. 2017-10-17 15:09:18 +01:00
Achim D. Brucker 9031a5cbb5 Added log file. 2017-10-17 06:50:48 +01:00
Achim D. Brucker 37ebd510c9 Reformatting. 2017-10-16 09:47:14 +01:00
Achim D. Brucker 4ee9c51ef7 Reformatting. 2017-10-16 09:42:43 +01:00
Achim D. Brucker fc33abb7a6 Fixed logging. 2017-10-16 09:35:53 +01:00
Achim D. Brucker 8780eb8f2f Added further logging output (info). 2017-10-16 05:36:59 +01:00
Achim D. Brucker bbfbbed35a Identify ressource/media files using the file library. 2017-10-15 15:34:45 +01:00
Achim D. Brucker f22c234267 Initial commit. 2017-10-15 14:06:20 +01:00
Michael Herzberg afe137ba36 Integrated last_crx_etag into last_crx. 2017-10-14 19:59:46 +01:00
Achim D. Brucker 8dbf867183 Added command line option to avoid use of external database. 2017-10-14 19:23:51 +01:00
Achim D. Brucker 64bc9bd90d Make use of data base with md5 sums optional. 2017-10-14 19:17:37 +01:00
Michael Herzberg ea800da613 Create new thread after 100 extensions. 2017-10-13 15:54:29 +01:00
Achim D. Brucker 03b08db905 Bug fix: download all extension in parallel mode. 2017-10-13 10:35:51 +01:00
Michael Herzberg f51bcfbf46 Use con object from db.py. 2017-10-12 16:01:45 +01:00
Achim D. Brucker 1e412226ee Bug fix: use raw strings for regexps to simplify regexps. 2017-10-12 06:35:52 +01:00
Achim D. Brucker cd9a40438b Bug fix: reporting of matching file names in crx files. 2017-10-12 06:19:42 +01:00
Achim D. Brucker b3240c48ef Bug fix: error reporting. 2017-10-12 00:05:21 +01:00
Achim D. Brucker b7bed2a341 Bug fix: log of corupted tar archives. 2017-10-12 00:01:41 +01:00
Achim D. Brucker 21d9b66fd0 Implemented case insentive match (command line option). 2017-10-11 22:41:54 +01:00
Achim D. Brucker 1b8fc1d45d Ensure that default for parallelization is 1. 2017-10-11 21:44:06 +01:00
Achim D. Brucker d3b7dea4d8 Added dectection based on file sizes after stripping white spaces. 2017-10-11 20:18:15 +01:00
Achim D. Brucker 10a80e2861 Compute size size after stripping. 2017-10-11 20:16:33 +01:00
Achim D. Brucker 7eb3955db5 Increase base size of cdnjs image. 2017-10-11 10:37:57 +01:00
Achim D. Brucker 39490ca490 Enforce block type to be code if it is not a comment. 2017-10-11 10:20:09 +01:00
Achim D. Brucker 91e0180151 Fixed indentation. 2017-10-11 09:46:39 +01:00
Achim D. Brucker a077d7e8b2 Fixed typo. 2017-10-11 09:43:54 +01:00
Achim D. Brucker dbdaa772dc Fixed typo. 2017-10-11 09:41:51 +01:00
Achim D. Brucker a4926aed19 Only store relative path for library files. 2017-10-11 09:22:27 +01:00
Achim D. Brucker 8dd745f826 Classify normalized detection as 'very likely library'. 2017-10-11 09:14:22 +01:00
Achim D. Brucker ee7ce8b446 Report stored library filename of detected libraries. 2017-10-11 08:48:20 +01:00
Achim D. Brucker 478500d797 Additional logging. 2017-10-11 08:38:36 +01:00
Achim D. Brucker 8c43fadfdb Basic implementation: check_md5_normalized(...). 2017-10-11 00:48:04 +01:00
Achim D. Brucker 154118cf50 Basic implementation: check_md5_decompressed(...). 2017-10-11 00:44:15 +01:00
Achim D. Brucker c6e5cb8511 Basic implementation: md5 checksum based library detection. 2017-10-11 00:40:06 +01:00
Achim D. Brucker c910e68575 Bug fix: counting of ERRORs. 2017-10-10 23:07:48 +01:00
Achim D. Brucker 518372c6f2 Fixed library/version computation for sub-tasks. 2017-10-10 23:02:21 +01:00
Achim D. Brucker 61010a6a01 Bug fix: library identification for multi-task jobs. 2017-10-10 22:16:46 +01:00
Achim D. Brucker 9ddddc50c4 Initial commit. 2017-10-10 20:32:30 +01:00
Achim D. Brucker 0a4fb222e9 Fixed links and access permissions. 2017-10-10 20:26:44 +01:00
Michael Herzberg 715b89f805 Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler 2017-10-10 18:55:48 +01:00
Michael Herzberg 63ae8ac4a7 Added missing fields for cdnjs and introduced new crxfile and libdet tables. 2017-10-10 18:55:28 +01:00
Achim D. Brucker 2f7fcd005a Increased number of parallel runs. 2017-10-10 17:19:27 +01:00
Michael Herzberg 6632cd0ded Added database update for cdnjs. 2017-10-10 15:35:02 +01:00
Michael Herzberg d1f8de19c1 Surpess log messages from requests lib. 2017-10-10 15:11:03 +01:00