Commit Graph

836 Commits

Author SHA1 Message Date
Achim D. Brucker e0d587cd94 Reformatting. 2017-11-23 21:57:58 +00:00
Achim D. Brucker 41bfe0cbf0 Reformatting. 2017-11-22 23:08:12 +00:00
Achim D. Brucker 06caca81e9 Store simhash in data base. 2017-11-22 06:52:31 +00:00
Achim D. Brucker f7cdc03133 Compute simhash for string representation of binary data. 2017-11-21 07:43:49 +00:00
Achim D. Brucker 52045ed53d Reformatting. 2017-11-20 22:42:21 +00:00
Achim D. Brucker 76c4c57ea3 Basic integration of simhash computation. 2017-11-20 22:41:31 +00:00
Achim D. Brucker 6ba5906ffb Added docstring. 2017-11-20 20:25:40 +00:00
Achim D. Brucker 74da2e9c08 Initial simhash integration. 2017-11-19 00:36:15 +00:00
Achim D. Brucker dbd0ff6bf3 Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler 2017-11-18 23:21:33 +00:00
Achim D. Brucker acfdb9ee50 Removed unused function analyse_comment_blocks. 2017-11-18 23:21:19 +00:00
Achim D. Brucker d63207410b Removed unused function. 2017-11-18 23:19:23 +00:00
Achim D. Brucker e3519f012d Reformatting. 2017-11-17 16:58:48 +00:00
Achim D. Brucker 32c08672d9 Added log output for failed data decoding. 2017-11-16 07:13:55 +00:00
Achim D. Brucker 64e0054975 Added logging infrastructure. 2017-11-16 07:08:42 +00:00
Achim D. Brucker 3db3435c07 Refactoring of heursitic detection stubs. 2017-11-15 08:05:40 +00:00
Achim D. Brucker c5dce7bcd0 Fixed decoding of content (str_data). 2017-11-15 07:12:41 +00:00
Achim D. Brucker 0667c5e0f2 Removed outdated cdnjs crawler (replaced by git miner instead). 2017-11-13 17:05:37 +00:00
Achim D. Brucker 24bdd9a1c5 Added log messages for cron report. 2017-11-12 14:49:51 +00:00
Achim D. Brucker 91e6014c6c Moved to single-threaded mode. 2017-11-12 14:07:25 +00:00
Achim D. Brucker 4cb49f2281 Merge branch 'production' 2017-11-11 21:56:33 +00:00
Achim D. Brucker 9bd283f35a Fixed use of append. 2017-11-10 00:13:06 +00:00
Achim D. Brucker 7dfbdac670 Disabled parallel updates (for debugging a deadlock situation). 2017-11-09 23:38:05 +00:00
Achim D. Brucker 5cc7a92f90 Fixed typo. 2017-11-09 00:17:09 +00:00
Achim D. Brucker d8956bae04 Updated latest python dependency. 2017-11-08 22:11:15 +00:00
Achim D. Brucker ac910bf819 Updated python version to 3.6. 2017-11-07 20:58:24 +00:00
Achim D. Brucker 631f461d1f Removed not supported connection_timeout parameter. 2017-11-06 06:11:14 +00:00
Achim D. Brucker d0b173c55f Disable automatic python module update. 2017-11-05 20:15:05 +00:00
Achim D. Brucker 6279bd9909 Fixed syntax error. 2017-11-05 20:14:12 +00:00
Achim D. Brucker 15079496cc Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler 2017-11-05 00:07:23 +00:00
Achim D. Brucker fcab770233 Reformatting. 2017-11-05 00:07:04 +00:00
Achim D. Brucker 07a7b346c7 Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler 2017-11-04 23:14:27 +00:00
Achim D. Brucker 58b317b95a Reformatting. 2017-11-04 19:27:34 +00:00
Achim D. Brucker 62bb639d67 Reformatting. 2017-11-04 19:27:27 +00:00
Achim D. Brucker 0db22c3217 Reformatting. 2017-11-04 19:27:21 +00:00
Achim D. Brucker 7d1f41589f Reformatting. 2017-11-04 19:27:15 +00:00
Achim D. Brucker 676bdcb0c0 Updated python dependencies. 2017-11-03 21:17:21 +00:00
Achim D. Brucker 8dbc04f16e Removed grepper, replaced by crx-jsstrings. 2017-11-03 18:40:53 +00:00
Achim D. Brucker 1c8694dcb8 Bind /srv/. 2017-11-02 19:18:53 +00:00
Achim D. Brucker 9bc9889767 Fixed location of singularity image. 2017-11-02 19:09:29 +00:00
Achim D. Brucker be7f9919ad Use singularity for extension update. 2017-11-02 18:50:24 +00:00
Achim D. Brucker 7ba829c90f Made python 3.6 the default. 2017-11-02 18:46:20 +00:00
Achim D. Brucker cfc26e62d7 Free git object as early as possible. 2017-10-22 21:20:49 +01:00
Achim D. Brucker 0963ea59d3 Fixed typo. 2017-10-21 20:12:19 +01:00
Achim D. Brucker d88e73167d Explicitely free git_obj. 2017-10-20 18:59:53 +01:00
Achim D. Brucker 14994e698b Reformatting. 2017-10-19 16:44:49 +01:00
Achim D. Brucker bb91e3874d Reformatting. 2017-10-19 16:44:36 +01:00
Achim D. Brucker 1203b4d581 Ensure default for TMPDIR. 2017-10-18 20:20:42 +01:00
Achim D. Brucker e4a8075da9 Configure timeout and retries for data base connection. 2017-10-18 20:19:43 +01:00
Achim D. Brucker 9f5d8f9b9e Added logs during creation of db connection. 2017-10-18 08:35:27 +01:00
Achim D. Brucker 6851223a6d Fixed log file name. 2017-10-18 08:35:04 +01:00