Commit Graph

352 Commits

Author SHA1 Message Date
Achim D. Brucker 65d451a707 Simplified requirements.txt using 'pipreqs --force .'. 2017-08-18 12:37:20 +01:00
Achim D. Brucker 1dbd0a9f4a Ad-hoc integration of a first analysis to be run after building the data base. 2017-08-17 13:07:29 +01:00
Achim D. Brucker 0820b68a52 Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler 2017-08-17 06:37:38 +01:00
Achim D. Brucker df7bc9bc61 Add option to use etag instead of date for extraction hierarchy. 2017-08-17 06:31:00 +01:00
Michael Herzberg 534ed5d581 Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler 2017-08-16 21:32:16 +01:00
Michael Herzberg b81a80e564 Added sql query. 2017-08-16 21:32:09 +01:00
Achim D. Brucker b7729150ba Bug fix: call helpmsg() if script is called without arguments instead of built-in help() method. 2017-08-16 08:26:49 +01:00
Achim D. Brucker 9e1be377dc Added option -w for file systems that do not support ':' in file names (e.g., Windows): ':' are replaced by '-'. 2017-08-16 08:25:48 +01:00
Achim D. Brucker c04752c9e9 Added documentation for get_tarinfo(). 2017-08-16 08:13:32 +01:00
Achim D. Brucker 6167c5f88a Use extractall instead of extract, as extracall seems to be more error tolerant (according to the documentation of tarfile). 2017-08-15 22:30:47 +01:00
Michael Herzberg 116c76a719 Fixed global update db. 2017-08-15 15:31:30 +01:00
Michael Herzberg 6de7eb4368 Fixed grepper sge. 2017-08-14 15:15:50 +01:00
Michael Herzberg 0549f7bb4d Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler 2017-08-14 14:49:51 +01:00
Michael Herzberg 77ddcc23e4 Updated greper. 2017-08-14 14:40:10 +01:00
Achim D. Brucker de8160df04 Bug fix: corrected file name for size check of aa-ac.sqlite.bz2. 2017-08-13 16:09:54 +01:00
Achim D. Brucker cd131cb4b8 Create tmp/build db to minimize the time in which no db is available. 2017-08-10 09:06:09 +01:00
Achim D. Brucker 5af2cff2d5 Updated cron example. 2017-08-10 09:05:40 +01:00
Achim D. Brucker d8bd7af2dd Refactoring: Generate databases from backup. 2017-08-09 20:27:49 +01:00
Michael Herzberg 68e7e72e93 Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler 2017-08-09 13:06:42 +01:00
Michael Herzberg 40f800b4de Check if 'annotations' exists in search results. 2017-08-09 13:06:22 +01:00
Achim D. Brucker d3da686e16 Changed formular for computing download delay. 2017-08-05 10:57:45 +01:00
Michael Herzberg c61f19e860 Use INSERT OR IGNORE. 2017-07-31 23:55:21 +01:00
Michael Herzberg b8f57196c7 Changed fts table structure. 2017-07-31 23:23:57 +01:00
Michael Herzberg b34d45c4dc Added md5sum to sqlite. 2017-07-31 20:38:21 +01:00
Michael Herzberg 9f6cfc22a3 Added create-db sge wrapper. 2017-07-31 20:30:35 +01:00
Michael Herzberg 82a41aef18 Added python wrapper for grepper sge stuff. 2017-07-31 20:18:34 +01:00
Michael Herzberg e1aee1446a Fixed grepper. 2017-07-31 19:11:39 +01:00
Michael Herzberg eac88001c3 Use empty string instead of None. 2017-07-31 16:19:54 +01:00
Michael Herzberg 4cc8a2695e Fixed import. 2017-07-31 16:19:20 +01:00
Michael Herzberg 4d0b2b5ec5 Fixed sge_common and merge script. 2017-07-31 14:21:57 +01:00
Michael Herzberg e94bb344d3 Refactored grepper. 2017-07-31 14:19:52 +01:00
Achim D. Brucker 35c133e395 Slightly more aggressive implementation of google_dos_protection. 2017-07-30 14:41:20 +01:00
Achim D. Brucker eace911472 Added description of extract-crx. 2017-07-30 09:59:42 +01:00
Achim D. Brucker 5268f2a732 Refactoring: clean-up of imports and a few other minor improvements. 2017-07-29 16:13:39 +01:00
Achim D. Brucker eb0054b47d Refactoring: Moved default configuration to config module. 2017-07-29 12:36:20 +01:00
Achim D. Brucker 0b24fb15fe Refactoring. 2017-07-29 11:32:06 +01:00
Achim D. Brucker 0ca3476b09 Slightly more aggressive implementation of google_dos_protection. 2017-07-29 11:21:15 +01:00
Achim D. Brucker d05ca9678e Refactoring. 2017-07-29 10:57:35 +01:00
Achim D. Brucker ac663299b3 Refactoring. 2017-07-29 10:17:16 +01:00
Achim D. Brucker b68eb42f96 Refactoring. 2017-07-29 09:46:28 +01:00
Achim D. Brucker 10cce2859d Renamed variable/attribute pk to public_key. 2017-07-29 09:15:22 +01:00
Achim D. Brucker 333bcaa62d Strip path from crx file. 2017-07-29 09:12:01 +01:00
Achim D. Brucker e5d671c7c4 Refactoring. 2017-07-29 09:05:16 +01:00
Achim D. Brucker 659f37c90c Refactoring. 2017-07-28 21:18:10 +01:00
Achim D. Brucker d5d2251de9 Refactoring. 2017-07-28 20:21:38 +01:00
Achim D. Brucker 716e35be00 Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler 2017-07-28 19:45:06 +01:00
Achim D. Brucker 22f18ec3c8 Refactoring. 2017-07-28 19:44:51 +01:00
Michael Herzberg fb64499c8f Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler 2017-07-28 16:47:33 +01:00
Michael Herzberg 44756e44d6 Added python-based sqlite merger. 2017-07-28 16:47:25 +01:00
Achim D. Brucker 1833dbad90 Refactoring. 2017-07-28 15:57:17 +01:00