Commit Graph

377 Commits

Author SHA1 Message Date
Michael Herzberg 98e6b37f20 Cleaned up scripts. 2017-08-23 20:38:27 +01:00
Achim D. Brucker 1d79dd0744 Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler 2017-08-23 20:09:05 +01:00
Achim D. Brucker 2bbd6281f7 Reformatting. 2017-08-23 20:09:02 +01:00
Achim D. Brucker 4c5f8889d2 Refactoring. 2017-08-23 20:04:52 +01:00
Michael Herzberg 9a5646240e Adjusted logging. 2017-08-23 19:52:59 +01:00
Achim D. Brucker 04396c43bb Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler 2017-08-23 19:43:03 +01:00
Achim D. Brucker cd217f57a6 Integrated JavaScript decomposition analysis. 2017-08-23 19:42:00 +01:00
Achim D. Brucker 5d89e28486 Cleanup. 2017-08-23 19:17:35 +01:00
Michael Herzberg d2288e9a03 Don't push sge file separatly. 2017-08-23 18:10:31 +01:00
Michael Herzberg 3d896c104d Also improved create-db script. 2017-08-23 18:04:33 +01:00
Achim D. Brucker 123623b111 Minor code cleanup. 2017-08-23 17:36:41 +01:00
Achim D. Brucker 3208a6e58a Initial import of JavaScript decomposition framework. 2017-08-23 17:22:58 +01:00
Michael Herzberg 93daae78a6 Move logs and out to separate dirs. 2017-08-23 17:01:05 +01:00
Michael Herzberg 83c653dad9 Added bzip to grepper. 2017-08-23 16:57:31 +01:00
Michael Herzberg a6ee53d35b Improved grepper. 2017-08-23 16:52:18 +01:00
Achim D. Brucker fddd2374c4 Set sqlite pragmas. 2017-08-22 23:26:11 +01:00
Achim D. Brucker 3bba0913c0 Sync file systems prior to critical operations. 2017-08-21 08:15:10 +01:00
Achim D. Brucker 3b88b21469 Report analysis results using tee. 2017-08-19 22:44:30 +01:00
Achim D. Brucker 61fa0b7f23 Merge branch 'master' of acb14jd/ExtensionCrawler into master 2017-08-19 14:00:48 +02:00
Achim D. Brucker 216fd64b90 Removed non required rm command. 2017-08-19 12:33:34 +01:00
Achim D. Brucker 1bd097b863 Force /usr/bin/mail as mailer. 2017-08-19 12:29:18 +01:00
Jack Deadman b54803d834 Add installation instructions to README 2017-08-18 17:00:23 +01:00
Jack Deadman 181d0de788 Add setup.py 2017-08-18 17:00:10 +01:00
Achim D. Brucker 623ddf57a3 Improved error message in case CRX is not found. 2017-08-18 13:27:17 +01:00
Achim D. Brucker 112ef74e9f Documented options: -e and -w. 2017-08-18 13:09:35 +01:00
Achim D. Brucker 65d451a707 Simplified requirements.txt using 'pipreqs --force .'. 2017-08-18 12:37:20 +01:00
Achim D. Brucker 1dbd0a9f4a Ad-hoc integration of a first analysis to be run after building the data base. 2017-08-17 13:07:29 +01:00
Achim D. Brucker 0820b68a52 Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler 2017-08-17 06:37:38 +01:00
Achim D. Brucker df7bc9bc61 Add option to use etag instead of date for extraction hierarchy. 2017-08-17 06:31:00 +01:00
Michael Herzberg 534ed5d581 Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler 2017-08-16 21:32:16 +01:00
Michael Herzberg b81a80e564 Added sql query. 2017-08-16 21:32:09 +01:00
Achim D. Brucker b7729150ba Bug fix: call helpmsg() if script is called without arguments instead of built-in help() method. 2017-08-16 08:26:49 +01:00
Achim D. Brucker 9e1be377dc Added option -w for file systems that do not support ':' in file names (e.g., Windows): ':' are replaced by '-'. 2017-08-16 08:25:48 +01:00
Achim D. Brucker c04752c9e9 Added documentation for get_tarinfo(). 2017-08-16 08:13:32 +01:00
Achim D. Brucker 6167c5f88a Use extractall instead of extract, as extracall seems to be more error tolerant (according to the documentation of tarfile). 2017-08-15 22:30:47 +01:00
Michael Herzberg 116c76a719 Fixed global update db. 2017-08-15 15:31:30 +01:00
Michael Herzberg 6de7eb4368 Fixed grepper sge. 2017-08-14 15:15:50 +01:00
Michael Herzberg 0549f7bb4d Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler 2017-08-14 14:49:51 +01:00
Michael Herzberg 77ddcc23e4 Updated greper. 2017-08-14 14:40:10 +01:00
Achim D. Brucker de8160df04 Bug fix: corrected file name for size check of aa-ac.sqlite.bz2. 2017-08-13 16:09:54 +01:00
Achim D. Brucker cd131cb4b8 Create tmp/build db to minimize the time in which no db is available. 2017-08-10 09:06:09 +01:00
Achim D. Brucker 5af2cff2d5 Updated cron example. 2017-08-10 09:05:40 +01:00
Achim D. Brucker d8bd7af2dd Refactoring: Generate databases from backup. 2017-08-09 20:27:49 +01:00
Michael Herzberg 68e7e72e93 Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler 2017-08-09 13:06:42 +01:00
Michael Herzberg 40f800b4de Check if 'annotations' exists in search results. 2017-08-09 13:06:22 +01:00
Achim D. Brucker d3da686e16 Changed formular for computing download delay. 2017-08-05 10:57:45 +01:00
Michael Herzberg c61f19e860 Use INSERT OR IGNORE. 2017-07-31 23:55:21 +01:00
Michael Herzberg b8f57196c7 Changed fts table structure. 2017-07-31 23:23:57 +01:00
Michael Herzberg b34d45c4dc Added md5sum to sqlite. 2017-07-31 20:38:21 +01:00
Michael Herzberg 9f6cfc22a3 Added create-db sge wrapper. 2017-07-31 20:30:35 +01:00