 Achim D. Brucker
|
ee8e4cd140
|
Using python 3.7.
|
2019-01-14 09:35:41 +00:00 |
|
Achim D. Brucker
|
2f9c9e7c78
|
Testing python 3.7.
|
2019-01-13 00:10:28 +00:00 |
|
Achim D. Brucker
|
fc497a45fd
|
Merge branch 'master' into production
|
2018-12-24 00:27:06 +00:00 |
|
Achim D. Brucker
|
9b934a3349
|
Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler
|
2018-12-23 10:33:14 +00:00 |
|
Achim D. Brucker
|
726d3c2257
|
Added libpython3.7-dev as dependency.
|
2018-12-23 10:32:58 +00:00 |
Michael Herzberg
|
3f43a02d9d
|
Added jquery and angular analysis.
|
2018-11-28 22:29:49 +00:00 |
|
Achim D. Brucker
|
c90bfb5fbb
|
Added support for xz compressed archives.
|
2018-11-10 20:48:00 +00:00 |
|
Achim D. Brucker
|
2289e8ecc2
|
Removed reporting of WorkerExceptions.
|
2018-11-10 16:50:13 +00:00 |
|
Achim D. Brucker
|
dd08cdb5a6
|
Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler
|
2018-10-29 19:29:02 +00:00 |
|
Achim D. Brucker
|
17b0ab53e8
|
Increased requests version (dependency).
|
2018-10-29 19:28:44 +00:00 |
|
Michael Herzberg
|
81b2bbd21f
|
Added MD5Table and made max simhash dist configurable.
|
2018-09-12 21:56:30 +01:00 |
|
Achim D. Brucker
|
3b75b839f0
|
Added SPDX identifier.
|
2018-09-03 00:30:58 +01:00 |
|
Achim D. Brucker
|
8ba0a0bb22
|
Merge branch 'master' into production
|
2018-09-02 20:18:21 +01:00 |
|
Achim D. Brucker
|
19bccc8be1
|
Reverted fix for double reporting of downloads.
|
2018-09-02 20:18:09 +01:00 |
|
Michael Herzberg
|
d1260980b5
|
Merge branch 'master' into production
|
2018-09-02 11:46:51 +01:00 |
|
Michael Herzberg
|
63fe0806ee
|
Fixed double-logging when not using forkserver.
|
2018-09-02 11:46:27 +01:00 |
|
Achim D. Brucker
|
6d0afeedb6
|
Merge branch 'production' of logicalhacking.com:BrowserSecurity/ExtensionCrawler into production
|
2018-09-02 11:12:17 +01:00 |
|
Achim D. Brucker
|
7cefced4ce
|
Merge branch 'master' into production
|
2018-09-02 11:11:55 +01:00 |
|
Achim D. Brucker
|
cb974b6ddf
|
Hack: divide download numbers by two to adapt to log format changes after disabling forkserver.
|
2018-09-02 11:11:33 +01:00 |
|
Achim D. Brucker
|
9a33bfdd9e
|
Added SPDX identifier.
|
2018-09-02 10:25:46 +01:00 |
|
Achim D. Brucker
|
4ab2f4d5a3
|
Added SPDX identifier.
|
2018-09-02 10:25:41 +01:00 |
|
Achim D. Brucker
|
3d2fb6c054
|
Added SPDX identifier.
|
2018-09-02 10:24:52 +01:00 |
|
Achim D. Brucker
|
c9ec991cfd
|
Added SPDX identifier.
|
2018-09-02 10:22:56 +01:00 |
|
Achim D. Brucker
|
c7419a2d9f
|
Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler
|
2018-09-01 21:52:02 +01:00 |
|
Achim D. Brucker
|
6d8ee12bce
|
Added SPDX identifier.
|
2018-09-01 21:48:14 +01:00 |
|
Achim D. Brucker
|
eb18d051dc
|
Added support for compressed archives.
|
2018-09-01 21:47:19 +01:00 |
|
Michael Herzberg
|
3904d84ad9
|
Merge branch 'master' into production
|
2018-09-01 11:35:11 +01:00 |
|
Michael Herzberg
|
e71323644a
|
Don't use forkserver anymore since it seems to lead to many sem_unlink/file not found exceptions.
|
2018-09-01 11:34:54 +01:00 |
|
Michael Herzberg
|
7d313790a7
|
Changed simhashbucket to use MySQL instead of SQLite.
|
2018-08-31 11:10:32 +01:00 |
|
Achim D. Brucker
|
d9bca223d4
|
Merge branch 'master' into production
|
2018-08-31 10:56:16 +01:00 |
|
Achim D. Brucker
|
a66620bcc7
|
Added plot of extension archive size.
|
2018-08-31 10:49:14 +01:00 |
|
Achim D. Brucker
|
449216907e
|
Increased y-scale to match larger number of extensions (and max download speed).
|
2018-08-31 10:30:13 +01:00 |
|
Achim D. Brucker
|
e5c51bcebc
|
Merge branch 'master' into production
|
2018-08-19 21:29:35 +01:00 |
|
Achim D. Brucker
|
d7496c8c56
|
Report WorkerException warnings.
|
2018-08-19 21:29:07 +01:00 |
|
Achim D. Brucker
|
2b00c6468c
|
Merge branch 'production' of logicalhacking.com:BrowserSecurity/ExtensionCrawler into production
|
2018-08-17 22:12:12 +01:00 |
|
Achim D. Brucker
|
aa32e8071f
|
Merge branch 'master' into production
|
2018-08-17 22:11:58 +01:00 |
|
Achim D. Brucker
|
3cd1b221fd
|
Added reporting of WorkerExceptions.
|
2018-08-17 22:08:40 +01:00 |
|
Michael Herzberg
|
43b8d01b46
|
Merge branch 'master' into production
|
2018-08-17 15:20:46 +01:00 |
|
Michael Herzberg
|
2d52091292
|
Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler
|
2018-08-17 15:20:09 +01:00 |
|
Michael Herzberg
|
873c249504
|
Build list for simhash lazily to save memory.
|
2018-08-17 15:20:00 +01:00 |
|
Michael Herzberg
|
c0477269d0
|
Merge branch 'master' into production
|
2018-08-09 14:20:29 +01:00 |
|
Michael Herzberg
|
e7b7625453
|
Added database documentation.
|
2018-08-09 14:20:01 +01:00 |
|
Michael Herzberg
|
61840d6a86
|
Merge branch 'master' into production
|
2018-08-02 16:14:02 +01:00 |
|
Michael Herzberg
|
e492f516ac
|
Restrict sharc jobs to 1 hour.
|
2018-08-02 16:13:25 +01:00 |
|
Michael Herzberg
|
66db569d5f
|
Only open DB connection when needed.
|
2018-08-02 12:37:57 +01:00 |
|
Michael Herzberg
|
05c1cbdea5
|
Give MySQL server up to 1 hour to recover.
|
2018-08-02 11:47:38 +01:00 |
|
Michael Herzberg
|
c931f0b683
|
Merge branch 'master' into production
|
2018-07-28 19:03:42 +02:00 |
|
Michael Herzberg
|
c6d3056fee
|
Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler
|
2018-07-28 19:02:48 +02:00 |
|
Michael Herzberg
|
947ecf50d4
|
Removed queue length and reduced mysql insert batch size.
|
2018-07-28 19:02:38 +02:00 |
|
Achim D. Brucker
|
1ee699cc0f
|
Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler
|
2018-07-28 10:48:09 +01:00 |