 Achim D. Brucker
|
2d33f3bebe
|
Added pdf output.
|
2018-04-04 09:35:35 +01:00 |
|
Achim D. Brucker
|
de2519130a
|
Improved derivative (downloads per eight hours) and png output.
|
2018-04-04 09:20:29 +01:00 |
|
Achim D. Brucker
|
423d3c35fa
|
Improved line types for png output.
|
2018-04-04 08:27:02 +01:00 |
|
Achim D. Brucker
|
0f1c53a011
|
More aggressive download heuristics.
|
2018-04-03 22:20:09 +01:00 |
|
Achim D. Brucker
|
7c688afee8
|
Configured 32 parallel downloads.
|
2018-04-03 22:14:02 +01:00 |
|
Achim D. Brucker
|
ca42e4026f
|
Added plot of an approximation of the first derivative.
|
2018-04-03 16:17:14 +01:00 |
|
Achim D. Brucker
|
1102fc102d
|
Kill running downloads more aggressively.
|
2018-04-02 16:41:07 +01:00 |
|
Achim D. Brucker
|
234cbef539
|
Improved mode for terminating running downloads.
|
2018-04-02 12:01:54 +01:00 |
|
Achim D. Brucker
|
ec30fdda5a
|
Added missing ".
|
2018-04-02 11:37:50 +01:00 |
|
Achim D. Brucker
|
c05ad75bca
|
Minor increasement of parallel downloads (testing).
|
2018-04-02 11:36:22 +01:00 |
|
Achim D. Brucker
|
2412a66731
|
Fixed kill mode.
|
2018-04-02 11:35:49 +01:00 |
|
Achim D. Brucker
|
2a7e94f325
|
Introduced mode that kills (still) running downloads.
|
2018-04-02 10:58:09 +01:00 |
|
Achim D. Brucker
|
2d046a5e4d
|
Removed unnecessary pipes.
|
2018-04-02 10:19:06 +01:00 |
|
Achim D. Brucker
|
46639927d7
|
Removed unused configuration variables.
|
2018-04-02 10:08:51 +01:00 |
|
Achim D. Brucker
|
8041e7366d
|
Improved x and y ticks.
|
2018-04-01 20:14:09 +01:00 |
|
Achim D. Brucker
|
b5af89e8c3
|
Increased chunk size to 500.
|
2018-04-01 19:54:28 +01:00 |
|
Achim D. Brucker
|
57b0b82326
|
Fixed last mail check and separator for max extensions.
|
2018-04-01 19:00:21 +01:00 |
|
Achim D. Brucker
|
fcaf4144dc
|
Fixed last mail check.
|
2018-04-01 18:50:17 +01:00 |
|
Achim D. Brucker
|
c032de575a
|
Fixed location of updates.csv.
|
2018-04-01 18:25:45 +01:00 |
|
Achim D. Brucker
|
51fe4bc1e2
|
Fixed type error (chunksize is a parameter of map, not the list constructor).
|
2018-04-01 18:19:27 +01:00 |
|
Achim D. Brucker
|
c7a4df17db
|
Fixed typo.
|
2018-04-01 17:02:25 +01:00 |
|
Achim D. Brucker
|
b9a9225a07
|
Added plot generation and moved location of CSV file.
|
2018-04-01 15:15:09 +01:00 |
|
Achim D. Brucker
|
fa74c46f5a
|
Initial commit: gnuplot script for generating graph of the downloads of the last week.
|
2018-04-01 15:13:48 +01:00 |
|
Achim D. Brucker
|
b9a9ed7f2b
|
Merged date/time fields.
|
2018-04-01 12:44:01 +01:00 |
|
Achim D. Brucker
|
337178f3cf
|
Fixed column numbers in csv file.
|
2018-03-31 21:12:40 +01:00 |
|
Achim D. Brucker
|
afd7a18f3d
|
Added PIDs to logged data.
|
2018-03-31 21:10:55 +01:00 |
|
Achim D. Brucker
|
d70c903656
|
Basic CSV-style logging of downloads.
|
2018-03-31 20:38:03 +01:00 |
|
Achim D. Brucker
|
7a2488c39b
|
Configured chunksize for parallel downloads.
|
2018-03-28 18:44:28 +01:00 |
|
Achim D. Brucker
|
7fdadf5885
|
Reduced number of concurrent downloads.
|
2018-03-27 13:55:50 +01:00 |
|
Achim D. Brucker
|
04d311d267
|
Report log analyzed log file.
|
2018-03-09 00:44:44 +00:00 |
|
Achim D. Brucker
|
6089055a81
|
Report number of finished downloads.
|
2018-03-09 00:43:08 +00:00 |
|
Achim D. Brucker
|
5508a1a760
|
Bug fix: computing latest log file.
|
2018-03-09 00:40:36 +00:00 |
|
Achim D. Brucker
|
cbc1fd9a58
|
Added install option.
|
2018-03-01 07:21:03 +00:00 |
|
Achim D. Brucker
|
79f8d15aeb
|
Report running PIDs.
|
2018-02-28 22:12:27 +00:00 |
|
Achim D. Brucker
|
1aed6cb1f2
|
Merge branch 'master' into production
|
2018-02-26 21:23:13 +00:00 |
|
Achim D. Brucker
|
d6c7fbd306
|
Ignore invalid bytes during character decoding.
|
2018-02-26 21:23:00 +00:00 |
|
Achim D. Brucker
|
527fca78bc
|
Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler
|
2018-02-18 19:32:47 +00:00 |
|
Achim D. Brucker
|
535e5c934b
|
Simple monitoring script for global_update.sh.
|
2018-02-18 19:06:10 +00:00 |
|
Achim D. Brucker
|
3547cdc26a
|
Merge branch 'master' into production
|
2018-02-16 21:32:55 +00:00 |
|
Achim D. Brucker
|
02320e51f7
|
Simple monitoring script for global_update.sh.
|
2018-02-16 21:32:11 +00:00 |
|
Achim D. Brucker
|
a32abc1d48
|
Merge branch 'master' into production
|
2018-02-12 08:48:46 +00:00 |
|
Achim D. Brucker
|
fd194d0103
|
Increased number of parallel downloads.
|
2018-02-12 08:48:28 +00:00 |
|
Achim D. Brucker
|
51f7337639
|
Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler
|
2018-02-12 08:46:58 +00:00 |
|
Achim D. Brucker
|
a17e71529b
|
Updated to build interface of latest singularity and read-only squashfs images for default crawler image.
|
2018-02-12 08:46:35 +00:00 |
Michael Herzberg
|
c633b4a085
|
Made arguments for CrawlError optional in the hopes of fixing some pickle error...
|
2017-12-14 00:05:28 +00:00 |
|
Michael Herzberg
|
2a751d69e4
|
Made arguments for CrawlError optional in the hopes of fixing some pickle error...
|
2017-12-14 00:02:26 +00:00 |
|
Achim D. Brucker
|
11f8d40a17
|
Reformatting.
|
2017-11-29 08:40:38 +09:00 |
|
Achim D. Brucker
|
b5f6b273a3
|
Reformatting.
|
2017-11-29 08:40:32 +09:00 |
|
Achim D. Brucker
|
781148be4f
|
Reformatting.
|
2017-11-29 08:40:28 +09:00 |
|
Achim D. Brucker
|
ae165e5527
|
Reformatting.
|
2017-11-28 14:10:31 +00:00 |