 Michael Herzberg
|
dbe8a26a6b
|
Fixed download parsing.
|
2017-07-05 16:20:52 +01:00 |
|
Michael Herzberg
|
cface0128c
|
Changed download number extraction to also work with Google Docs extensions (and potentially others).
|
2017-07-05 16:08:15 +01:00 |
|
Michael Herzberg
|
7d0a68a808
|
Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler
|
2017-07-05 14:23:55 +01:00 |
|
Michael Herzberg
|
4c01b95f69
|
Added ratingValue and ratingCount to db.
|
2017-07-05 14:23:45 +01:00 |
 Achim D. Brucker
|
d5d0a44b69
|
Reformatting.
|
2017-07-05 08:21:40 +01:00 |
|
Achim D. Brucker
|
600ec933f4
|
Introduced optional argument to last_crx - return latest crx that is not newer than the passed date/time.
|
2017-07-05 08:21:00 +01:00 |
|
Achim D. Brucker
|
30c0b92979
|
Ignore empty crx files in calculating last crx file date.
|
2017-07-04 09:30:33 +01:00 |
|
Achim D. Brucker
|
939b29f55a
|
Use getmembers instead of getnames in last_crx().
|
2017-07-03 07:04:03 +01:00 |
|
Achim D. Brucker
|
817cf11ca7
|
Update script via cron.
|
2017-07-02 17:35:51 +01:00 |
|
Achim D. Brucker
|
c7a06dcf8e
|
Remove old compressed sqlite file prior to compressing updated sqlite file.
|
2017-07-02 17:31:48 +01:00 |
|
Achim D. Brucker
|
cc80684630
|
Disabled compressing of log files due to raise condition problems on network mounted drive.
|
2017-07-02 17:30:09 +01:00 |
|
Achim D. Brucker
|
4aad117c12
|
Simple script for syncing a local archive (excerpt of the total archive) for development or debugging.
|
2017-07-02 16:11:20 +01:00 |
|
Achim D. Brucker
|
b73ed18b67
|
Ignore errors while compressing log files.
|
2017-07-01 20:09:00 +01:00 |
|
Achim D. Brucker
|
797328b855
|
Overwrite compressed files.
|
2017-07-01 19:57:29 +01:00 |
|
Achim D. Brucker
|
5702a43368
|
Use parallel bzip2 (pbzip2) instead of regular bzip2.
|
2017-06-30 20:54:08 +01:00 |
|
Achim D. Brucker
|
062f2dea26
|
Report size before/after compressing of data base files.
|
2017-06-30 20:02:49 +01:00 |
|
Achim D. Brucker
|
931ae4f7ed
|
Normalized script name.
|
2017-06-30 18:39:26 +01:00 |
|
Achim D. Brucker
|
70f69f652f
|
Compress aa-ac.sqlite.
|
2017-06-29 22:46:59 +01:00 |
|
Achim D. Brucker
|
ef04c71314
|
Delete compressed database before re-creating it.
|
2017-06-29 20:38:31 +01:00 |
|
Achim D. Brucker
|
77c1fae66d
|
Compress log files.
|
2017-06-29 20:22:13 +01:00 |
|
Achim D. Brucker
|
69c20edfe8
|
Use same date/time for log files.
|
2017-06-29 19:45:21 +01:00 |
|
Achim D. Brucker
|
1f963ff4e4
|
Improved log output.
|
2017-06-28 20:34:47 +01:00 |
|
Achim D. Brucker
|
0a3d46f6da
|
Simple update script to simplify crontab entries.
|
2017-06-27 14:19:13 +01:00 |
|
Achim D. Brucker
|
1c0e687069
|
Use /bin/bash instead of /usr/bin/bash.
|
2017-06-27 13:03:01 +01:00 |
|
Achim D. Brucker
|
f7bcd91a34
|
Initial commit.
|
2017-06-27 09:00:44 +01:00 |
|
Achim D. Brucker
|
25dfdc3b90
|
Fixed typo.
|
2017-06-25 09:42:54 +01:00 |
|
Achim D. Brucker
|
ff331f0465
|
Documented archive hierarchy.
|
2017-06-24 08:16:34 +01:00 |
|
Achim D. Brucker
|
b23ffd9723
|
Added create_db.
|
2017-06-23 18:47:14 +01:00 |
|
Achim D. Brucker
|
221a31bbf0
|
Removed outdated permissions analysis script.
|
2017-06-23 18:43:12 +01:00 |
|
Michael Herzberg
|
b080543e9b
|
Added script to generate small db.
|
2017-06-23 14:44:07 +01:00 |
M.S. Herzberg
|
5949150b00
|
Added two scripts.
|
2017-06-22 19:41:11 +01:00 |
|
Michael Herzberg
|
42161363ce
|
Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler
|
2017-06-22 17:46:28 +01:00 |
|
Michael Herzberg
|
6d5221c5d7
|
Make db path configurable.
|
2017-06-22 17:46:18 +01:00 |
|
Achim D. Brucker
|
675bd301cc
|
Added missing parallel parameter to second call of update_extensions.
|
2017-06-21 15:26:48 +01:00 |
|
Michael Herzberg
|
6833ba6683
|
Fixed sqlite creation, added missing commit
|
2017-06-20 23:47:31 +01:00 |
|
Michael Herzberg
|
4220d48d34
|
Close db when an exception is thrown.
|
2017-06-20 23:15:15 +01:00 |
|
Achim D. Brucker
|
8dbd535e3e
|
Merge branch 'master' into production
|
2017-06-20 20:03:10 +01:00 |
|
Achim D. Brucker
|
d9ebe265ae
|
Re-formatting
|
2017-06-20 18:17:44 +01:00 |
|
Achim D. Brucker
|
05227494d6
|
Re-formatting
|
2017-06-20 18:17:36 +01:00 |
|
Michael Herzberg
|
dae5d4caa9
|
Fixed creation of empty .crx files.
|
2017-06-20 18:05:22 +01:00 |
|
Michael Herzberg
|
7ef8ecf3b1
|
Relax json parsing of manifest.
|
2017-06-20 17:45:13 +01:00 |
|
Michael Herzberg
|
1cfe1bdab9
|
Also ignore /* style comments in manifests.
|
2017-06-20 15:22:09 +01:00 |
|
Michael Herzberg
|
f40febdf09
|
Added -p option for create-db (parallelism).
|
2017-06-20 15:10:32 +01:00 |
|
Michael Herzberg
|
437a00d256
|
Don't print warning when crx status is 404.
|
2017-06-20 15:07:44 +01:00 |
|
Michael Herzberg
|
69cdcd7174
|
Remove JavaScript-style comments from manifest before parsing.
|
2017-06-20 11:22:54 +01:00 |
|
Michael Herzberg
|
b6bf280d1e
|
Fixed error.
|
2017-06-20 08:49:01 +01:00 |
|
Michael Herzberg
|
3496e89460
|
Fixed error.
|
2017-06-20 08:43:43 +01:00 |
|
Michael Herzberg
|
aa259807e2
|
Catch exceptions due to empty crx header file.
|
2017-06-20 08:42:30 +01:00 |
|
Michael Herzberg
|
c47ba57c97
|
Changed handing of manifest parsing exceptions.
|
2017-06-20 08:28:50 +01:00 |
|
Michael Herzberg
|
d2dd2aaf81
|
Moved db path into config file.
|
2017-06-20 08:10:28 +01:00 |