 Achim D. Brucker
|
bd18a73271
|
Refactoring.
|
2017-01-26 03:16:47 +00:00 |
|
Achim D. Brucker
|
a346118c13
|
Renamed basedir to archivedir.
|
2017-01-25 19:43:10 +00:00 |
|
Achim D. Brucker
|
0b96aeb49d
|
Computer forum update id.
|
2017-01-24 22:04:34 +00:00 |
|
Achim D. Brucker
|
be36b7f129
|
Re-discover already archived ids.
|
2017-01-23 18:54:32 +00:00 |
|
Achim D. Brucker
|
3dc7a5d663
|
Added comment on skipping language specific extension URLs.
|
2017-01-22 15:53:00 +00:00 |
|
Achim D. Brucker
|
1077d04322
|
Switched to new library.
|
2017-01-22 15:52:16 +00:00 |
|
Achim D. Brucker
|
c74f36371c
|
Switched to new library.
|
2017-01-21 20:02:31 +00:00 |
|
Achim D. Brucker
|
6b38e2c738
|
Reformatting.
|
2017-01-21 18:47:44 +00:00 |
|
Achim D. Brucker
|
b4756b3350
|
Modulified parse_sitemap.
|
2017-01-21 12:51:55 +00:00 |
|
Achim D. Brucker
|
fac837d016
|
Module setup.
|
2017-01-20 23:02:56 +00:00 |
 Michael Herzberg
|
c75e2f2c97
|
Added script that parses the chrome web store sitemap for ids. This yields around 100k ids.
|
2017-01-19 14:59:34 +00:00 |
|
Achim D. Brucker
|
97a3e16c72
|
Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler
|
2017-01-18 05:05:54 +00:00 |
|
Achim D. Brucker
|
8622869ef5
|
Added optional summary to stderr.
|
2017-01-17 19:29:03 +00:00 |
|
Michael Herzberg
|
82045444a9
|
Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler
|
2017-01-17 16:08:27 +00:00 |
|
Michael Herzberg
|
dbaa55286e
|
Improved discovery script.
|
2017-01-17 16:08:20 +00:00 |
|
Achim D. Brucker
|
e096b9a2d5
|
Re-formatting.
|
2017-01-14 20:34:58 +00:00 |
|
Achim D. Brucker
|
a67aaf0501
|
Fixed too many arguments bug.
|
2017-01-12 22:20:06 +00:00 |
|
Achim D. Brucker
|
c4c687d2ff
|
Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler
|
2017-01-12 22:06:44 +00:00 |
|
Achim D. Brucker
|
92352668ca
|
Improved robustness.
|
2017-01-12 22:06:20 +00:00 |
|
Michael Herzberg
|
5146f1808f
|
Fixed mkdirs call.
|
2017-01-11 17:22:23 +00:00 |
|
Michael Herzberg
|
ddabc6c89d
|
Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler
|
2017-01-11 16:01:53 +00:00 |
|
Michael Herzberg
|
87ab4a5982
|
Added discover script.
|
2017-01-11 16:01:40 +00:00 |
|
Achim D. Brucker
|
a67478530f
|
Implemented mode for only downloading overview page.
|
2017-01-11 13:23:03 +00:00 |
|
Achim D. Brucker
|
614708cdfb
|
Fixed failed login counter.
|
2017-01-11 07:17:56 +00:00 |
|
Achim D. Brucker
|
cd6363d8b4
|
Flush output.
|
2017-01-10 20:21:09 +00:00 |
|
Achim D. Brucker
|
ca6ddf76ed
|
Extended summary.
|
2017-01-10 20:03:04 +00:00 |
|
Achim D. Brucker
|
1289a7f077
|
Fixed typo.
|
2017-01-10 19:53:21 +00:00 |
|
Achim D. Brucker
|
5f0221fc3a
|
Reformatting source code.
|
2017-01-10 16:31:16 +00:00 |
|
Achim D. Brucker
|
8758f5c8e0
|
Bug fix: removed access to non-defined variable.
|
2017-01-10 16:30:09 +00:00 |
|
Achim D. Brucker
|
a6af890c10
|
Removed ua header.
|
2017-01-10 16:29:32 +00:00 |
|
Achim D. Brucker
|
1327547b85
|
Slow down access of google.com.
|
2017-01-10 16:27:49 +00:00 |
|
Achim D. Brucker
|
93e2a84ecd
|
Added captcha warning.
|
2017-01-10 13:39:36 +00:00 |
|
Achim D. Brucker
|
ab4ead2ea2
|
Store metadata for each request.
|
2017-01-10 13:23:19 +00:00 |
|
Achim D. Brucker
|
781ba1ddca
|
Catch exceptions during updates.
|
2017-01-01 18:24:52 +00:00 |
|
Achim D. Brucker
|
d5bde39626
|
Harmonized help text.
|
2016-12-22 04:35:28 +00:00 |
|
Achim D. Brucker
|
9f53f4500f
|
Flush output stream.
|
2016-12-20 03:48:34 +00:00 |
|
Achim D. Brucker
|
ea469ba564
|
Improved messages.
|
2016-12-19 00:26:03 +00:00 |
|
Achim D. Brucker
|
7a919c994c
|
Documented dateutil dependency.
|
2016-12-18 18:32:36 +00:00 |
|
Achim D. Brucker
|
9fdba0ee73
|
Bug fix: avoid re-download in discover mode.
|
2016-12-17 19:36:45 +00:00 |
|
Achim D. Brucker
|
782d7ee493
|
Implemented If-Modified-Since check.
|
2016-12-16 21:51:18 +00:00 |
|
Achim D. Brucker
|
c5209c25b6
|
Reformatting.
|
2016-12-15 08:15:30 +00:00 |
|
Achim D. Brucker
|
82f62a32a6
|
Verbose mode.
|
2016-12-14 08:34:53 +00:00 |
|
Achim D. Brucker
|
701a90f760
|
Documented dependency: requests.
|
2016-12-13 23:43:37 +00:00 |
|
Achim D. Brucker
|
01486280f5
|
Changed default download/archive directory.
|
2016-12-12 23:27:31 +00:00 |
|
Achim D. Brucker
|
b8e4fa13ee
|
Silent update.
|
2016-12-10 07:40:53 +00:00 |
|
Achim D. Brucker
|
ac4096fbda
|
Added download of support messages.
|
2016-12-09 21:27:48 +00:00 |
|
Achim D. Brucker
|
50cae9116d
|
Symlink already existing crx-files.
|
2016-12-08 20:16:04 +00:00 |
|
Achim D. Brucker
|
cfb58aa6ca
|
Only store metadata on first downloadd.
|
2016-12-07 21:41:21 +00:00 |
|
Achim D. Brucker
|
f40964113f
|
Implemented download of reviews.
|
2016-12-06 20:11:13 +00:00 |
|
Achim D. Brucker
|
71995b8261
|
Minor refactoring and introduction of command line switch for discovering new extensions vs. updating existing ones.
|
2016-12-05 06:42:20 +00:00 |