Achim D. Brucker
|
86a608c6a1
|
Re-formatting.
|
2017-06-16 23:19:13 +01:00 |
Achim D. Brucker
|
1c8d68d495
|
Moved path utility functions into config module.
|
2017-06-16 23:09:23 +01:00 |
Achim D. Brucker
|
5dd424c06d
|
Removed obsolete permstats.py.
|
2017-06-16 22:48:37 +01:00 |
Achim D. Brucker
|
012c285c84
|
Added assert to ensure Python 3.5.
|
2017-06-16 22:46:04 +01:00 |
Achim D. Brucker
|
9f174f6785
|
Downport to python 3.5.
|
2017-06-16 22:38:48 +01:00 |
Michael Herzberg
|
6e2772711f
|
Next version of sqlite generator.
|
2017-06-16 20:40:48 +01:00 |
Michael Herzberg
|
c08124fa17
|
First version of sqlite generator.
|
2017-06-16 14:56:23 +01:00 |
Achim D. Brucker
|
ab4c0ad002
|
Fixed logging.
|
2017-06-16 12:07:51 +01:00 |
Achim D. Brucker
|
b9e5ca6f82
|
Stub for updating sqlite.
|
2017-06-16 11:06:04 +01:00 |
Achim D. Brucker
|
73baef61b2
|
Re-formatting.
|
2017-06-16 10:29:07 +01:00 |
Achim D. Brucker
|
64778c783e
|
Check etags in addition to modified-since (basic implementation).
|
2017-06-16 10:28:47 +01:00 |
Achim D. Brucker
|
763ac137b2
|
Re-introduced parallel download (they are not causing the If-Modified-Since problem).
|
2017-06-15 23:14:07 +01:00 |
Achim D. Brucker
|
3ff67bddc8
|
Disabled parallel download (IF-Modified Bug Hunting).
|
2017-06-14 16:56:05 +01:00 |
Achim D. Brucker
|
fd717d1516
|
Reformatting.
|
2017-05-27 20:39:00 +01:00 |
Achim D. Brucker
|
e164b7fe72
|
Reformatting.
|
2017-05-27 20:38:56 +01:00 |
Achim D. Brucker
|
b4e680ccef
|
Disabled local backup.
|
2017-05-20 21:09:03 +01:00 |
Achim D. Brucker
|
02eed607b4
|
Re-added wait before downloading first forum/support page - old setup was too aggressive.
|
2017-04-14 19:56:39 +01:00 |
Achim D. Brucker
|
a547e840cb
|
Normalized formatting.
|
2017-04-13 09:34:33 +01:00 |
Achim D. Brucker
|
0ee655f018
|
Interlaving forum and support download with crx download and removed inital wait before downloading first forum/support page.
|
2017-04-12 08:59:08 +01:00 |
Achim D. Brucker
|
0f88b5d8c5
|
Reduced pool size to reduce load.
|
2017-04-11 07:44:19 +01:00 |
Achim D. Brucker
|
63bf936e1e
|
Avoid use of ReadTarFS (seems to be very slow compared to the tarfile module).
|
2017-04-10 07:08:52 +01:00 |
Achim D. Brucker
|
23fd7731bc
|
Reduced waiting time for DOS protection.
|
2017-04-09 08:20:52 +01:00 |
Achim D. Brucker
|
e65c21a3b1
|
Increased pool size to 48.
|
2017-04-08 00:12:40 +01:00 |
Achim D. Brucker
|
c03fa789bd
|
Fixed reporting of new extensions.
|
2017-04-07 07:07:49 +01:00 |
Achim D. Brucker
|
c75cdc9d09
|
Switched to proper append mode for tar archive.
|
2017-04-06 21:42:59 +01:00 |
Achim D. Brucker
|
a06d218073
|
Re-Formatting
|
2017-04-05 21:42:00 +01:00 |
Achim D. Brucker
|
86ed713b9d
|
Updated last_crx call in update_extension to match new archive layout.
|
2017-04-04 22:51:45 +01:00 |
Achim D. Brucker
|
8cfd0d3bb2
|
Fixed folder confusion during tar file creation.
|
2017-04-03 21:32:53 +01:00 |
Achim D. Brucker
|
90d58705c4
|
Re-formatting.
|
2017-04-02 09:23:13 +01:00 |
Achim D. Brucker
|
308c0d8721
|
Improved log output.
|
2017-04-01 06:57:39 +01:00 |
Achim D. Brucker
|
5a8b76ce14
|
Move tar creation to (local) tmp dir.
|
2017-03-31 17:04:51 +01:00 |
Achim D. Brucker
|
af1aeb5b80
|
Re-formatting.
|
2017-03-30 07:53:04 +01:00 |
Achim D. Brucker
|
6513a5727a
|
Report extensions with file corruption explicitely.
|
2017-03-29 06:07:27 +01:00 |
Achim D. Brucker
|
e72da5b3ff
|
Catching even more file i/o-exceptions.
|
2017-03-28 06:38:12 +01:00 |
Achim D. Brucker
|
660ebcf34d
|
Sync before executing large file operations.
|
2017-03-27 22:00:06 +01:00 |
Achim D. Brucker
|
00b59d8429
|
Ignore exceptions during backup creation.
|
2017-03-26 21:30:07 +01:00 |
Achim D. Brucker
|
fe49f56959
|
Re-formatting.
|
2017-03-25 06:31:48 +00:00 |
Achim D. Brucker
|
e6e8914004
|
Fixed call of write_text (missing argument to interface changes).
|
2017-03-24 06:19:40 +00:00 |
Achim D. Brucker
|
581f2ef10d
|
Catch exception in case of corrupt tar file and rename tar file as mitigation.
|
2017-03-23 20:32:51 +00:00 |
Achim D. Brucker
|
26a9c7e8f1
|
Increased pool size to 24 to mitigitate longer downloads due to tar/untar-operations.
|
2017-03-22 05:44:09 +00:00 |
Achim D. Brucker
|
7007ddebb6
|
Ensure that dir is defined even if an exception is thrown.
|
2017-03-21 20:47:28 +00:00 |
Achim D. Brucker
|
8b38afedc5
|
Fixed file permissions.
|
2017-03-20 21:51:06 +00:00 |
Achim D. Brucker
|
19bd4f8f44
|
Renaming.
|
2017-03-19 16:34:45 +00:00 |
Achim D. Brucker
|
ad47feae61
|
Moved crx analysis in own module.
|
2017-03-18 09:21:18 +00:00 |
Achim D. Brucker
|
95561773dd
|
Removed outdated parse sitemap.
|
2017-03-17 06:48:02 +00:00 |
Achim D. Brucker
|
74992388e0
|
Re-formatting.
|
2017-03-16 08:30:33 +00:00 |
Achim D. Brucker
|
cee61773ed
|
Removed outdated discovery script.
|
2017-03-15 20:06:24 +00:00 |
Achim D. Brucker
|
34a7bf7228
|
Updated log directory.
|
2017-03-14 06:52:58 +00:00 |
Achim D. Brucker
|
5007e60c71
|
First working version that creates tar archives.
|
2017-03-13 07:02:17 +00:00 |
Achim D. Brucker
|
6892a614a6
|
Converted get_existing_ids to new tar-based file layout.
|
2017-03-01 12:48:29 +00:00 |