Commit Graph

500 Commits

Author SHA1 Message Date
Achim D. Brucker a547e840cb Normalized formatting. 2017-04-13 09:34:33 +01:00
Achim D. Brucker 0ee655f018 Interlaving forum and support download with crx download and removed inital wait before downloading first forum/support page. 2017-04-12 08:59:08 +01:00
Achim D. Brucker 0f88b5d8c5 Reduced pool size to reduce load. 2017-04-11 07:44:19 +01:00
Achim D. Brucker 63bf936e1e Avoid use of ReadTarFS (seems to be very slow compared to the tarfile module). 2017-04-10 07:08:52 +01:00
Achim D. Brucker 23fd7731bc Reduced waiting time for DOS protection. 2017-04-09 08:20:52 +01:00
Achim D. Brucker e65c21a3b1 Increased pool size to 48. 2017-04-08 00:12:40 +01:00
Achim D. Brucker c03fa789bd Fixed reporting of new extensions. 2017-04-07 07:07:49 +01:00
Achim D. Brucker c75cdc9d09 Switched to proper append mode for tar archive. 2017-04-06 21:42:59 +01:00
Achim D. Brucker a06d218073 Re-Formatting 2017-04-05 21:42:00 +01:00
Achim D. Brucker 86ed713b9d Updated last_crx call in update_extension to match new archive layout. 2017-04-04 22:51:45 +01:00
Achim D. Brucker 8cfd0d3bb2 Fixed folder confusion during tar file creation. 2017-04-03 21:32:53 +01:00
Achim D. Brucker 90d58705c4 Re-formatting. 2017-04-02 09:23:13 +01:00
Achim D. Brucker 308c0d8721 Improved log output. 2017-04-01 06:57:39 +01:00
Achim D. Brucker 5a8b76ce14 Move tar creation to (local) tmp dir. 2017-03-31 17:04:51 +01:00
Achim D. Brucker e72da5b3ff Catching even more file i/o-exceptions. 2017-03-28 06:38:12 +01:00
Achim D. Brucker 660ebcf34d Sync before executing large file operations. 2017-03-27 22:00:06 +01:00
Achim D. Brucker 00b59d8429 Ignore exceptions during backup creation. 2017-03-26 21:30:07 +01:00
Achim D. Brucker fe49f56959 Re-formatting. 2017-03-25 06:31:48 +00:00
Achim D. Brucker e6e8914004 Fixed call of write_text (missing argument to interface changes). 2017-03-24 06:19:40 +00:00
Achim D. Brucker 581f2ef10d Catch exception in case of corrupt tar file and rename tar file as mitigation. 2017-03-23 20:32:51 +00:00
Achim D. Brucker 26a9c7e8f1 Increased pool size to 24 to mitigitate longer downloads due to tar/untar-operations. 2017-03-22 05:44:09 +00:00
Achim D. Brucker 7007ddebb6 Ensure that dir is defined even if an exception is thrown. 2017-03-21 20:47:28 +00:00
Achim D. Brucker ad47feae61 Moved crx analysis in own module. 2017-03-18 09:21:18 +00:00
Achim D. Brucker 74992388e0 Re-formatting. 2017-03-16 08:30:33 +00:00
Achim D. Brucker 5007e60c71 First working version that creates tar archives. 2017-03-13 07:02:17 +00:00
Achim D. Brucker 6892a614a6 Converted get_existing_ids to new tar-based file layout. 2017-03-01 12:48:29 +00:00
Achim D. Brucker ad53411d55 Code reformatting. 2017-02-05 14:11:09 +00:00
Achim D. Brucker b1666aade0 Fixed datetime imports. 2017-02-03 09:45:51 +00:00
Achim D. Brucker f6a7a6466c Catch exception during discovery. 2017-02-01 07:32:52 +00:00
Achim D. Brucker 58f0e2cb1f Fixed non initialised variable in exception handling. 2017-01-31 22:35:05 +00:00
Achim D. Brucker 1802350dbb Added timeout for requests. 2017-01-31 09:52:21 +00:00
Achim D. Brucker c73b1e5ac2 Compute new extensions by checking if directory already exists. 2017-01-29 13:29:46 +00:00
Achim D. Brucker 828c6c95da Reformatting. 2017-01-28 17:22:28 +00:00
Achim D. Brucker 111c5394c3 Increased DDOS protection delay. 2017-01-28 17:21:25 +00:00
Achim D. Brucker f41a2f67b1 Only try to download crx if response status is 200. 2017-01-28 17:20:17 +00:00
Achim D. Brucker 18a3519bc5 Log messages are now (kind of) thread safe. 2017-01-28 17:08:18 +00:00
Achim D. Brucker 0083fd8aab Basic multithreading support. 2017-01-28 16:37:44 +00:00
Achim D. Brucker a301796a9b Ensure that new extensions are indeed unkown/new. 2017-01-28 15:27:31 +00:00
Achim D. Brucker 644419ed5d Fixed crx download validation. 2017-01-28 15:05:56 +00:00
Achim D. Brucker 2dbf90adc5 Flush output. 2017-01-28 14:49:29 +00:00
Achim D. Brucker 3cdeba20b4 Reformatting. 2017-01-28 13:15:05 +00:00
Achim D. Brucker 3ed43f036d Refactoring. 2017-01-28 13:12:47 +00:00
Achim D. Brucker 23e1147370 Refactoring. 2017-01-28 13:03:40 +00:00
Achim D. Brucker e8f01eae55 Refactoring. 2017-01-28 12:56:29 +00:00
Achim D. Brucker 9c4ba39558 Refactoring. 2017-01-28 12:52:18 +00:00
Achim D. Brucker bd53b117e5 Refactoring. 2017-01-27 22:40:07 +00:00
Achim D. Brucker 3dc7a5d663 Added comment on skipping language specific extension URLs. 2017-01-22 15:53:00 +00:00
Achim D. Brucker 6b38e2c738 Reformatting. 2017-01-21 18:47:44 +00:00
Achim D. Brucker b4756b3350 Modulified parse_sitemap. 2017-01-21 12:51:55 +00:00
Achim D. Brucker fac837d016 Module setup. 2017-01-20 23:02:56 +00:00