Commit Graph

69 Commits

Author SHA1 Message Date
Achim D. Brucker 7d1f41589f Reformatting. 2017-11-04 19:27:15 +00:00
Achim D. Brucker 7ba829c90f Made python 3.6 the default. 2017-11-02 18:46:20 +00:00
Achim D. Brucker b7bed2a341 Bug fix: log of corupted tar archives. 2017-10-12 00:01:41 +01:00
Michael Herzberg 98a2d69ebb This time actually disable annoying HTTPS log messages. 2017-09-18 13:41:54 +01:00
Michael Herzberg cee90ececc Moved urllib logger config. 2017-09-18 12:59:52 +01:00
Michael Herzberg 1ddb9c1c10 Surpress HTTPS connection log messages. 2017-09-17 12:26:51 +01:00
Michael Herzberg abd9605ebc Use python3.5 for all files. 2017-09-01 14:12:05 +01:00
Michael Herzberg 5c24608c4d Added --max-discover <N> option to limit the number of new extensions. 2017-09-01 13:30:42 +01:00
Michael Herzberg e06d3f4ac4 Reduced timeout and fixed logging. 2017-08-31 23:01:05 +01:00
Michael Herzberg cbd2dea820 Removed everything related to sqlite and updated README. 2017-08-30 15:38:04 +01:00
Michael Herzberg 5f234d8539 Improved logging. 2017-08-30 15:12:54 +01:00
Michael Herzberg 3e24d1f08c Changed logging to use logging library. 2017-08-29 22:29:38 +01:00
Michael Herzberg 9521240d90 Make stuff configurable. 2017-08-27 18:28:19 +01:00
Achim D. Brucker eb0054b47d Refactoring: Moved default configuration to config module. 2017-07-29 12:36:20 +01:00
Achim D. Brucker 659f37c90c Refactoring. 2017-07-28 21:18:10 +01:00
Achim D. Brucker d5d2251de9 Refactoring. 2017-07-28 20:21:38 +01:00
Achim D. Brucker 22f18ec3c8 Refactoring. 2017-07-28 19:44:51 +01:00
Achim D. Brucker 1833dbad90 Refactoring. 2017-07-28 15:57:17 +01:00
Achim D. Brucker 5658facebd Set unused variables to None to help garbage collector. 2017-07-28 15:32:19 +01:00
Achim D. Brucker 04d242ce7e Added sqlite3 version to config log. 2017-07-24 11:10:16 +01:00
Achim D. Brucker 675bd301cc Added missing parallel parameter to second call of update_extensions. 2017-06-21 15:26:48 +01:00
Achim D. Brucker c5a7f82e13 Fixed getopt setup. 2017-06-19 06:03:36 +01:00
Achim D. Brucker d9195c8174 Max. number of concurrent download can now be configured via command line. 2017-06-18 15:36:21 +01:00
Achim D. Brucker 2e6323c8c5 Report number of extensions for which the SQL database was updated. 2017-06-17 18:15:08 +01:00
Achim D. Brucker 760ac171f1 Releaxed supported version to 3.4 or 3.5. 2017-06-17 15:43:18 +01:00
Achim D. Brucker 97460c498f Basic support for logging of errors related to SQL import/update. 2017-06-17 00:43:40 +01:00
Achim D. Brucker 86a608c6a1 Re-formatting. 2017-06-16 23:19:13 +01:00
Achim D. Brucker 012c285c84 Added assert to ensure Python 3.5. 2017-06-16 22:46:04 +01:00
Achim D. Brucker af1aeb5b80 Re-formatting. 2017-03-30 07:53:04 +01:00
Achim D. Brucker 6513a5727a Report extensions with file corruption explicitely. 2017-03-29 06:07:27 +01:00
Achim D. Brucker 581f2ef10d Catch exception in case of corrupt tar file and rename tar file as mitigation. 2017-03-23 20:32:51 +00:00
Achim D. Brucker 8b38afedc5 Fixed file permissions. 2017-03-20 21:51:06 +00:00
Achim D. Brucker 74992388e0 Re-formatting. 2017-03-16 08:30:33 +00:00
Achim D. Brucker 34a7bf7228 Updated log directory. 2017-03-14 06:52:58 +00:00
Achim D. Brucker 9bc898812b Reformatting. 2017-02-04 00:07:48 +00:00
Achim D. Brucker 75e54d274c Fixed re-dowload bug wrt forum downloads. 2017-02-04 00:07:23 +00:00
Achim D. Brucker 2548940e0e Moved to full isodate/time for log file names. 2017-02-03 09:46:55 +00:00
Achim D. Brucker b1666aade0 Fixed datetime imports. 2017-02-03 09:45:51 +00:00
Achim D. Brucker a6d8d6d068 Fixed empty list check resulting in complete re-download. 2017-02-03 08:41:20 +00:00
Achim D. Brucker 51c7bf064f Retry to download extensions where an exception was thrown. 2017-02-02 01:51:29 +00:00
Achim D. Brucker c73b1e5ac2 Compute new extensions by checking if directory already exists. 2017-01-29 13:29:46 +00:00
Achim D. Brucker 3dd16d1a95 Log IDs with anomalies to log files. 2017-01-29 12:27:26 +00:00
Achim D. Brucker 828c6c95da Reformatting. 2017-01-28 17:22:28 +00:00
Achim D. Brucker a301796a9b Ensure that new extensions are indeed unkown/new. 2017-01-28 15:27:31 +00:00
Achim D. Brucker f99a931f43 Create empty dirs. 2017-01-28 14:37:35 +00:00
Achim D. Brucker 24dd304a6d Print summary to stderr. 2017-01-28 14:20:56 +00:00
Achim D. Brucker c631c22827 Support command line options. 2017-01-28 14:01:53 +00:00
Achim D. Brucker 41a5eddb24 Log runtime. 2017-01-28 13:32:47 +00:00
Achim D. Brucker 3cdeba20b4 Reformatting. 2017-01-28 13:15:05 +00:00
Achim D. Brucker 3ed43f036d Refactoring. 2017-01-28 13:12:47 +00:00