Michael Herzberg
|
a789fe505f
|
Fixed style errors and warnings.
|
2018-04-21 19:00:07 +01:00 |
|
Michael Herzberg
|
46494ec18b
|
Re-setup logging in new processes.
|
2018-04-10 18:19:12 +01:00 |
 Achim D. Brucker
|
e1ef0758f7
|
Made the choice of Pool vs. ProcessPool a configuration option.
|
2018-04-08 10:06:26 +01:00 |
|
Achim D. Brucker
|
d3fe5e758a
|
New default download timeout to 2 hours.
|
2018-04-06 12:08:02 +01:00 |
|
Achim D. Brucker
|
8c9aab8216
|
Converted timeout into a proper configuration parameter.
|
2018-04-06 07:25:21 +01:00 |
|
Achim D. Brucker
|
9586eed280
|
Added documentation.
|
2018-04-06 07:18:15 +01:00 |
|
Achim D. Brucker
|
fd9cc1855a
|
Improved command line interface for selecting which type of extensiosn should be crawled.
|
2018-04-06 07:17:20 +01:00 |
|
Achim D. Brucker
|
fee88ed0fe
|
Implemented sequential download mode.
|
2018-04-05 17:32:11 +01:00 |
|
Achim D. Brucker
|
781148be4f
|
Reformatting.
|
2017-11-29 08:40:28 +09:00 |
|
Achim D. Brucker
|
ac910bf819
|
Updated python version to 3.6.
|
2017-11-07 20:58:24 +00:00 |
 Michael Herzberg
|
c3e295267b
|
Log loglevel and only print stacktrace on first mysql exception.
|
2017-09-16 17:22:57 +01:00 |
|
Achim D. Brucker
|
a6e90794bc
|
Extended const_basedir to check environment variable EXTENSION_ARCHIVE and modified main scripts to actually use const_basedir.
|
2017-09-10 15:55:22 +01:00 |
|
Michael Herzberg
|
ab943c87f0
|
Expand user directory for mysql config file.
|
2017-09-01 16:17:51 +01:00 |
|
Michael Herzberg
|
abd9605ebc
|
Use python3.5 for all files.
|
2017-09-01 14:12:05 +01:00 |
|
Michael Herzberg
|
e06d3f4ac4
|
Reduced timeout and fixed logging.
|
2017-08-31 23:01:05 +01:00 |
|
Michael Herzberg
|
ccf43de3d0
|
Pad process id to 6 chars.
|
2017-08-30 20:05:17 +01:00 |
|
Michael Herzberg
|
cbd2dea820
|
Removed everything related to sqlite and updated README.
|
2017-08-30 15:38:04 +01:00 |
|
Michael Herzberg
|
12c111ca11
|
Once more, make mysql the default. Also, increased timeout.
|
2017-08-30 12:13:25 +01:00 |
|
Michael Herzberg
|
3e24d1f08c
|
Changed logging to use logging library.
|
2017-08-29 22:29:38 +01:00 |
|
Michael Herzberg
|
8b91957372
|
Reduced default MySQL timeout.
|
2017-08-29 15:20:58 +01:00 |
|
Michael Herzberg
|
c30f0c4147
|
Removed database and host setting. To be set in ~/.my.cnf file now.
|
2017-08-28 20:17:11 +01:00 |
|
Michael Herzberg
|
81077b807c
|
Added mysql retry logic and use time.time() now.
|
2017-08-28 11:50:41 +01:00 |
|
Michael Herzberg
|
9521240d90
|
Make stuff configurable.
|
2017-08-27 18:28:19 +01:00 |
|
Achim D. Brucker
|
eb0054b47d
|
Refactoring: Moved default configuration to config module.
|
2017-07-29 12:36:20 +01:00 |
|
Achim D. Brucker
|
d05ca9678e
|
Refactoring.
|
2017-07-29 10:57:35 +01:00 |
|
Michael Herzberg
|
b3d1ab912e
|
Wait a maximum of 10min before stopping jsbeautifier.
|
2017-07-25 22:57:55 +01:00 |
|
Michael Herzberg
|
eded1ca893
|
Only attempt to search for replies when we actually have search parameters.
|
2017-07-16 20:14:50 +01:00 |
|
Michael Herzberg
|
51bdcb4f16
|
Also download replies for support forum.
|
2017-07-12 16:57:16 +01:00 |
|
Michael Herzberg
|
11b0ccee4a
|
Added download of review replies.
|
2017-07-12 16:10:47 +01:00 |
|
Achim D. Brucker
|
05227494d6
|
Re-formatting
|
2017-06-20 18:17:36 +01:00 |
|
Michael Herzberg
|
d2dd2aaf81
|
Moved db path into config file.
|
2017-06-20 08:10:28 +01:00 |
|
Achim D. Brucker
|
86a608c6a1
|
Re-formatting.
|
2017-06-16 23:19:13 +01:00 |
|
Achim D. Brucker
|
1c8d68d495
|
Moved path utility functions into config module.
|
2017-06-16 23:09:23 +01:00 |
|
Achim D. Brucker
|
bd53b117e5
|
Refactoring.
|
2017-01-27 22:40:07 +00:00 |
|
Achim D. Brucker
|
fac837d016
|
Module setup.
|
2017-01-20 23:02:56 +00:00 |