 Achim D. Brucker
|
6e9ff09e3c
|
Switched to python 3.7.
|
2019-02-01 13:42:04 +00:00 |
|
Achim D. Brucker
|
c90bfb5fbb
|
Added support for xz compressed archives.
|
2018-11-10 20:48:00 +00:00 |
Michael Herzberg
|
05c1cbdea5
|
Give MySQL server up to 1 hour to recover.
|
2018-08-02 11:47:38 +01:00 |
|
Michael Herzberg
|
250bdd2c6b
|
Bundle mysql inserts.
|
2018-07-19 23:26:25 +01:00 |
|
Michael Herzberg
|
4b5cc276ee
|
Added option to use INSERT DELAYED with create-db.
|
2018-07-16 19:14:24 +01:00 |
|
Michael Herzberg
|
3bef0afe7a
|
Group mysql inserts and don't compress them.
|
2018-07-15 00:08:11 +01:00 |
|
Michael Herzberg
|
5b9971ecec
|
Fixed path.
|
2018-06-10 11:21:23 +01:00 |
|
Michael Herzberg
|
d88a7b1e3c
|
Optimized tar file discover when reading ids from file.
|
2018-06-10 01:44:53 +01:00 |
|
Michael Herzberg
|
78bd8a376d
|
Bringing create-db up-to-date.
|
2018-05-15 00:33:37 +01:00 |
|
Michael Herzberg
|
d8d49b1b80
|
Moved ext_id into logger formatter to make logger output more uniform.
|
2018-04-21 19:59:02 +01:00 |
|
Michael Herzberg
|
a789fe505f
|
Fixed style errors and warnings.
|
2018-04-21 19:00:07 +01:00 |
|
Achim D. Brucker
|
0db22c3217
|
Reformatting.
|
2017-11-04 19:27:21 +00:00 |
|
Achim D. Brucker
|
7ba829c90f
|
Made python 3.6 the default.
|
2017-11-02 18:46:20 +00:00 |
 Michael Herzberg
|
2cb56edd9b
|
Adjusted retries for create-db.
|
2017-10-05 11:14:59 +01:00 |
|
Michael Herzberg
|
87af0019b4
|
Catch mysql exception.
|
2017-10-05 11:00:19 +01:00 |
|
Michael Herzberg
|
6ba73c2ed9
|
Changed autocommit behaviour.
|
2017-10-04 20:56:47 +01:00 |
|
Michael Herzberg
|
c57bce2491
|
Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler
|
2017-09-15 17:42:05 +01:00 |
|
Michael Herzberg
|
5ce3f2a148
|
Added until-date option.
|
2017-09-12 11:01:44 +01:00 |
|
Achim D. Brucker
|
a6e90794bc
|
Extended const_basedir to check environment variable EXTENSION_ARCHIVE and modified main scripts to actually use const_basedir.
|
2017-09-10 15:55:22 +01:00 |
|
Michael Herzberg
|
c94f23dcee
|
Added --from-date option for create-db.
|
2017-09-02 17:42:18 +01:00 |
|
Michael Herzberg
|
abd9605ebc
|
Use python3.5 for all files.
|
2017-09-01 14:12:05 +01:00 |
|
Michael Herzberg
|
cbd2dea820
|
Removed everything related to sqlite and updated README.
|
2017-08-30 15:38:04 +01:00 |
|
Michael Herzberg
|
5f234d8539
|
Improved logging.
|
2017-08-30 15:12:54 +01:00 |
|
Michael Herzberg
|
9b8a693a5f
|
Changed logging a little bit.
|
2017-08-30 12:12:57 +01:00 |
|
Michael Herzberg
|
3e24d1f08c
|
Changed logging to use logging library.
|
2017-08-29 22:29:38 +01:00 |
|
Michael Herzberg
|
35ec26e001
|
Flush guarded output immediatly and remove parallelism for sharc jobs :(.
|
2017-08-28 11:56:34 +01:00 |
|
Michael Herzberg
|
81077b807c
|
Added mysql retry logic and use time.time() now.
|
2017-08-28 11:50:41 +01:00 |
|
Michael Herzberg
|
e04ec98eca
|
Added logging for create-db.
|
2017-08-27 23:04:38 +01:00 |
|
Michael Herzberg
|
295649ac1e
|
Reduced logging output.
|
2017-08-24 08:07:37 +01:00 |
|
Michael Herzberg
|
9a5646240e
|
Adjusted logging.
|
2017-08-23 19:52:59 +01:00 |
|
Michael Herzberg
|
3d896c104d
|
Also improved create-db script.
|
2017-08-23 18:04:33 +01:00 |
|
Michael Herzberg
|
4cc8a2695e
|
Fixed import.
|
2017-07-31 16:19:20 +01:00 |
|
Achim D. Brucker
|
931ae4f7ed
|
Normalized script name.
|
2017-06-30 18:39:26 +01:00 |