Commit Graph

49 Commits

Author SHA1 Message Date
Achim D. Brucker 77895218e4 Port to latest MysqlDB module. 2020-03-02 09:17:04 +00:00
Michael Herzberg d4d7e3c8ca Fix missing host error in mariadb 10.3 config files. 2019-01-23 16:48:31 +00:00
Michael Herzberg 66db569d5f Only open DB connection when needed. 2018-08-02 12:37:57 +01:00
Michael Herzberg 05c1cbdea5 Give MySQL server up to 1 hour to recover. 2018-08-02 11:47:38 +01:00
Michael Herzberg 947ecf50d4 Removed queue length and reduced mysql insert batch size. 2018-07-28 19:02:38 +02:00
Michael Herzberg 45a8486f69 Fixed small bug. 2018-07-27 16:39:42 +02:00
Michael Herzberg 250bdd2c6b Bundle mysql inserts. 2018-07-19 23:26:25 +01:00
Michael Herzberg a1d866d0ff Overwrite last_updated on duplicate. 2018-07-17 14:06:43 +01:00
Michael Herzberg a6173fe23e Don't look for etags in the DB anymore. 2018-07-16 19:19:26 +01:00
Michael Herzberg 4b5cc276ee Added option to use INSERT DELAYED with create-db. 2018-07-16 19:14:24 +01:00
Michael Herzberg 8bc4e8fa37 Cache etags in applications. 2018-07-16 01:04:27 +01:00
Michael Herzberg 3bef0afe7a Group mysql inserts and don't compress them. 2018-07-15 00:08:11 +01:00
Michael Herzberg 651506bd0c Sort db inserts to prevent deadlocks. 2018-06-13 09:33:55 +01:00
Michael Herzberg 5b0f49b35a Deleted annoying Creating DB Connection message. 2018-04-21 20:35:23 +01:00
Michael Herzberg d8d49b1b80 Moved ext_id into logger formatter to make logger output more uniform. 2018-04-21 19:59:02 +01:00
Michael Herzberg a789fe505f Fixed style errors and warnings. 2018-04-21 19:00:07 +01:00
Michael Herzberg 0c3423dcd8 Fitted db connection log messages into our logging framework. 2018-04-07 00:42:39 +01:00
Achim D. Brucker 0963ea59d3 Fixed typo. 2017-10-21 20:12:19 +01:00
Achim D. Brucker 9f5d8f9b9e Added logs during creation of db connection. 2017-10-18 08:35:27 +01:00
Achim D. Brucker ee7ce8b446 Report stored library filename of detected libraries. 2017-10-11 08:48:20 +01:00
Achim D. Brucker c6e5cb8511 Basic implementation: md5 checksum based library detection. 2017-10-11 00:40:06 +01:00
Michael Herzberg 048990e8f8 Turned dbbackend into a package. 2017-10-10 15:10:41 +01:00
Michael Herzberg 301ad23d4c Use new review etc. table structure. 2017-10-09 17:18:01 +01:00
Michael Herzberg 2b1e55c7ec Fixed import. 2017-10-09 13:56:22 +01:00
Michael Herzberg 300a8c905a Only log last mysql exception as error, rest as warning. 2017-10-08 20:57:25 +01:00
Michael Herzberg 615b8f46a3 Fixed mysql caching. 2017-10-07 21:01:14 +01:00
Michael Herzberg d05194b9bb Group cached commits for efficiency. 2017-10-06 12:08:21 +01:00
Michael Herzberg 2cb56edd9b Adjusted retries for create-db. 2017-10-05 11:14:59 +01:00
Michael Herzberg 6ba73c2ed9 Changed autocommit behaviour. 2017-10-04 20:56:47 +01:00
Michael Herzberg 4712e15249 Fixed autocommit bug. 2017-09-19 17:09:35 +01:00
Michael Herzberg 7277e6f76e Fixed log msg bug. 2017-09-17 17:45:01 +01:00
Michael Herzberg c3e295267b Log loglevel and only print stacktrace on first mysql exception. 2017-09-16 17:22:57 +01:00
Michael Herzberg 58aacef3ff Reopen connection after every exception. 2017-09-16 12:31:00 +01:00
Michael Herzberg 85680d360b Automatically reopen database connection on failure. 2017-09-15 18:23:25 +01:00
Michael Herzberg ddbbc2672d Try to insert also other data if some inserts fail. Use autocommit to prevent data loss on retries. 2017-09-15 18:15:03 +01:00
Michael Herzberg 36d36facfe Relaxed mysql retries. 2017-09-04 15:54:28 +01:00
Michael Herzberg 4145f88a94 MySQL wait +/- 20%. 2017-08-30 19:59:15 +01:00
Michael Herzberg b76eef12d5 Added randomized delay for MySQL. 2017-08-30 18:55:13 +01:00
Michael Herzberg bde59c5040 Fixed crx_etag select bug and some logging. 2017-08-30 16:32:36 +01:00
Michael Herzberg cbd2dea820 Removed everything related to sqlite and updated README. 2017-08-30 15:38:04 +01:00
Michael Herzberg 5f234d8539 Improved logging. 2017-08-30 15:12:54 +01:00
Michael Herzberg 47f424cf2f Added more logging. 2017-08-29 23:10:46 +01:00
Michael Herzberg 2b11117b6f Always process crx, regardless whether or not crx_etag is already in db. 2017-08-29 15:24:59 +01:00
Michael Herzberg 81077b807c Added mysql retry logic and use time.time() now. 2017-08-28 11:50:41 +01:00
Michael Herzberg 257afe92f0 Use selective insert. 2017-08-27 23:00:28 +01:00
Michael Herzberg 9521240d90 Make stuff configurable. 2017-08-27 18:28:19 +01:00
Michael Herzberg d4b0a6535b Fixed some things. 2017-08-27 16:57:23 +01:00
Michael Herzberg 585c8faf0e Added mysql, but still outcommented. 2017-08-27 02:53:15 +01:00
Michael Herzberg c5c04cd1ed Refactored sqlite-specifics into own class. 2017-08-27 00:22:19 +01:00