Commit Graph

156 Commits

Author SHA1 Message Date
Achim D. Brucker d491ff2950 Increased yscale. 2020-04-03 14:48:28 +01:00
Achim D. Brucker 671395d9d1 Reduced number of parallel downloads to reduce memory footprint. 2020-03-22 21:22:34 +00:00
Achim D. Brucker 68496ecaa6 Install libmariadb-dev-compat - required by Python packages for mysql_config .... 2019-10-23 12:08:11 +01:00
Achim D. Brucker b1a23da67d Various bug fixes. 2019-05-23 08:58:55 +01:00
Achim D. Brucker 72e737328d Increased yrange. 2019-05-15 21:54:22 +01:00
Michael Herzberg 8903d6c896 Added dockerfile for building singularity-images. 2019-02-28 13:09:26 +00:00
Achim D. Brucker c835691f23 Moved singularity build scripts into scripts folder. 2019-02-27 21:33:20 +00:00
Achim D. Brucker 7a0f7ea496 Initial commit. 2019-02-27 19:36:57 +00:00
Achim D. Brucker e81065aecc Restructuring. 2019-02-11 22:01:00 +00:00
Achim D. Brucker cbe93ddeb6 Restructuring. 2019-02-11 22:01:00 +00:00
Achim D. Brucker 7994c96c2a Restructuring. 2019-02-10 21:01:00 +00:00
Achim D. Brucker 6992c9cfea Replace , by . in log file names. 2019-01-29 08:46:51 +00:00
Achim D. Brucker 7f44b32b70 Fixed find constraints. 2019-01-28 23:13:56 +00:00
Achim D. Brucker fa52a9a1da Submit a job for a compressing a group instead of an individual file. 2019-01-28 22:22:25 +00:00
Achim D. Brucker be4c7afd5b Replace , by . in log file names. 2019-01-28 22:10:54 +00:00
Achim D. Brucker c81fc59ae4 Initial commit: HPC-based compression of tar archives. 2019-01-27 10:28:01 +00:00
Achim D. Brucker 9745ba2c1a Renaming. 2019-01-26 18:01:34 +00:00
Achim D. Brucker ab6e49b549 Fixed log file name. 2019-01-26 18:00:12 +00:00
Achim D. Brucker ae78ef64d6 Only search for logs in monthly directories. 2019-01-26 17:46:09 +00:00
Achim D. Brucker 42f1c0814d Move log files into monthy directory. 2019-01-26 17:27:34 +00:00
Achim D. Brucker bfabb5d083 Only search for logs in monthly directories. 2019-01-26 17:26:27 +00:00
Achim D. Brucker 27253df451 Initial commit. 2019-01-26 16:57:44 +00:00
Achim D. Brucker 44ea1557e5 Log into year-month directory. 2019-01-25 15:01:41 +00:00
Achim D. Brucker f666b2baf6 Move log files into monthy directory. 2019-01-23 12:18:03 +00:00
Achim D. Brucker b7cad23da6 Normalized dates used in log file names. 2019-01-23 09:59:45 +00:00
Achim D. Brucker 2289e8ecc2 Removed reporting of WorkerExceptions. 2018-11-10 16:50:13 +00:00
Achim D. Brucker 19bccc8be1 Reverted fix for double reporting of downloads. 2018-09-02 20:18:09 +01:00
Achim D. Brucker cb974b6ddf Hack: divide download numbers by two to adapt to log format changes after disabling forkserver. 2018-09-02 11:11:33 +01:00
Achim D. Brucker a66620bcc7 Added plot of extension archive size. 2018-08-31 10:49:14 +01:00
Achim D. Brucker 449216907e Increased y-scale to match larger number of extensions (and max download speed). 2018-08-31 10:30:13 +01:00
Achim D. Brucker d7496c8c56 Report WorkerException warnings. 2018-08-19 21:29:07 +01:00
Achim D. Brucker 3cd1b221fd Added reporting of WorkerExceptions. 2018-08-17 22:08:40 +01:00
Achim D. Brucker 4356335659 Removed -m options not supported by ts on our server. 2018-06-19 20:12:20 +01:00
Achim D. Brucker 25d6e04d6e Create log file for output to stderr. 2018-06-15 23:05:28 +01:00
Achim D. Brucker d04086b7ad Fixed mail notification for stalled download. 2018-06-14 08:15:35 +01:00
Achim D. Brucker bad8334df1 Report parallel downloads instead of total downloads as fourth column. 2018-04-27 16:29:32 +01:00
Michael Herzberg 738d7e9b4f Adjusted monitor script for new log line. 2018-04-21 20:13:08 +01:00
Michael Herzberg ac3c1c7f20 Removed plain multiprocessing option. 2018-04-21 17:25:22 +01:00
Michael Herzberg 87b2847c6e Make ProcessPool and pystuck the default (for now). 2018-04-11 15:39:23 +01:00
Achim D. Brucker 0c70b2e20b Increase number of parallel downloads. 2018-04-08 22:45:56 +01:00
Achim D. Brucker 70b64616e1 Ensure the use of /usr/bin/mail. 2018-04-08 09:59:03 +01:00
Achim D. Brucker 7f71a40ff4 Configured number of parallel processes. 2018-04-07 21:14:36 +01:00
Achim D. Brucker a3c60c0ae8 Ensure that mail recipient is defined. 2018-04-07 17:54:15 +01:00
Achim D. Brucker a7f0b26ead Log memory usage. 2018-04-07 16:26:00 +01:00
Achim D. Brucker 2fc154d643 Use UTC-based time/dates for logging. 2018-04-07 15:54:39 +01:00
Achim D. Brucker 91a76091e3 Use UTC-based time/dates for logging. 2018-04-07 15:42:29 +01:00
Achim D. Brucker 6a86b37e7c Increase number of parallel downloads. 2018-04-06 21:36:11 +01:00
Achim D. Brucker 69f1618db2 Reduced number of parallel downloads, as pebble seems to be much more memory hungry ... 2018-04-06 13:34:36 +01:00
Achim D. Brucker bf6269c600 Bug fix: warning mail for stalled download. 2018-04-05 17:05:51 +01:00
Achim D. Brucker 2d33f3bebe Added pdf output. 2018-04-04 09:35:35 +01:00