 Achim D. Brucker
|
c5dce7bcd0
|
Fixed decoding of content (str_data).
|
2017-11-15 07:12:41 +00:00 |
|
Achim D. Brucker
|
0667c5e0f2
|
Removed outdated cdnjs crawler (replaced by git miner instead).
|
2017-11-13 17:05:37 +00:00 |
|
Achim D. Brucker
|
24bdd9a1c5
|
Added log messages for cron report.
|
2017-11-12 14:49:51 +00:00 |
|
Achim D. Brucker
|
91e6014c6c
|
Moved to single-threaded mode.
|
2017-11-12 14:07:25 +00:00 |
|
Achim D. Brucker
|
4cb49f2281
|
Merge branch 'production'
|
2017-11-11 21:56:33 +00:00 |
|
Achim D. Brucker
|
9bd283f35a
|
Fixed use of append.
|
2017-11-10 00:13:06 +00:00 |
|
Achim D. Brucker
|
7dfbdac670
|
Disabled parallel updates (for debugging a deadlock situation).
|
2017-11-09 23:38:05 +00:00 |
|
Achim D. Brucker
|
5cc7a92f90
|
Fixed typo.
|
2017-11-09 00:17:09 +00:00 |
|
Achim D. Brucker
|
d8956bae04
|
Updated latest python dependency.
|
2017-11-08 22:11:15 +00:00 |
|
Achim D. Brucker
|
ac910bf819
|
Updated python version to 3.6.
|
2017-11-07 20:58:24 +00:00 |
|
Achim D. Brucker
|
631f461d1f
|
Removed not supported connection_timeout parameter.
|
2017-11-06 06:11:14 +00:00 |
|
Achim D. Brucker
|
d0b173c55f
|
Disable automatic python module update.
|
2017-11-05 20:15:05 +00:00 |
|
Achim D. Brucker
|
6279bd9909
|
Fixed syntax error.
|
2017-11-05 20:14:12 +00:00 |
|
Achim D. Brucker
|
15079496cc
|
Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler
|
2017-11-05 00:07:23 +00:00 |
|
Achim D. Brucker
|
fcab770233
|
Reformatting.
|
2017-11-05 00:07:04 +00:00 |
|
Achim D. Brucker
|
07a7b346c7
|
Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler
|
2017-11-04 23:14:27 +00:00 |
|
Achim D. Brucker
|
58b317b95a
|
Reformatting.
|
2017-11-04 19:27:34 +00:00 |
|
Achim D. Brucker
|
62bb639d67
|
Reformatting.
|
2017-11-04 19:27:27 +00:00 |
|
Achim D. Brucker
|
0db22c3217
|
Reformatting.
|
2017-11-04 19:27:21 +00:00 |
|
Achim D. Brucker
|
7d1f41589f
|
Reformatting.
|
2017-11-04 19:27:15 +00:00 |
|
Achim D. Brucker
|
676bdcb0c0
|
Updated python dependencies.
|
2017-11-03 21:17:21 +00:00 |
|
Achim D. Brucker
|
8dbc04f16e
|
Removed grepper, replaced by crx-jsstrings.
|
2017-11-03 18:40:53 +00:00 |
|
Achim D. Brucker
|
1c8694dcb8
|
Bind /srv/.
|
2017-11-02 19:18:53 +00:00 |
|
Achim D. Brucker
|
9bc9889767
|
Fixed location of singularity image.
|
2017-11-02 19:09:29 +00:00 |
|
Achim D. Brucker
|
be7f9919ad
|
Use singularity for extension update.
|
2017-11-02 18:50:24 +00:00 |
|
Achim D. Brucker
|
7ba829c90f
|
Made python 3.6 the default.
|
2017-11-02 18:46:20 +00:00 |
|
Achim D. Brucker
|
cfc26e62d7
|
Free git object as early as possible.
|
2017-10-22 21:20:49 +01:00 |
|
Achim D. Brucker
|
0963ea59d3
|
Fixed typo.
|
2017-10-21 20:12:19 +01:00 |
|
Achim D. Brucker
|
d88e73167d
|
Explicitely free git_obj.
|
2017-10-20 18:59:53 +01:00 |
|
Achim D. Brucker
|
14994e698b
|
Reformatting.
|
2017-10-19 16:44:49 +01:00 |
|
Achim D. Brucker
|
bb91e3874d
|
Reformatting.
|
2017-10-19 16:44:36 +01:00 |
|
Achim D. Brucker
|
1203b4d581
|
Ensure default for TMPDIR.
|
2017-10-18 20:20:42 +01:00 |
|
Achim D. Brucker
|
e4a8075da9
|
Configure timeout and retries for data base connection.
|
2017-10-18 20:19:43 +01:00 |
|
Achim D. Brucker
|
9f5d8f9b9e
|
Added logs during creation of db connection.
|
2017-10-18 08:35:27 +01:00 |
|
Achim D. Brucker
|
6851223a6d
|
Fixed log file name.
|
2017-10-18 08:35:04 +01:00 |
|
Achim D. Brucker
|
85b7f01751
|
Bug fix: name of log file.
|
2017-10-17 18:14:33 +01:00 |
|
Achim D. Brucker
|
2dc8408b6b
|
Bug fix: added ARCHIVE.
|
2017-10-17 17:44:13 +01:00 |
|
Achim D. Brucker
|
df2a3778de
|
Bug fix: variable.
|
2017-10-17 15:42:03 +01:00 |
|
Achim D. Brucker
|
14da483046
|
Even more logging.
|
2017-10-17 15:17:29 +01:00 |
|
Achim D. Brucker
|
887f8ec3d2
|
Create backup if image before updating it.
|
2017-10-17 15:09:18 +01:00 |
|
Achim D. Brucker
|
9031a5cbb5
|
Added log file.
|
2017-10-17 06:50:48 +01:00 |
|
Achim D. Brucker
|
37ebd510c9
|
Reformatting.
|
2017-10-16 09:47:14 +01:00 |
|
Achim D. Brucker
|
4ee9c51ef7
|
Reformatting.
|
2017-10-16 09:42:43 +01:00 |
|
Achim D. Brucker
|
fc33abb7a6
|
Fixed logging.
|
2017-10-16 09:35:53 +01:00 |
|
Achim D. Brucker
|
8780eb8f2f
|
Added further logging output (info).
|
2017-10-16 05:36:59 +01:00 |
|
Achim D. Brucker
|
bbfbbed35a
|
Identify ressource/media files using the file library.
|
2017-10-15 15:34:45 +01:00 |
|
Achim D. Brucker
|
f22c234267
|
Initial commit.
|
2017-10-15 14:06:20 +01:00 |
 Michael Herzberg
|
afe137ba36
|
Integrated last_crx_etag into last_crx.
|
2017-10-14 19:59:46 +01:00 |
|
Achim D. Brucker
|
8dbf867183
|
Added command line option to avoid use of external database.
|
2017-10-14 19:23:51 +01:00 |
|
Achim D. Brucker
|
64bc9bd90d
|
Make use of data base with md5 sums optional.
|
2017-10-14 19:17:37 +01:00 |