 Michael Herzberg
|
cbd2dea820
|
Removed everything related to sqlite and updated README.
|
2017-08-30 15:38:04 +01:00 |
|
Michael Herzberg
|
98e6b37f20
|
Cleaned up scripts.
|
2017-08-23 20:38:27 +01:00 |
 Achim D. Brucker
|
fddd2374c4
|
Set sqlite pragmas.
|
2017-08-22 23:26:11 +01:00 |
|
Achim D. Brucker
|
3bba0913c0
|
Sync file systems prior to critical operations.
|
2017-08-21 08:15:10 +01:00 |
|
Achim D. Brucker
|
3b88b21469
|
Report analysis results using tee.
|
2017-08-19 22:44:30 +01:00 |
|
Achim D. Brucker
|
216fd64b90
|
Removed non required rm command.
|
2017-08-19 12:33:34 +01:00 |
|
Achim D. Brucker
|
1bd097b863
|
Force /usr/bin/mail as mailer.
|
2017-08-19 12:29:18 +01:00 |
|
Achim D. Brucker
|
1dbd0a9f4a
|
Ad-hoc integration of a first analysis to be run after building the data base.
|
2017-08-17 13:07:29 +01:00 |
|
Michael Herzberg
|
116c76a719
|
Fixed global update db.
|
2017-08-15 15:31:30 +01:00 |
|
Achim D. Brucker
|
de8160df04
|
Bug fix: corrected file name for size check of aa-ac.sqlite.bz2.
|
2017-08-13 16:09:54 +01:00 |
|
Achim D. Brucker
|
cd131cb4b8
|
Create tmp/build db to minimize the time in which no db is available.
|
2017-08-10 09:06:09 +01:00 |
|
Achim D. Brucker
|
5af2cff2d5
|
Updated cron example.
|
2017-08-10 09:05:40 +01:00 |
|
Achim D. Brucker
|
d8bd7af2dd
|
Refactoring: Generate databases from backup.
|
2017-08-09 20:27:49 +01:00 |
|
Michael Herzberg
|
b8f57196c7
|
Changed fts table structure.
|
2017-07-31 23:23:57 +01:00 |
|
Michael Herzberg
|
4d0b2b5ec5
|
Fixed sge_common and merge script.
|
2017-07-31 14:21:57 +01:00 |
|
Michael Herzberg
|
44756e44d6
|
Added python-based sqlite merger.
|
2017-07-28 16:47:25 +01:00 |
|
Achim D. Brucker
|
9b291d02ae
|
Added local bin/lib-directory to PATH.
|
2017-07-24 10:47:42 +01:00 |
|
Achim D. Brucker
|
d6d1d21d05
|
Bug fix: Append log to log instead of overwritting it.
|
2017-07-24 10:26:03 +01:00 |
|
Achim D. Brucker
|
2bf32b7a8f
|
Merge branch 'production' of logicalhacking.com:BrowserSecurity/ExtensionCrawler into production
|
2017-07-22 21:14:07 +01:00 |
|
Achim D. Brucker
|
052748af07
|
Create log file for profiling.
|
2017-07-20 07:51:30 +01:00 |
|
Achim D. Brucker
|
c73f4cda3e
|
Fixed log output.
|
2017-07-19 07:01:38 +01:00 |
|
Michael Herzberg
|
cf0478d740
|
Added sge file for merging the individual dbs into the individual dbs of our archive.
|
2017-07-18 23:51:11 +01:00 |
|
Achim D. Brucker
|
3346b1b61a
|
Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler
|
2017-07-16 14:02:40 +01:00 |
|
Achim D. Brucker
|
049db03021
|
Add user local to binary and library search paths.
|
2017-07-16 14:02:22 +01:00 |
|
Michael Herzberg
|
5e60715d98
|
Removed schema creation from scripts as it is now being done by the merge script.
|
2017-07-13 14:47:42 +01:00 |
|
Michael Herzberg
|
34e62d4e13
|
Merge branch 'master' of logicalhacking.com:BrowserSecurity/ExtensionCrawler
|
2017-07-13 14:43:50 +01:00 |
|
Michael Herzberg
|
a901fa30bb
|
Adjusted merge scripts for fts tables.
|
2017-07-13 14:43:37 +01:00 |
|
Achim D. Brucker
|
02ce0cfd2c
|
Print info: sqlite3 binary used.
|
2017-07-12 20:36:29 +01:00 |
|
Michael Herzberg
|
2cb868b3d0
|
Removed removal of review row ids as we now use author ids as primary keys.
|
2017-07-12 18:13:04 +01:00 |
|
Michael Herzberg
|
885f580f2e
|
Fixed set -u.
|
2017-07-11 11:15:43 +01:00 |
|
Michael Herzberg
|
6d03e8da71
|
Refactored sge scripts.
|
2017-07-11 11:11:32 +01:00 |
|
Michael Herzberg
|
8ca76f373e
|
Made extension crawler repo path mandatory for sge scripts.
|
2017-07-10 15:25:56 +01:00 |
|
Michael Herzberg
|
00ad40e3a0
|
Added more sge scripts.
|
2017-07-10 14:42:03 +01:00 |
|
Michael Herzberg
|
af68a95139
|
Fixed sed string.
|
2017-07-10 12:28:55 +01:00 |
|
Achim D. Brucker
|
817cf11ca7
|
Update script via cron.
|
2017-07-02 17:35:51 +01:00 |
|
Achim D. Brucker
|
c7a06dcf8e
|
Remove old compressed sqlite file prior to compressing updated sqlite file.
|
2017-07-02 17:31:48 +01:00 |
|
Achim D. Brucker
|
cc80684630
|
Disabled compressing of log files due to raise condition problems on network mounted drive.
|
2017-07-02 17:30:09 +01:00 |
|
Achim D. Brucker
|
4aad117c12
|
Simple script for syncing a local archive (excerpt of the total archive) for development or debugging.
|
2017-07-02 16:11:20 +01:00 |
|
Achim D. Brucker
|
b73ed18b67
|
Ignore errors while compressing log files.
|
2017-07-01 20:09:00 +01:00 |
|
Achim D. Brucker
|
797328b855
|
Overwrite compressed files.
|
2017-07-01 19:57:29 +01:00 |
|
Achim D. Brucker
|
5702a43368
|
Use parallel bzip2 (pbzip2) instead of regular bzip2.
|
2017-06-30 20:54:08 +01:00 |
|
Achim D. Brucker
|
062f2dea26
|
Report size before/after compressing of data base files.
|
2017-06-30 20:02:49 +01:00 |
|
Achim D. Brucker
|
931ae4f7ed
|
Normalized script name.
|
2017-06-30 18:39:26 +01:00 |
|
Achim D. Brucker
|
70f69f652f
|
Compress aa-ac.sqlite.
|
2017-06-29 22:46:59 +01:00 |
|
Achim D. Brucker
|
ef04c71314
|
Delete compressed database before re-creating it.
|
2017-06-29 20:38:31 +01:00 |
|
Achim D. Brucker
|
77c1fae66d
|
Compress log files.
|
2017-06-29 20:22:13 +01:00 |
|
Achim D. Brucker
|
69c20edfe8
|
Use same date/time for log files.
|
2017-06-29 19:45:21 +01:00 |
|
Achim D. Brucker
|
1f963ff4e4
|
Improved log output.
|
2017-06-28 20:34:47 +01:00 |
|
Achim D. Brucker
|
0a3d46f6da
|
Simple update script to simplify crontab entries.
|
2017-06-27 14:19:13 +01:00 |
|
Achim D. Brucker
|
1c0e687069
|
Use /bin/bash instead of /usr/bin/bash.
|
2017-06-27 13:03:01 +01:00 |