BrowserSecurity
/
ExtensionCrawler
2
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity

Pebble: start processing results right away.

This commit is contained in:
Michael Herzberg 2018-04-10 16:15:33 +01:00
parent 6bee81b711
commit bbe575d07b
1 changed files with 17 additions and 18 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
ExtensionCrawler/archive.py
View File

@ -581,7 +581,6 @@ def execute_parallel_ProcessPool(archivedir, max_retry, timeout, max_workers, ex
future = pool.map(partial(update_extension, archivedir, forums) future = pool.map(partial(update_extension, archivedir, forums)
,ext_ids ,ext_ids
,timeout=timeout) ,timeout=timeout)
# wait for pool is finished before processing results.
iterator = future.result() iterator = future.result()
ext_timeouts=[] ext_timeouts=[]
for ext_id in ext_ids: for ext_id in ext_ids: