Analyses of really large datasets are randomly killed.
[calio@albiorix polygons]$ time /usr/local/db/speciesgeocoder/preformancetests/loc100mi_edg400thou.txt &> Time_loc100mi_edg400thou.txt
...
/usr/local/bin/phylogeocoder: line 7: 42584 Killed /usr/local/opt/python/bin/python2.7 /usr/local/git/geocoder/geocoder.py $*
real 1416m28.221s
user 1414m31.354s
sys 0m40.957s
84871.35user 40.95system 23:36:28elapsed 99%CPU (0avgtext+0avgdata 36414128maxresident)k
1180016inputs+0outputs (24major+6439329minor)pagefaults 0swaps
It turns out that the process was killed by the system:
[root@compute-0-0 ]# cat /var/log/messages
...
Mar 10 22:10:56 compute-0-0 kernel: Out of memory: Kill process 42584 (python2.7) score 91 or sacrifice child
Mar 10 22:10:56 compute-0-0 kernel: Killed process 42584, UID 1594, (python2.7) total-vm:9301140kB, anon-rss:9093160kB, file-rss:192kB
...
The code may have a "leak" of memory. Perhaps test it with https://code.google.com/p/pympler/
Analyses of really large datasets are randomly killed.
[calio@albiorix polygons]$ time /usr/local/db/speciesgeocoder/preformancetests/loc100mi_edg400thou.txt &> Time_loc100mi_edg400thou.txt
...
/usr/local/bin/phylogeocoder: line 7: 42584 Killed /usr/local/opt/python/bin/python2.7 /usr/local/git/geocoder/geocoder.py $*
real 1416m28.221s
user 1414m31.354s
sys 0m40.957s
84871.35user 40.95system 23:36:28elapsed 99%CPU (0avgtext+0avgdata 36414128maxresident)k
1180016inputs+0outputs (24major+6439329minor)pagefaults 0swaps
It turns out that the process was killed by the system:
[root@compute-0-0 ]# cat /var/log/messages
...
Mar 10 22:10:56 compute-0-0 kernel: Out of memory: Kill process 42584 (python2.7) score 91 or sacrifice child
Mar 10 22:10:56 compute-0-0 kernel: Killed process 42584, UID 1594, (python2.7) total-vm:9301140kB, anon-rss:9093160kB, file-rss:192kB
...
The code may have a "leak" of memory. Perhaps test it with https://code.google.com/p/pympler/