From 3d110652994bb573947fb935a0b91cd2438523bf Mon Sep 17 00:00:00 2001 From: Brian Date: Tue, 13 May 2014 16:56:13 -0600 Subject: [PATCH] Update README.md --- README.md | 6 ++++++ 1 file changed, 6 insertions(+) diff --git a/README.md b/README.md index 02b16e7..49e0903 100644 --- a/README.md +++ b/README.md @@ -15,4 +15,10 @@ With Python 2.7.6 on a 133GB Directory with 15,700 Folders and 153,415 Files, th With Python 3.4.0 on the same directory, the script ran for 3m and 00.86s. At this point the directory was already stripped of unversioned files, but that's not the longest part of the process, so this version of Python is just that much faster. I'll have more concrete tests later when things are changing less in code. +**UPDATE** +To give you an idea of the improvement, running the new script in the testing branch with Python 3.4.0 has a runtime of 3m and 44.44s, singlethreaded. The previous test was done with 100 threads. So, once I make this multi-threaded, it will be blazing. + + Notes +=================== +Besides making the new script multi-threaded, I'm looking at a way of improving the os.walk speed, I see there's a betterwalk module I can take advantage of. I noticed when iterating directories for deletion it's super fast, but iterating files makes it super slow for some reason; so, I want to look into this.