Removed thread shutdown print, and bumped up thread count.
I haven't yet determined a good number of threads to use, we'll see. Also have to change how the directories are being handled, kind of a waste to push every directory to the queue, would be faster if the batches were bigger. I also still have to work on using fstat across a tree, this will bring super speed ups. Output is a bit different, parsing is more complex and how we handle things will be a bit different.
This commit is contained in:
parent
3eb7a78339
commit
d3fdef1342
|
@ -135,7 +135,6 @@ class Worker( threading.Thread ):
|
|||
( cmd, data ) = self.queue.get( )
|
||||
|
||||
if cmd == MSG.SHUTDOWN:
|
||||
self.console.write("SHUTDOWN")
|
||||
self.queue.task_done( )
|
||||
self.console.flush( )
|
||||
break
|
||||
|
@ -229,7 +228,7 @@ def main( args ):
|
|||
parser = optparse.OptionParser( )
|
||||
|
||||
parser.add_option( "-d", "--dir", dest="directory", help="Desired directory to crawl.", default=None )
|
||||
parser.add_option( "-t", "--threads", dest="thread_count", help="Number of threads to crawl your drive and poll p4.", default=2 )
|
||||
parser.add_option( "-t", "--threads", dest="thread_count", help="Number of threads to crawl your drive and poll p4.", default=100 )
|
||||
parser.add_option( "-v", "--verbose", action="store_true", dest="verbose", default=True )
|
||||
|
||||
( options, args ) = parser.parse_args( )
|
||||
|
|
Loading…
Reference in New Issue