Removed thread shutdown print, and bumped up thread count.

I haven't yet determined a good number of threads to use, we'll see.

Also have to change how the directories are being handled, kind of a
waste to push every directory to the queue, would be faster if the
batches were bigger.

I also still have to work on using fstat across a tree, this will bring
super speed ups.  Output is a bit different, parsing is more complex and
how we handle things will be a bit different.
This commit is contained in:
Brian 2014-05-09 11:25:53 -06:00
parent 3eb7a78339
commit d3fdef1342
1 changed files with 1 additions and 2 deletions

View File

@ -135,7 +135,6 @@ class Worker( threading.Thread ):
( cmd, data ) = self.queue.get( )
if cmd == MSG.SHUTDOWN:
self.console.write("SHUTDOWN")
self.queue.task_done( )
self.console.flush( )
break
@ -229,7 +228,7 @@ def main( args ):
parser = optparse.OptionParser( )
parser.add_option( "-d", "--dir", dest="directory", help="Desired directory to crawl.", default=None )
parser.add_option( "-t", "--threads", dest="thread_count", help="Number of threads to crawl your drive and poll p4.", default=2 )
parser.add_option( "-t", "--threads", dest="thread_count", help="Number of threads to crawl your drive and poll p4.", default=100 )
parser.add_option( "-v", "--verbose", action="store_true", dest="verbose", default=True )
( options, args ) = parser.parse_args( )