iro.hg: iro/controller/pool.py@584b9c97ecfd (annotated)

132 80a334e2aae7 moving pool to controller Sandro Knauß <knauss@netzguerilla.net> parents: diff changeset	1	from twisted.python.threadpool import ThreadPool
80a334e2aae7 moving pool to controller Sandro Knauß <knauss@netzguerilla.net> parents: diff changeset	2	from twisted.internet import threads
80a334e2aae7 moving pool to controller Sandro Knauß <knauss@netzguerilla.net> parents: diff changeset	3
80a334e2aae7 moving pool to controller Sandro Knauß <knauss@netzguerilla.net> parents: diff changeset	4	class Pool:
264 584b9c97ecfd iro.controller: adding docstrings Sandro Knauß <knauss@netzguerilla.net> parents: 141 diff changeset	5	"""wrapper class to handles a twisted threadpool"""
132 80a334e2aae7 moving pool to controller Sandro Knauß <knauss@netzguerilla.net> parents: diff changeset	6	def __init__(self,name,maxthreads):
264 584b9c97ecfd iro.controller: adding docstrings Sandro Knauß <knauss@netzguerilla.net> parents: 141 diff changeset	7	"""
584b9c97ecfd iro.controller: adding docstrings Sandro Knauß <knauss@netzguerilla.net> parents: 141 diff changeset	8	:param string name: name of the threadpool
584b9c97ecfd iro.controller: adding docstrings Sandro Knauß <knauss@netzguerilla.net> parents: 141 diff changeset	9	:param integer maxthreads: how many thread a allowed at maximum
584b9c97ecfd iro.controller: adding docstrings Sandro Knauß <knauss@netzguerilla.net> parents: 141 diff changeset	10	"""
132 80a334e2aae7 moving pool to controller Sandro Knauß <knauss@netzguerilla.net> parents: diff changeset	11	self.maxthreads = maxthreads
80a334e2aae7 moving pool to controller Sandro Knauß <knauss@netzguerilla.net> parents: diff changeset	12	self.pool = ThreadPool(minthreads=1, maxthreads=maxthreads, name=name)
80a334e2aae7 moving pool to controller Sandro Knauß <knauss@netzguerilla.net> parents: diff changeset	13	self.reactor = None
80a334e2aae7 moving pool to controller Sandro Knauß <knauss@netzguerilla.net> parents: diff changeset	14
80a334e2aae7 moving pool to controller Sandro Knauß <knauss@netzguerilla.net> parents: diff changeset	15	def start(self, reactor):
264 584b9c97ecfd iro.controller: adding docstrings Sandro Knauß <knauss@netzguerilla.net> parents: 141 diff changeset	16	"""stats the pool and adds the pool.stop function to the stop procedure.
584b9c97ecfd iro.controller: adding docstrings Sandro Knauß <knauss@netzguerilla.net> parents: 141 diff changeset	17
584b9c97ecfd iro.controller: adding docstrings Sandro Knauß <knauss@netzguerilla.net> parents: 141 diff changeset	18	:param reactor: a valid twisted reactor
584b9c97ecfd iro.controller: adding docstrings Sandro Knauß <knauss@netzguerilla.net> parents: 141 diff changeset	19	"""
132 80a334e2aae7 moving pool to controller Sandro Knauß <knauss@netzguerilla.net> parents: diff changeset	20	self.pool.start()
80a334e2aae7 moving pool to controller Sandro Knauß <knauss@netzguerilla.net> parents: diff changeset	21	self.reactor = reactor
80a334e2aae7 moving pool to controller Sandro Knauß <knauss@netzguerilla.net> parents: diff changeset	22	self.reactor.addSystemEventTrigger('before', 'shutdown', self.pool.stop)
80a334e2aae7 moving pool to controller Sandro Knauß <knauss@netzguerilla.net> parents: diff changeset	23
80a334e2aae7 moving pool to controller Sandro Knauß <knauss@netzguerilla.net> parents: diff changeset	24	def run(self,f,args,*kwargs):
264 584b9c97ecfd iro.controller: adding docstrings Sandro Knauß <knauss@netzguerilla.net> parents: 141 diff changeset	25	"""run a function in Twisted's thread pool"""
132 80a334e2aae7 moving pool to controller Sandro Knauß <knauss@netzguerilla.net> parents: diff changeset	26	return threads.deferToThreadPool(self.reactor, self.pool, f, args, *kwargs)
80a334e2aae7 moving pool to controller Sandro Knauß <knauss@netzguerilla.net> parents: diff changeset	27
80a334e2aae7 moving pool to controller Sandro Knauß <knauss@netzguerilla.net> parents: diff changeset	28	taskPool = Pool('task',5)
264 584b9c97ecfd iro.controller: adding docstrings Sandro Knauß <knauss@netzguerilla.net> parents: 141 diff changeset	29	"""taskpool to handle sending data"""
135 f8640c663e3e model.job created Sandro Knauß <knauss@netzguerilla.net> parents: 132 diff changeset	30
132 80a334e2aae7 moving pool to controller Sandro Knauß <knauss@netzguerilla.net> parents: diff changeset	31	dbPool = Pool('database',5)
264 584b9c97ecfd iro.controller: adding docstrings Sandro Knauß <knauss@netzguerilla.net> parents: 141 diff changeset	32	"""pool to handle database connection via sqlalchemy"""
132 80a334e2aae7 moving pool to controller Sandro Knauß <knauss@netzguerilla.net> parents: diff changeset	33
80a334e2aae7 moving pool to controller Sandro Knauß <knauss@netzguerilla.net> parents: diff changeset	34	pools=[taskPool,dbPool]
264 584b9c97ecfd iro.controller: adding docstrings Sandro Knauß <knauss@netzguerilla.net> parents: 141 diff changeset	35	"""all available pools"""
132 80a334e2aae7 moving pool to controller Sandro Knauß <knauss@netzguerilla.net> parents: diff changeset	36
80a334e2aae7 moving pool to controller Sandro Knauß <knauss@netzguerilla.net> parents: diff changeset	37	def startPool(reactor):
264 584b9c97ecfd iro.controller: adding docstrings Sandro Knauß <knauss@netzguerilla.net> parents: 141 diff changeset	38	'''run start function for all items in :attr:`pools`'''
132 80a334e2aae7 moving pool to controller Sandro Knauß <knauss@netzguerilla.net> parents: diff changeset	39	for pool in pools:
80a334e2aae7 moving pool to controller Sandro Knauß <knauss@netzguerilla.net> parents: diff changeset	40	pool.start(reactor)
264 584b9c97ecfd iro.controller: adding docstrings Sandro Knauß <knauss@netzguerilla.net> parents: 141 diff changeset	41
584b9c97ecfd iro.controller: adding docstrings Sandro Knauß <knauss@netzguerilla.net> parents: 141 diff changeset	42	__all__=["Pool", "startPool", "dbPool", "taskPool", "pools"]

author	Sandro Knauß <knauss@netzguerilla.net>
	Thu, 29 Mar 2012 18:31:53 +0200
branch	devel
changeset 264	584b9c97ecfd
parent 141	90c95fdd1e33
child 294	0e75bd39767d
permissions	-rw-r--r--