#20 Write stats collecting mechanism

Fechado
aberto por yannweb 4 anos atrás · 2 comentários

Nedd #24

Find a way to collect stats in pool_handling process.

The collection mechanism should give access to UDP server ( see #19 ) to following data :

  • worker count
  • requests count last 10/5/1 minute
  • request time average (maybe ?) => slow IPC between worker & pool ?
  • total request counter (maybe ?) => will overflow ?!
  • idle/busy state (maybe ?) => change too fast ?
  • idle/busy ratio or workload (maybe ?)

We have to take care of not slowing down the workers with this component…

Maybe the collection child could help implementing this mechanism ?

__Nedd #24__ Find a way to collect stats in pool_handling process. The collection mechanism should give access to UDP server ( see #19 ) to following data : - worker count - requests count last 10/5/1 minute - request time average (maybe ?) => slow IPC between worker & pool ? - total request counter (maybe ?) => will overflow ?! - idle/busy state (maybe ?) => change too fast ? - idle/busy ratio or workload (maybe ?) We have to take care of not slowing down the workers with this component... Maybe the collection child could help implementing this mechanism ?
yannweb adicionou esta issue para o marco BETA version 4 anos atrás
yannweb adicionou a etiqueta
enhancement
4 anos atrás
yannweb adicionou a etiqueta
_core
4 anos atrás
yannweb comentou 4 anos atrás
Proprietário

A solution to a fast request counter implementation can use semaphores :

When a worker starts handling a request it increment a sempahore. Meanwhile, a counter process (pool_handler or stats collection child) will attempt to decrease (fast enough) the semaphore with WNOHANG.

If the decrement semop do not fail, a counter can be incremented.

Note : the 10/5/1 min counters implies to store all requests timestamps ?? Maybe we can associate a timestamp with a request count ?

=> if 100 req/s stores {time(NULL), 100} and not time_t [100] = {time(NULL), time(NULL), etc.}

A solution to a fast request counter implementation can use semaphores : When a worker starts handling a request it increment a sempahore. Meanwhile, a counter process (pool_handler or stats collection child) will attempt to decrease (fast enough) the semaphore with WNOHANG. If the decrement semop do not fail, a counter can be incremented. Note : the 10/5/1 min counters implies to store all requests timestamps ?? Maybe we can associate a timestamp with a request count ? <code>=> if 100 req/s stores {time(NULL), 100} and not time_t [100] = {time(NULL), time(NULL), etc.}</code>
yannweb começou a trabalhar 4 anos atrás
yannweb parou de trabalhar 4 anos atrás
54min 36s
yannweb começou a trabalhar 4 anos atrás
yannweb parou de trabalhar 4 anos atrás
3h 12min
yannweb se auto atribuiu para esta issue 4 anos atrás
yannweb adicionou tempo gasto 4 anos atrás
1h
yannweb adicionou uma nova dependência 4 anos atrás
yannweb adicionou uma nova dependência 4 anos atrás
yannweb começou a trabalhar 4 anos atrás
yannweb parou de trabalhar 4 anos atrás
31min 16s
yannweb comentou 4 anos atrás
Proprietário

closed by b3af92459e

closed by b3af92459e
Acesse para participar desta conversação.
Sem marco
Sem responsável
1 participante(s)
Tempo total gasto: 5h 37min 52s
Yann Weber
5h 37min 52s
Data limite

Data limite não informada.

Carregando…
Cancelar
Salvar
Ainda não há conteúdo.