Performance Spamassassin - réseaux et sécurité - Linux et OS Alternatifs
Marsh Posté le 12-09-2007 à 11:37:28
5 secondes en timeout cela me parait tres court
si tu ne peux pas le modifier, tu vas avoir du mal a bosser avec SA. (la marge de manoeuvre est etroite)
mais d'un autre coté 5 secondes de temps de traitement avec SA c'est beaucoup si tu dis que c'est le cas meme en ayant desactivé les regles.
lance un spamassassin -D --lint en console (avec le user avec lequel SA fonctionne) et montre la sortie.
peut etre un pb DNS, ou une erreur qqueconque qui ralentit le traitement.
de meme la version 3.1.7 est obsolete, peut etre qu'une maj est a envisager
Marsh Posté le 12-09-2007 à 11:53:34
Merci pour ta réponse
Jusqu'a maintenant avec la même machine et la version 3.1.3 je n'avait aucun pb, et mes temps étaient inférieur à 5s 95% du temps.
sinon effectivement avec mon utilisateur "spam" il n'arrive pas à ouvrir correctement la base bayes:
bayes: tie-ing to DB file R/O /home/spam/.spamassassin/bayes_* R/O: tie failed: aucun fichier ou repertoire de ce type
Marsh Posté le 12-09-2007 à 11:55:13
il faut que tu fixes ca car il pert quelques secondes sur cette erreur
je te conseille d'ailleurs de placer la base bayes dans une base mysql.
Marsh Posté le 12-09-2007 à 11:57:48
oui, je suis entrain de regarder ca, les droits semblent correct pourtant...
Marsh Posté le 12-09-2007 à 11:58:47
fait voir le lint complet aussi
Marsh Posté le 12-09-2007 à 12:12:51
Code :
|
Marsh Posté le 12-09-2007 à 12:17:45
Voilà ce que j'avais comme stats avant:
sam aoû 25 08:00:01 CEST 2007
***** Antispam stats J-1 *****
SpamAssassin statistics for entire logfile
----------------------------------------------------------------------
Total messages: Ham: Spam: % Spam:
----------------------------------------------------------------------
2584 436 2148 83.13%
Average spam score : 22.59/6.00
Average ham score : 0.34/6.00
Username: Total: Ham: Spam: % Spam:
----------------------------------------------------------------------
(unknown) 2584 436 2148 83.13%
Username: Avg. ham score: Avg. spam score:
----------------------------------------------------------------------
(unknown) 0.34/6.00 22.59/6.00
*****# Script de stats complementaires du filtrage antispam #*****
Nombre de mails dans les logs de filtrage antispam : 18243
Temps moyen de filtrage par mail (log global) : 2.82194814449377843556
Temps moyen de filtrage pour aujourd'hui : 2.62761904761904761904
----- Stats des regles antispam -----
Erreur de date : 12% (330)
Systeme Razor : 0% (0)
Regles URI : 0% (1)
Regles SARE : 0% (0)
Regles DRUGS : 6% (162)
----- Filtrage DNS et sur infos IP -----
Filtrage XBL : 16% (431)
Filtrage NJABL : 14% (379)
Fitrage SORBS : 27% (707)
Regles Dynamic IP 1 : 27% (701)
Regles Dynamic IP 2 : 9% (252)
*****-- FIN du script --*****
Marsh Posté le 12-09-2007 à 12:36:09
ton pb de bayes est reglé semble t il ?
est ce que cela ameliore les temps de reponses ?
-ta base bayes et son journal ont quelle taille ?
-utilise tu spamd ou bien amavisd ?
-tu as un cache DNS sur ta becane ?
-Pyzor et DCC sont til actifs dans les plugins ?
- fais voir ton local.cf et les *.pre
essaye de migrer vers la derniere version de SA et d'activer les compilations des rules.
Marsh Posté le 12-09-2007 à 14:03:38
merci
Oui pour bayes ca a l'air d'aller, les droits sur les fichiers étaient bons mais pas sur le répertoire.
-la base bayes fait 5mo environ
-j'utilise spamd
-non pas de cache DNS
-non pas de pyzor et DCC (tu me conseilles de les mettre?)
Je viens de migrer vers la version 3.2.1
Voilà mon fichier local.cf
# This is the right place to customize your installation of SpamAssassin.
#
# See 'perldoc Mail::SpamAssassin::Conf' for details of what can be
# tweaked.
#
# Only a small subset of options are listed below
#
###########################################################################
# Add *****SPAM***** to the Subject header of spam e-mails
#
rewrite_header Subject *****SPAM*****
# Save spam messages as a message/rfc822 MIME attachment instead of
# modifying the original message (0: off, 2: use text/plain instead)
#
# report_safe 1
# Set which networks or hosts are considered 'trusted' by your mail
# server (i.e. not spammers)
#
trusted_networks 120.0.100.150
# Set file-locking method (flock is not safe over NFS, but is faster)
#
# lock_method flock
# Set the threshold at which a message is considered spam (default: 5.0)
#
required_score 6.0
skip_rbl_checks 1
# Use Bayesian classifier (default: 1)
#
use_bayes 1
bayes_path /home/spam/.spamassassin/bayes
bayes_file_mode 0666
bayes_use_hapaxes 1
# Bayesian classifier auto-learning (default: 1)
#
bayes_auto_learn 1
use_razor2 1
razor_config /usr/share/spamassassin/.razor/razor-agent.conf
razor_timeout 3
rbl_timeout 3
dns_available yes
#check_mx_attempts 1
# Set headers which may provide inappropriate cues to the Bayesian
# classifier
#
bayes_ignore_header X-Bogosity
bayes_ignore_header X-Spam-Flag
bayes_ignore_header X-Spam-Status
Marsh Posté le 12-09-2007 à 14:13:33
il faut verifier dans tes fichiers *.pre les plugins activés, en particulier razor2 qui par defaut est desactivé (a verifier)
de meme desactive le dans ton local.cf: use_razor2 0.
DCC et pyzor ne doivent pas etre activé car il ajoute un temps de latence non negligeable
tu devrait utiliser un cache dns.
verifie bien que spamd est utilisé et non spamassassin directment.
comment as tu update SA ?
Marsh Posté le 12-09-2007 à 14:20:08
Oui pour désactiver razor en faisant un
use_razor2 1
c'est bon.
Avant il était activer pourtant...
J'ai update SA avec un apt-get sur backports.org
Marsh Posté le 12-09-2007 à 14:22:04
que donne les temps de reponses maintenant ?
Marsh Posté le 12-09-2007 à 14:28:47
desactive bayes et le awl pour comparer les tps de reponse:
use_bayes 0
use_auto_whitelist 0
puis relances spamd
PS: es tu bien certain que c'est spamd qui est appelé a chaque fois ? pas d'acces direct par le binaire spamassassin ?
Comment est appelé SA dans ta boucle (postfix ?)
Marsh Posté le 12-09-2007 à 14:31:31
Oui dans le fichier /etc/default/spamassassin
j'ai bien la ligne
ENABLED=1
Je vais essayer de desactiver bayes et AWL
Sinon je n'ai pas de postfix qui tourne dessus, mon relais SMTP soumet le mail directement à mon serveur spamassassin vie le port 783.
Marsh Posté le 12-09-2007 à 14:35:04
C'est pareil en désactivant tout, 5.9s lors de mon dernier mail analysé... il y a vraiment un problème qqpart
Marsh Posté le 12-09-2007 à 14:36:16
Sinon ma machine ne semble pas être saturée:
ram utilisée: 160Mo sur 1024
CPU tourne autour de 5 à 20%
Marsh Posté le 12-09-2007 à 14:49:38
peut etre les dns, mais tes RBL sont desactivés donc les requetes sont plutot limités...
ou bien un pb reseau...
essaye de voir les connections effectuées lors du traitement.
Marsh Posté le 12-09-2007 à 15:47:01
il n'y a pas de pb a ma connaissance.
j'utilise des etch avec des SA sans soucis.
verifie bien le reseau, et les connections lors du traitement dans SA. (avec iptraf par exemple)
teste une requete dns en console pour voir le temps de reponse
Marsh Posté le 12-09-2007 à 16:11:29
Bon, j'ai finalement trouvé un autre moyen: passer le timeout de mon relais smtp à 10s !
Cela dit ca ne me dit pas pourquoi suite à ce changement de version j'ai doublé mon temps de traitement
Marsh Posté le 12-09-2007 à 16:13:42
c'est une bonne chose
mais comme tu dis il y aun pb qque part
essaie ce que j'ai ecrit plus haut et active le debug de spamd pour bien checker ce qu'il fait a la reception d'un mail (-D dans le init.d)
Marsh Posté le 12-09-2007 à 16:17:02
j'ai lancé un sa-compil sans vraiment comprendre ce que je faisais, ca change quoi?
Sinon je vais activer le debug oui.
Marsh Posté le 12-09-2007 à 16:23:08
cela compile les rules qui sont prévues pour, pour accelerer sensiblement le traitement
c'est une bonne chose a faire
n'oublie pas de decommenter loadplugin Mail::SpamAssassin::Plugin::Rule2XSBody dans le v320.pre
Marsh Posté le 12-09-2007 à 16:23:35
en activant le debug je vois ça de bizarre donc mon mail.log:
spamd[26744]: prefork: sysread(8) not ready, wait max 300s
ça me semble suspect ! non?
Marsh Posté le 12-09-2007 à 16:27:57
tu as bcp de mail en parallele qui arrive sur SA ?
Marsh Posté le 12-09-2007 à 16:28:49
non, que ça qui arrive sur cette machine. qq mail par minutes je dirais...
Marsh Posté le 12-09-2007 à 16:32:42
c'est pas forcement suspect...
d'autre messages bizarres dans le debug ?
Marsh Posté le 12-09-2007 à 16:59:02
Je vais continuer mes recherches, en tout cas merci beaucoup pour ton aide précieux
Pour le moment ca semble marcher avec mes 10s de timeout...
je trouve ce debian bien plus lent... pour récuperer les mails de spam par exemple... je me demande si le DD n'aurait pas un pb physique.
Marsh Posté le 12-09-2007 à 18:18:12
les perfs sont à chié, y a rien à y faire, ça bouffe trop de CPU. Tu te retrouve toujours sur des temps de traitement de l'ordre de la seconde ...
Marsh Posté le 13-09-2007 à 08:37:07
Oui si tu veux, seulement ca n'explique pas pourquoi avec le même matériel je suis passé d'un temps moyen de 2.5s à 7.5s...
Marsh Posté le 13-09-2007 à 10:14:00
Autre question: est ce que ca vaut le coup d'augmenter un peu la priorité des processus spamd?
Marsh Posté le 13-09-2007 à 10:20:17
pour ce que tu disais que tu recois comme volume de mail, ce n'est pas cela le pb.
a moins que le serveru ne soit assigné a d'autres taches.
il faudrait que tu verifies ce que je disais plus haut lors du traitement sur le reseau, ainsi que la charge cpu a ce moment.
quelles sont les caracteristiques de la machine ?
le temps de traitement est il superieur a 5 secondes avec tous les emails, meme par exemple ce ne contenant qu'une ligne de texte brut ?
Marsh Posté le 13-09-2007 à 11:05:39
La machine n'est pas un foudre de guerre.
P4 2.4Ghz
1Go de Ram
Elle ne fait rien d'autre.
La charge CPU monte entre 20 et 60% à chaque mail reçu.
Le traffic réseau passe à qq ko/s au moment des transferts.
180Mo de Ram sont utilisés
Sinon oui TOUTES les analyses dépassent les 5s.
Voilà mes stats depuis hier:
jeudi 13 septembre 2007, 09:03:01 (UTC+0200)
***** Antispam stats J-1 *****
SpamAssassin statistics for entire logfile
----------------------------------------------------------------------
Total messages: Ham: Spam: % Spam:
----------------------------------------------------------------------
1456 566 890 61.13%
Average spam score : 19.11/6.00
Average ham score : 1.25/6.00
Username: Total: Ham: Spam: % Spam:
----------------------------------------------------------------------
(unknown) 1456 566 890 61.13%
Username: Avg. ham score: Avg. spam score:
----------------------------------------------------------------------
(unknown) 1.25/6.00 19.11/6.00
*****# Script de stats complementaires du filtrage antispam #*****
Nombre de mails dans les logs de filtrage antispam : 1579
Temps moyen de filtrage par mail (log global) : 6.61405953134895503483
Temps moyen de filtrage pour aujourd'hui : 6.11300813008130081300
----- Stats des regles antispam -----
Erreur de date : 16% (237)
Systeme Razor : 41% (605)
Regles URI : 0% (1)
Regles SARE : 0% (0)
Regles DRUGS : 12% (182)
----- Filtrage DNS et sur infos IP -----
Filtrage XBL : 1% (26)
Filtrage NJABL : 2% (34)
Fitrage SORBS : 1% (28)
Regles Dynamic IP 1 : 13% (200)
Regles Dynamic IP 2 : 6% (96)
Marsh Posté le 13-09-2007 à 11:09:50
que donne un top lors du traitement ?
de meme essaye d'utiliser iptraf pour voir les connections lors du traitement. essaie de reperer des requetes DNS.
la machine est largement assez puissante pour traiter un mail simple en moins de 2 secondes.
et poste le debug de spamd sur le traitement d'un message
Marsh Posté le 13-09-2007 à 11:42:31
Je vois bien des requetes DNS à distination d'un de mes serveurs internes dans le IP traf.
Sinon voilà le traitement d'un message en 6s:
Sep 13 11:27:16 localhost spamd[7053]: spamd: connection from 120.0.100.150 [120.0.100.150] at port 44841
Sep 13 11:27:16 localhost spamd[7053]: spamd: running as uid 1000
Sep 13 11:27:16 localhost spamd[7053]: message: main message type: multipart/alternative
Sep 13 11:27:16 localhost spamd[7053]: spamd: processing message <534546071@prod-mail.cabestan.com> for (unknown):1000
Sep 13 11:27:16 localhost spamd[7053]: conf: trusted_networks are not configured; it is recommended that you configure trusted_networks manually
Sep 13 11:27:16 localhost spamd[7053]: received-header: parsed as [ ip=213.41.75.84 rdns= helo=prod-mail.cabestan.com by=arkoon.maboite.fr ident= envfrom= intl=0 id=smtpdGXAiWD auth= msa=0 ]
Sep 13 11:27:16 localhost spamd[7053]: received-header: do not trust any hosts from here on
Sep 13 11:27:16 localhost spamd[7053]: received-header: relay 213.41.75.84 trusted? no internal? no msa? no
Sep 13 11:27:16 localhost spamd[7053]: metadata: X-Spam-Relays-Trusted:
Sep 13 11:27:16 localhost spamd[7053]: metadata: X-Spam-Relays-Untrusted: [ ip=213.41.75.84 rdns= helo=prod-mail.cabestan.com by=arkoon.maboite.fr ident= envfrom= intl=0 id=smtpdGXAiWD auth= msa=0 ]
Sep 13 11:27:16 localhost spamd[7053]: metadata: X-Spam-Relays-Internal:
Sep 13 11:27:16 localhost spamd[7053]: metadata: X-Spam-Relays-External: [ ip=213.41.75.84 rdns= helo=prod-mail.cabestan.com by=arkoon.maboite.fr ident= envfrom= intl=0 id=smtpdGXAiWD auth= msa=0 ]
Sep 13 11:27:16 localhost spamd[7053]: message: ---- MIME PARSER START ----
Sep 13 11:27:16 localhost spamd[7053]: message: parsing multipart, got boundary: ----=_Boundary__13092007_111345
Sep 13 11:27:16 localhost spamd[7053]: message: found part of type text/plain, boundary: ----=_Boundary__13092007_111345
Sep 13 11:27:16 localhost spamd[7053]: message: added part, type: text/plain
Sep 13 11:27:16 localhost spamd[7053]: message: found part of type text/html, boundary: ----=_Boundary__13092007_111345
Sep 13 11:27:16 localhost spamd[7053]: message: added part, type: text/html
Sep 13 11:27:16 localhost spamd[7053]: message: parsing normal part
Sep 13 11:27:16 localhost spamd[7053]: message: parsing normal part
Sep 13 11:27:16 localhost spamd[7053]: message: ---- MIME PARSER END ----
Sep 13 11:27:16 localhost spamd[7053]: message: decoding quoted-printable
Sep 13 11:27:16 localhost spamd[7053]: message: decoding quoted-printable
Sep 13 11:27:16 localhost spamd[7053]: uridnsbl: domains to query: cabestan.com
Sep 13 11:27:16 localhost spamd[7053]: dns: URIBL_GREY lookup start
Sep 13 11:27:16 localhost spamd[7053]: dns: WHOIS_SECUREWHOIS lookup start
Sep 13 11:27:16 localhost spamd[7053]: dns: WHOIS_MYPRIVREG lookup start
Sep 13 11:27:16 localhost spamd[7053]: dns: WHOIS_NETSOLPR lookup start
Sep 13 11:27:16 localhost spamd[7053]: dns: WHOIS_AITPRIV lookup start
Sep 13 11:27:16 localhost spamd[7053]: dns: WHOIS_FINEXE lookup start
Sep 13 11:27:16 localhost spamd[7053]: dns: WHOIS_CONTACTPRIV lookup start
Sep 13 11:27:16 localhost spamd[7053]: dns: URIBL_BLACK lookup start
Sep 13 11:27:16 localhost spamd[7053]: dns: WHOIS_REGISTER4LESS lookup start
Sep 13 11:27:16 localhost spamd[7053]: dns: WHOIS_NETID lookup start
Sep 13 11:27:16 localhost spamd[7053]: dns: WHOIS_DYNADOT lookup start
Sep 13 11:27:16 localhost spamd[7053]: dns: URIBL_OB_SURBL lookup start
Sep 13 11:27:16 localhost spamd[7053]: dns: WHOIS_DMNBYPROXY lookup start
Sep 13 11:27:16 localhost spamd[7053]: dns: WHOIS_MONIKER_PRIV lookup start
Sep 13 11:27:16 localhost spamd[7053]: dns: WHOIS_PRIVDOMAIN lookup start
Sep 13 11:27:16 localhost spamd[7053]: dns: WHOIS_DREAMPRIV lookup start
Sep 13 11:27:16 localhost spamd[7053]: dns: URIBL_RED lookup start
Sep 13 11:27:16 localhost spamd[7053]: dns: URIBL_SC_SURBL lookup start
Sep 13 11:27:16 localhost spamd[7053]: dns: URIBL_AB_SURBL lookup start
Sep 13 11:27:16 localhost spamd[7053]: dns: WHOIS_WHOISGUARD lookup start
Sep 13 11:27:16 localhost spamd[7053]: dns: WHOIS_PRIVPROT lookup start
Sep 13 11:27:16 localhost spamd[7053]: dns: WHOIS_NAMEKING lookup start
Sep 13 11:27:16 localhost spamd[7053]: dns: URIBL_PH_SURBL lookup start
Sep 13 11:27:16 localhost spamd[7053]: dns: WHOIS_DOMPRIVCORP lookup start
Sep 13 11:27:16 localhost spamd[7053]: dns: WHOIS_PRIVACYPOST lookup start
Sep 13 11:27:16 localhost spamd[7053]: dns: URIBL_RHS_DOB lookup start
Sep 13 11:27:16 localhost spamd[7053]: dns: WHOIS_DOMESCROW lookup start
Sep 13 11:27:16 localhost spamd[7053]: dns: WHOIS_WHOISPROT lookup start
Sep 13 11:27:16 localhost spamd[7053]: dns: URIBL_JP_SURBL lookup start
Sep 13 11:27:16 localhost spamd[7053]: dns: WHOIS_REGTEK lookup start
Sep 13 11:27:16 localhost spamd[7053]: dns: WHOIS_SAFENAMES lookup start
Sep 13 11:27:16 localhost spamd[7053]: dns: URIBL_WS_SURBL lookup start
Sep 13 11:27:16 localhost spamd[7053]: dns: WHOIS_NOMINET lookup start
Sep 13 11:27:16 localhost spamd[7053]: dns: WHOIS_REGISTERFLY lookup start
Sep 13 11:27:16 localhost spamd[7053]: dns: WHOIS_UNLISTED lookup start
Sep 13 11:27:16 localhost spamd[7053]: dns: URIBL_SBL lookup start
Sep 13 11:27:16 localhost spamd[7053]: check: running tests for priority: -1000
Sep 13 11:27:16 localhost spamd[7053]: rules: running head tests; score so far=0
Sep 13 11:27:16 localhost spamd[7053]: eval: all '*From' addrs: peter.wildhorn@ipwgroup.eu
Sep 13 11:27:16 localhost spamd[7053]: eval: all '*To' addrs: jacques.michaux@maboite.fr
Sep 13 11:27:16 localhost spamd[7053]: rules: running body tests; score so far=0
Sep 13 11:27:16 localhost spamd[7053]: rules: running uri tests; score so far=0
Sep 13 11:27:16 localhost spamd[7053]: rules: running rawbody tests; score so far=0
Sep 13 11:27:16 localhost spamd[7053]: rules: running full tests; score so far=0
Sep 13 11:27:16 localhost spamd[7053]: rules: running meta tests; score so far=0
Sep 13 11:27:16 localhost spamd[7053]: check: running tests for priority: -950
Sep 13 11:27:16 localhost spamd[7053]: rules: running head tests; score so far=0
Sep 13 11:27:16 localhost spamd[7053]: rules: running body tests; score so far=0
Sep 13 11:27:16 localhost spamd[7053]: rules: running uri tests; score so far=0
Sep 13 11:27:16 localhost spamd[7053]: rules: running rawbody tests; score so far=0
Sep 13 11:27:16 localhost spamd[7053]: rules: running full tests; score so far=0
Sep 13 11:27:16 localhost spamd[7053]: rules: running meta tests; score so far=0
Sep 13 11:27:16 localhost spamd[7053]: check: running tests for priority: -900
Sep 13 11:27:16 localhost spamd[7053]: rules: running head tests; score so far=0
Sep 13 11:27:16 localhost spamd[7053]: rules: running body tests; score so far=0
Sep 13 11:27:16 localhost spamd[7053]: rules: running uri tests; score so far=0
Sep 13 11:27:16 localhost spamd[7053]: rules: running rawbody tests; score so far=0
Sep 13 11:27:16 localhost spamd[7053]: rules: running full tests; score so far=0
Sep 13 11:27:16 localhost spamd[7053]: rules: running meta tests; score so far=0
Sep 13 11:27:16 localhost spamd[7053]: check: running tests for priority: -400
Sep 13 11:27:16 localhost spamd[7053]: rules: running head tests; score so far=0
Sep 13 11:27:16 localhost spamd[7053]: rules: running body tests; score so far=0
Sep 13 11:27:16 localhost spamd[7053]: rules: running uri tests; score so far=0
Sep 13 11:27:16 localhost spamd[7053]: bayes: tie-ing to DB file R/O /home/spam/.spamassassin/bayes_toks
Sep 13 11:27:16 localhost spamd[7053]: bayes: tie-ing to DB file R/O /home/spam/.spamassassin/bayes_seen
Sep 13 11:27:16 localhost spamd[7053]: bayes: found bayes db version 3
Sep 13 11:27:16 localhost spamd[7053]: bayes: DB journal sync: last sync: 1189675146
Sep 13 11:27:16 localhost spamd[7053]: bayes: corpus size: nspam = 9471, nham = 298
Sep 13 11:27:16 localhost spamd[7053]: bayes: score = 0.500000000112844
Sep 13 11:27:16 localhost spamd[7053]: bayes: DB journal sync: last sync: 1189675146
Sep 13 11:27:16 localhost spamd[7053]: bayes: DB expiry: tokens in DB: 133903, Expiry max size: 150000, Oldest atime: 1178565756, Newest atime: 1189675383, Last expire: 1189621407, Current time: 1189675636
Sep 13 11:27:16 localhost spamd[7053]: bayes: untie-ing
Sep 13 11:27:16 localhost spamd[7053]: rules: running rawbody tests; score so far=0
Sep 13 11:27:16 localhost spamd[7053]: rules: running full tests; score so far=0
Sep 13 11:27:16 localhost spamd[7053]: rules: running meta tests; score so far=0
Sep 13 11:27:16 localhost spamd[7053]: check: running tests for priority: 0
Sep 13 11:27:16 localhost spamd[7053]: rules: running head tests; score so far=0
Sep 13 11:27:16 localhost spamd[7053]: rules: ran header rule __CTYPE_MULTIPART_ALT ======> got hit: "multipart/alternative"
Sep 13 11:27:16 localhost spamd[7053]: rules: ran header rule __CTYPE_HAS_BOUNDARY ======> got hit: "boundary"
Sep 13 11:27:16 localhost spamd[7053]: rules: ran header rule __CT ======> got hit: "m"
Sep 13 11:27:16 localhost spamd[7053]: rules: ran header rule RDNS_NONE ======> got hit: "[ ip=213.41.75.84 rdns= "
Sep 13 11:27:16 localhost spamd[7053]: rules: ran header rule __LAST_UNTRUSTED_RELAY_NO_AUTH ======> got hit: "[ ip=213.41.75.84 rdns= helo=prod-mail.cabestan.com by=arkoon.maboite.fr ident= envfrom= intl=0 id=smtpdGXAiWD auth= "
Sep 13 11:27:16 localhost spamd[7053]: rules: ran header rule __DOS_SINGLE_EXT_RELAY ======> got hit: "[ ip=213.41.75.84 rdns= helo=prod-mail.cabestan.com by=arkoon.maboite.fr ident= envfrom= intl=0 id=smtpdGXAiWD auth= msa=0 ]"
Sep 13 11:27:16 localhost spamd[7053]: rules: ran header rule __MISSING_REF ======> got hit: "UNSET"
Sep 13 11:27:16 localhost spamd[7053]: rules: ran header rule __NAKED_TO ======> got hit: "jacques.michaux@maboite.fr"
Sep 13 11:27:16 localhost spamd[7053]: rules: ran header rule __MIME_VERSION ======> got hit: "1"
Sep 13 11:27:16 localhost spamd[7053]: rules: ran header rule __HAS_RCVD ======> got hit: "f"
Sep 13 11:27:16 localhost spamd[7053]: rules: ran header rule __DOS_RCVD_THU ======> got hit: " Thu, "
Sep 13 11:27:16 localhost spamd[7053]: rules: ran header rule __TOCC_EXISTS ======> got hit: "j"
Sep 13 11:27:16 localhost spamd[7053]: rules: ran header rule __MSGID_OK_HOST ======> got hit: "@prod-mail.cabestan.com>"
Sep 13 11:27:16 localhost spamd[7053]: rules: ran header rule __MSOE_MID_WRONG_CASE ======> got hit: "
Sep 13 11:27:16 localhost spamd[7053]: rules: Message-Id: "
Sep 13 11:27:16 localhost spamd[7053]: rules: ran header rule __HAS_MSGID ======> got hit: "<"
Sep 13 11:27:16 localhost spamd[7053]: rules: ran header rule __SANE_MSGID ======> got hit: "<60pt8g$ftp1kn@ironport-1.cabestan-local.com>
Sep 13 11:27:16 localhost spamd[7053]: rules: "
Sep 13 11:27:16 localhost spamd[7053]: rules: ran header rule __HAS_SUBJECT ======> got hit: "A"
Sep 13 11:27:16 localhost spamd[7053]: spf: checking to see if the message has a Received-SPF header that we can use
Sep 13 11:27:16 localhost spamd[7053]: spf: already checked for Received-SPF headers, proceeding with DNS based checks
Sep 13 11:27:16 localhost last message repeated 3 times
Sep 13 11:27:16 localhost spamd[7053]: spf: cannot get Envelope-From, cannot use SPF
Sep 13 11:27:16 localhost spamd[7053]: spf: def_spf_whitelist_from: could not find useable envelope sender
Sep 13 11:27:16 localhost spamd[7053]: spf: already checked for Received-SPF headers, proceeding with DNS based checks
Sep 13 11:27:16 localhost last message repeated 2 times
Sep 13 11:27:16 localhost spamd[7053]: spf: spf_whitelist_from: could not find useable envelope sender
Sep 13 11:27:16 localhost spamd[7053]: rules: running body tests; score so far=0.1
Sep 13 11:27:16 localhost spamd[7053]: rules: ran body rule __MBA ======> got hit: "MBA"
Sep 13 11:27:16 localhost spamd[7053]: rules: ran body rule __DOS_BODY_MON ======> got hit: "mon"
Sep 13 11:27:16 localhost spamd[7053]: rules: ran body rule __HAS_ANY_EMAIL ======> got hit: "n@ipwgroup.e"
Sep 13 11:27:16 localhost spamd[7053]: rules: ran body rule __FB_MBA ======> got hit: "MBA"
Sep 13 11:27:16 localhost spamd[7053]: rules: ran body rule __NONEMPTY_BODY ======> got hit: "A"
Sep 13 11:27:16 localhost spamd[7053]: rules: running uri tests; score so far=0.1
Sep 13 11:27:16 localhost spamd[7053]: rules: ran uri rule __DOS_HAS_ANY_URI ======> got hit: "h"
Sep 13 11:27:16 localhost spamd[7053]: https_http_mismatch: anchors 9
Sep 13 11:27:16 localhost spamd[7053]: eval: stock info total: 0
Sep 13 11:27:16 localhost spamd[7053]: rules: ran eval rule __TAG_EXISTS_BODY ======> got hit (1)
Sep 13 11:27:16 localhost spamd[7053]: eval: text words: 203, html words: 30
Sep 13 11:27:16 localhost spamd[7053]: eval: madiff: left: 15, orig: 30, max-difference: 50.00%
Sep 13 11:27:16 localhost spamd[7053]: rules: ran eval rule MPART_ALT_DIFF_COUNT ======> got hit (1)
Sep 13 11:27:16 localhost spamd[7053]: rules: ran eval rule HTML_IMAGE_RATIO_02 ======> got hit (1)
Sep 13 11:27:16 localhost spamd[7053]: rules: ran eval rule __MIME_HTML ======> got hit (1)
Sep 13 11:27:16 localhost spamd[7053]: rules: ran eval rule __HTML_TITLE_SUBJ_DIFF ======> got hit (1)
Sep 13 11:27:16 localhost spamd[7053]: rules: ran eval rule HTML_MESSAGE ======> got hit (1)
Sep 13 11:27:16 localhost spamd[7053]: rules: ran eval rule __TAG_EXISTS_HTML ======> got hit (1)
Sep 13 11:27:16 localhost spamd[7053]: rules: relay UNKNOWN(213.41.75.84), doesn't match any whitelist
Sep 13 11:27:16 localhost spamd[7053]: rules: ran eval rule BAYES_50 ======> got hit (1)
Sep 13 11:27:16 localhost spamd[7053]: rules: ran eval rule __TVD_MIME_ATT_TP ======> got hit (1)
Sep 13 11:27:16 localhost spamd[7053]: rules: ran eval rule __HTML_LINK_IMAGE ======> got hit (1)
Sep 13 11:27:16 localhost spamd[7053]: rules: ran eval rule __TAG_EXISTS_HEAD ======> got hit (1)
Sep 13 11:27:16 localhost spamd[7053]: rules: ran eval rule __TAG_EXISTS_META ======> got hit (1)
Sep 13 11:27:16 localhost spamd[7053]: rules: running rawbody tests; score so far=1.595
Sep 13 11:27:16 localhost spamd[7053]: rules: ran rawbody rule __TVD_BODY ======> got hit: "GROU"
Sep 13 11:27:16 localhost spamd[7053]: rules: ran eval rule __MIME_QP ======> got hit (2)
Sep 13 11:27:16 localhost spamd[7053]: rules: running full tests; score so far=1.595
Sep 13 11:27:16 localhost spamd[7053]: info: entering helper-app run mode
Sep 13 11:27:17 localhost spamd[7053]: info: leaving helper-app run mode
Sep 13 11:27:17 localhost spamd[7053]: razor2: part=0 engine=4 contested=0 confidence=0
Sep 13 11:27:17 localhost spamd[7053]: razor2: part=1 engine=4 contested=1 confidence=0
Sep 13 11:27:17 localhost spamd[7053]: razor2: part=1 engine=8 contested=0 confidence=0
Sep 13 11:27:17 localhost spamd[7053]: razor2: results: spam? 0
Sep 13 11:27:17 localhost spamd[7053]: razor2: results: engine 8, highest cf score: 0
Sep 13 11:27:17 localhost spamd[7053]: razor2: results: engine 4, highest cf score: 0
Sep 13 11:27:17 localhost spamd[7053]: pyzor: pyzor is not available: no pyzor executable found
Sep 13 11:27:17 localhost spamd[7053]: pyzor: no pyzor found, disabling Pyzor
Sep 13 11:27:17 localhost spamd[7053]: rules: running meta tests; score so far=1.595
Sep 13 11:27:17 localhost spamd[7053]: check: running tests for priority: 500
Sep 13 11:27:17 localhost spamd[7053]: async: select found 1 socks ready
Sep 13 11:27:17 localhost spamd[7053]: uridnsbl: query for cabestan.com took 1 seconds to look up (multi.uribl.com.:cabestan.com)
Sep 13 11:27:17 localhost spamd[7053]: async: queries completed: 1 started: 0
Sep 13 11:27:17 localhost spamd[7053]: async: queries active: URI-DNSBL=3 URI-NS=1 at Thu Sep 13 11:27:17 2007
Sep 13 11:27:17 localhost spamd[7053]: async: select found 1 socks ready
Sep 13 11:27:17 localhost spamd[7053]: uridnsbl: query for cabestan.com took 1 seconds to look up (multi.surbl.org.:cabestan.com)
Sep 13 11:27:17 localhost spamd[7053]: async: queries completed: 1 started: 0
Sep 13 11:27:17 localhost spamd[7053]: async: queries active: URI-DNSBL=2 URI-NS=1 at Thu Sep 13 11:27:17 2007
Sep 13 11:27:17 localhost spamd[7053]: async: select found 1 socks ready
Sep 13 11:27:17 localhost spamd[7053]: async: queries completed: 1 started: 2
Sep 13 11:27:17 localhost spamd[7053]: async: queries active: URI-DNSBL=2 at Thu Sep 13 11:27:17 2007
Sep 13 11:27:17 localhost spamd[7053]: async: select found 1 socks ready
Sep 13 11:27:17 localhost spamd[7053]: uridnsbl: query for cabestan.com took 1 seconds to look up (dob.sibl.support-intelligence.net:cabestan.com)
Sep 13 11:27:17 localhost spamd[7053]: async: queries completed: 1 started: 0
Sep 13 11:27:17 localhost spamd[7053]: async: queries active: URI-A=2 URI-DNSBL=1 at Thu Sep 13 11:27:17 2007
Sep 13 11:27:17 localhost spamd[7053]: async: select found 1 socks ready
Sep 13 11:27:17 localhost spamd[7053]: uridnsbl: query for cabestan.com took 1 seconds to look up (bl.open-whois.org.:cabestan.com)
Sep 13 11:27:17 localhost spamd[7053]: async: queries completed: 1 started: 0
Sep 13 11:27:17 localhost spamd[7053]: async: queries active: URI-A=2 at Thu Sep 13 11:27:17 2007
Sep 13 11:27:17 localhost spamd[7053]: async: select found 1 socks ready
Sep 13 11:27:17 localhost spamd[7053]: async: queries completed: 1 started: 1
Sep 13 11:27:17 localhost spamd[7053]: async: queries active: URI-A=1 at Thu Sep 13 11:27:17 2007
Sep 13 11:27:17 localhost spamd[7053]: async: select found 1 socks ready
Sep 13 11:27:17 localhost spamd[7053]: async: queries completed: 1 started: 1
Sep 13 11:27:17 localhost spamd[7053]: async: queries active: URI-DNSBL=1 at Thu Sep 13 11:27:17 2007
Sep 13 11:27:17 localhost spamd[7053]: async: select found 1 socks ready
Sep 13 11:27:17 localhost spamd[7053]: uridnsbl: query for cabestan.com took 1 seconds to look up (sbl.spamhaus.org.:70.75.41.213)
Sep 13 11:27:17 localhost spamd[7053]: async: queries completed: 1 started: 0
Sep 13 11:27:17 localhost spamd[7053]: async: queries active: URI-DNSBL=1 at Thu Sep 13 11:27:17 2007
Sep 13 11:27:17 localhost spamd[7053]: async: select found 1 socks ready
Sep 13 11:27:17 localhost spamd[7053]: uridnsbl: query for cabestan.com took 1 seconds to look up (sbl.spamhaus.org.:71.75.41.213)
Sep 13 11:27:17 localhost spamd[7053]: async: queries completed: 1 started: 0
Sep 13 11:27:17 localhost spamd[7053]: async: queries active: at Thu Sep 13 11:27:17 2007
Sep 13 11:27:17 localhost spamd[7053]: dns: success for 4 of 5 queries
Sep 13 11:27:17 localhost spamd[7053]: rules: running head tests; score so far=1.595
Sep 13 11:27:17 localhost spamd[7053]: rules: running body tests; score so far=1.595
Sep 13 11:27:17 localhost spamd[7053]: rules: running uri tests; score so far=1.595
Sep 13 11:27:17 localhost spamd[7053]: rules: running rawbody tests; score so far=1.595
Sep 13 11:27:17 localhost spamd[7053]: rules: running full tests; score so far=1.595
Sep 13 11:27:17 localhost spamd[7053]: rules: running meta tests; score so far=1.595
Sep 13 11:27:17 localhost spamd[7053]: check: running tests for priority: 1000
Sep 13 11:27:17 localhost spamd[7053]: rules: running head tests; score so far=2.812
Sep 13 11:27:17 localhost spamd[7053]: config: using "/home/spam/.spamassassin" for user state dir
Sep 13 11:27:17 localhost spamd[7053]: locker: safe_lock: created /home/spam/.spamassassin/auto-whitelist.lock.debian3.maboite.fr.7053
Sep 13 11:27:17 localhost spamd[7053]: locker: safe_lock: trying to get lock on /home/spam/.spamassassin/auto-whitelist with 0 retries
Sep 13 11:27:17 localhost spamd[7053]: locker: safe_lock: link to /home/spam/.spamassassin/auto-whitelist.lock: link ok
Sep 13 11:27:17 localhost spamd[7053]: auto-whitelist: tie-ing to DB file of type DB_File R/W in /home/spam/.spamassassin/auto-whitelist
Sep 13 11:27:17 localhost spamd[7053]: auto-whitelist: db-based peter.wildhorn@ipwgroup.eu|ip=213.41 scores 0/0
Sep 13 11:27:17 localhost spamd[7053]: auto-whitelist: db-based peter.wildhorn@ipwgroup.eu|ip=none scores 0/0
Sep 13 11:27:17 localhost spamd[7053]: auto-whitelist: AWL active, pre-score: 2.812, autolearn score: 2.812, mean: undef, IP: 213.41.75.84
Sep 13 11:27:17 localhost spamd[7053]: auto-whitelist: add_score: new count: 1, new totscore: 2.812
Sep 13 11:27:17 localhost spamd[7053]: auto-whitelist: DB addr list: untie-ing and unlocking
Sep 13 11:27:17 localhost spamd[7053]: auto-whitelist: DB addr list: file locked, breaking lock
Sep 13 11:27:17 localhost spamd[7053]: locker: safe_unlock: unlink /home/spam/.spamassassin/auto-whitelist.lock
Sep 13 11:27:17 localhost spamd[7053]: auto-whitelist: post auto-whitelist score: 2.812
Sep 13 11:27:17 localhost spamd[7053]: rules: running body tests; score so far=2.812
Sep 13 11:27:17 localhost spamd[7053]: rules: running uri tests; score so far=2.812
Sep 13 11:27:17 localhost spamd[7053]: rules: running rawbody tests; score so far=2.812
Sep 13 11:27:17 localhost spamd[7053]: rules: running full tests; score so far=2.812
Sep 13 11:27:17 localhost spamd[7053]: rules: running meta tests; score so far=2.812
Sep 13 11:27:17 localhost spamd[7053]: learn: auto-learn: currently using scoreset 3, recomputing score based on scoreset 1
Sep 13 11:27:17 localhost spamd[7053]: learn: auto-learn: message score: 2.812, computed score for autolearn: 3.338
Sep 13 11:27:17 localhost spamd[7053]: learn: auto-learn? ham=0.1, spam=12, body-points=3.338, head-points=3.338, learned-points=0.001
Sep 13 11:27:17 localhost spamd[7053]: learn: auto-learn? no: inside auto-learn thresholds, not considered ham or spam
Sep 13 11:27:17 localhost spamd[7053]: check: is spam? score=2.812 required=6
Sep 13 11:27:17 localhost spamd[7053]: check: tests=BAYES_50,HTML_IMAGE_RATIO_02,HTML_MESSAGE,HTML_TITLE_SUBJ_DIFF,MPART_ALT_DIFF_COUNT,RDNS_NONE
Sep 13 11:27:17 localhost spamd[7053]: check: subtests=__CT,__CTYPE_HAS_BOUNDARY,__CTYPE_MULTIPART_ALT,__DOS_BODY_MON,__DOS_HAS_ANY_URI,__DOS_RCVD_THU,__DOS_REF_2_WK_DAYS,__DOS_SINGLE_EXT_RELAY,__FB_MBA,__HAS_ANY_EMAIL,__HAS_ANY_URI,__HAS_MSGID,__HAS_RCVD,__HAS_SUBJECT,__HTML_LINK_IMAGE,__HTML_TITLE_SUBJ_DIFF,__LAST_UNTRUSTED_RELAY_NO_AUTH,__MBA,__MIME_HTML,__MIME_QP,__MIME_VERSION,__MISSING_REF,__MSGID_OK_HOST,__MSOE_MID_WRONG_CASE,__NAKED_TO,__NONEMPTY_BODY,__SANE_MSGID,__TAG_EXISTS_BODY,__TAG_EXISTS_HEAD,__TAG_EXISTS_HTML,__TAG_EXISTS_META,__TOCC_EXISTS,__TVD_BODY,__TVD_MIME_ATT_TP
Sep 13 11:27:17 localhost spamd[7053]: spamd: clean message (2.8/6.0) for (unknown):1000 in 6.0 seconds, 9169 bytes.
Sep 13 11:27:17 localhost spamd[7053]: spamd: result: . 2 - BAYES_50,HTML_IMAGE_RATIO_02,HTML_MESSAGE,HTML_TITLE_SUBJ_DIFF,MPART_ALT_DIFF_COUNT,RDNS_NONE scantime=6.0,size=9169,user=(unknown),uid=1000,required_score=6.0,rhost=120.0.100.150,raddr=120.0.100.150,rport=44841,mid=<534546071@prod-mail.cabestan.com>,bayes=0.500000,autolearn=no
Sep 13 11:27:17 localhost spamd[7053]: config: copying current conf from backup
Sep 13 11:27:17 localhost spamd[7052]: prefork: child 7053: entering state 1
Sep 13 11:27:17 localhost spamd[7053]: prefork: periodic ping from spamd parent
Sep 13 11:27:17 localhost spamd[7052]: prefork: new lowest idle kid: 7053
Sep 13 11:27:17 localhost spamd[7053]: prefork: sysread(8) not ready, wait max 300 secs
Sep 13 11:27:17 localhost spamd[7052]: prefork: child reports idle
Sep 13 11:27:17 localhost spamd[7052]: prefork: child states: IB
Marsh Posté le 13-09-2007 à 11:44:24
Il y a qqch de très bizarre:
D'après les heures dans les traces le message semble avoir été traité en 3 secondes mais il indique 6s
En tout cas dans les faits c'est bien 6s car si j'ai un timeout de 5s sur mon relais smtp ca ne passe pas.
Marsh Posté le 13-09-2007 à 11:53:03
installe un cache dns sur ta becane en local et refait le test
Marsh Posté le 12-09-2007 à 11:29:04
Hello tous,
Suite au crash de mon serveur spamassassin ( http://forum.hardware.fr/forum2.ph [...] w=0&nojs=0 ) j'ai décidé de tout réinstaller proprement.
J'ai donc réinstallé le dernier Debian Etch sur ma machine.
installé la version de spamassassin "fourni" avec: la 3.1.7 donc.
J'ai configuré tout ce qu'il me fallait sans pb: bayes ... network tests etc...
mon architecture fait que mon serveur spam n'est pas relais SMTP, mon relais SMTP lui transmet les simplement les mails pour analyse !
tout fonctionne SAUF que depuis ce changement le scan time est anormalement long : entre 5 et 10s !
Sachant que mon relais smtp à un timeout de 5s (NON MODIFIABLE) je me retrouve avec aucun mail analysé. Dans les log de spamassassin tout va bien, seulement il scanne le mail en 6, 7 voir 8s donc mon relais n'attend pas sa réponse.
J'ai tout essayé:
-desactivé bayes
-desactiver les network test
-supprimer toutes mes règles
-augmenter la priorité des processus spamd ...
je n'arrive pas à descendre en dessous des 5s
Est ce que vous auriez des idées?
(surtout qu'avant il crash ca marchait très bien avec la même machine j'avais des temps d'analyse entre 1 et 4 secondes)
help
Message édité par Pims le 12-09-2007 à 11:29:32
---------------
Life is like a box of chocolate you never know what you gonna get.