New User? Need help? Click here to register for free! Registering removes the advertisements.

Computer Cops
image image image image image image image image
Donations
If you found this site helpful, please donate to help keep it online
Don't want to use PayPal? Try our physical address
image
Prime Choice
· Head Lines
· Advisories (All)
· Dnld of the Week!
· CCSP News Ltrs
· Find a Cure!

· Ian T's (AR 23)
· Marcia's (CO8)
· Bill G's (CO11)
· Paul's (AR 5)
· Robin's (AR 2)

· Ian T's Archive
· Marcia's Archive
· Bill G's Archive
· Paul's Archive
· Robin's Archive
image
Security Central
· Home
· Wireless
· Bookmarks
· CLSID
· Columbia
· Community
· Downloads
· Encyclopedia
· Feedback (send)
· Forums
· Gallery
· Giveaways
· HijackThis
· Journal
· Members List
· My Downloads
· PremChat
· Premium
· Private Messages
· Proxomitron
· Quizz
· RegChat
· Reviews
· Google Search
· Sections
· Software
· Statistics
· Stories Archive
· Submit News
· Surveys
· Top
· Topics
· Web Links
· Your Account
image
CCSP Toolkit
· Email Virus Scan
· UDP Port Scanner
· TCP Port Scanner
· Trojan TCP Scan
· Reveal Your IP
· Algorithms
· Whois
· nmap port scanner
· IPs Banned [?]
image
Survey
How much can you give to keep Computer Cops online?

$10 up to $25 per year?
$25 up to $50 per year?
$10 up to $25 per month?
$25 up to $50 per month?
More than $50 per year?
More than $50 per month?
One time only?
Other (please comment)



Results
Polls

Votes: 1018
Comments: 21
image
Translate
English German French
Italian Portuguese Spanish
Chinese Greek Russian
image
 Forum FAQForum FAQ   SearchSearch   UsergroupsUsergroups   ProfileProfile   Login to check your private messagesLogin to check your private messages   LoginLogin 

First Alert report blacklisted junk automacticly..
Goto page 1, 2, 3, 4  Next
 
Post new topic   Reply to topic       Computer Cops Forum Index -> FirstAlert!
View previous topic :: View next topic  
Author Message
rfharbin

Guest






PostPosted: Fri Jan 16, 2004 4:01 pm    Post subject: First Alert report blacklisted junk automacticly..
Reply with quote

All mail that is on my blacklist or that is filtered I have to click the check-box to report it. This is at least fifty or sixty e-mails a day. May I suggest that you add a function to have any mail that is blacklisted or filtered automatically put a check-mark in the report box, or at least a button at the bottom that will do this when I am ready to do so.
Back to top
stan_qaz

General
General
Premium Member
Premium Member


Joined: Mar 31, 2003
Posts: 4099
Location: USA

PostPosted: Fri Jan 16, 2004 4:35 pm    Post subject:
Reply with quote

That is not going to happen, check your instructions again, they require each e-mail be individually reviewed prior to being submitted to the first alert system.

Folks have been submitting non-spam e-mails and messing up the system already, removing the manual review would make that worse.

For more info search here on the author boo and the subject First Alert.
Back to top
View users profile Send private message Visit posters website
AbdLomax

Private
Private



Joined: Mar 10, 2004
Posts: 35
Location: USA

PostPosted: Tue Mar 16, 2004 11:35 am    Post subject:
Reply with quote

I've been looking through old posts on this forum and making a few comments. Here is another:

The name of First Alert implies something about how it works or should work. When it is working well, it will quickly identify spam and add the spam signature to the database. In such an environment, repetitive reports are useless. I.e., once mail is tagged by First Alert, reporting it will just add to the mail burden. (It shouldn't add to the aeministrative load, since presumably reports going to admin will be prefiltered to remove already-tagged spam reports.)

Mail that is being locally tagged by a blacklist or locally-created filter is almost by definition not new spam. More worrisome, if, as Mailwasher makes quite easy, it may even be the default, mail is being tagged by SpamCop, which has a low but persistent false positive rate, automatic reporting of such mail to First Alert will add to the administrative burden and increase the risk of a false indentification ending up on the First Alert list, which would be a serious failure.

So it is essential in the First Alert system, as was said, that a reporter have looked at the actual mail sufficiently to clearly and unmistakeably identify it as spam. Sometimes this only requires looking at the Subject line: "Impress your girlfriend!" Sometimes it may be necessary to look at the mail content: "Order information." Mailwasher Pro now makes all this really easy and fast.

Local sender blacklists, by the way, are being greatly over-used. They are quite ineffectual in identifying spam, and have a growing false positive rate as spammers increasingly spoof From headers, plus the all-too-common practice of adding SpamCop tagged mail senders to a local blacklist.

_________________
Abd ul-Rahman Lomax
Back to top
View users profile Send private message Send email
tbenton

Cadet
Cadet



Joined: Oct 30, 2003
Posts: 7
Location: USA

PostPosted: Wed Mar 17, 2004 8:37 am    Post subject: First Alert is an enhancement?
Reply with quote

I have had Mailwasher for a long time and First Alert since the trial began. I follow the instructions but seems I am getting more and more spam. MW and FA are wonderful for not getting the spam into my downloaded email but it takes so long to go thru the list delete/bounce/report,etc and longer every day. My filters do not seem to work at all either no matter how hard I try or how I configure them. Bottom line is that nothing seems to be helping the spam onslaught. I am wondering whether to pay for F Alert as it seems that the database of spammers grows too fast for anything to keep up with it. They are smarter than I ever thought they could be and it makes me winch, scream, moan and cuss. I have NEVER been to any web sites (not even by accident) to elicit all the penis enlargement and porn spam. No one uses my PC but me and I am always amazed at how they find me except that I get lots of it that is multiaddressed to many on my high speed cable ISP.

I also have everything checked to blacklist, delete,bounce AND hide but it never hides anything but my friends list....whats up with that?? Jedi Brawl

Any words of wisdom or comfort?

Terri
Back to top
View users profile Send private message
stan_qaz

General
General
Premium Member
Premium Member


Joined: Mar 31, 2003
Posts: 4099
Location: USA

PostPosted: Wed Mar 17, 2004 11:28 pm    Post subject:
Reply with quote

AbdLomax wrote:
Mail that is being locally tagged by a blacklist or locally-created filter is almost by definition not new spam.


Blacklist - yes.

Local filter - depends on the filter, most of the good ones work on things taht are common to all spams and aren't created to catch a specific word or phrase in a message.
Back to top
View users profile Send private message Visit posters website
stan_qaz

General
General
Premium Member
Premium Member


Joined: Mar 31, 2003
Posts: 4099
Location: USA

PostPosted: Wed Mar 17, 2004 11:35 pm    Post subject:
Reply with quote

Try this, first give up on the blacklist and quit bouncing. They aren't worth the effort.

Keep FA as it keeps getting better as they go along and learn more about running it.

Look at some of the filters proposed here, Denn has a couple good ones as does Gary, a half dozen of these should catch 90 percent of your spam.

If you have a good friends list turn on the source of spam tool and select spamcop.net.

I don't hide stuff so maybe someone else has a suggestion there.
Back to top
View users profile Send private message Visit posters website
Ikeb

General
General
Premium Member
Premium Member


Joined: Apr 20, 2003
Posts: 3503
Location: Canada

PostPosted: Thu Mar 18, 2004 12:59 am    Post subject:
Reply with quote

AbdLomax wrote:
The name of First Alert implies something about how it works or should work. When it is working well, it will quickly identify spam and add the spam signature to the database. In such an environment, repetitive reports are useless. I.e., once mail is tagged by First Alert, reporting it will just add to the mail burden. (It shouldn't add to the aeministrative load, since presumably reports going to admin will be prefiltered to remove already-tagged spam reports.)

I keep thinking that these repeated reports should be worth something! Perhaps the FA! system already takes this into account but if not it seems to me that the higher the number of reports regarding the same SPAM should guide the admins' priorities.

AbdLomax wrote:
Mail that is being locally tagged by a blacklist or locally-created filter is almost by definition not new spam. More worrisome, if, as Mailwasher makes quite easy, it may even be the default, mail is being tagged by SpamCop, which has a low but persistent false positive rate, automatic reporting of such mail to First Alert will add to the administrative burden and increase the risk of a false indentification ending up on the First Alert list, which would be a serious failure.

I agree with Stan: blacklist - forget it; local filters - not so fast! My top ten filters look for SPAM "fingerprints" in the header (largely based on info posted by Denn988), the next ten or so look for indicators in the message body (mostly stuff I worked out and posted). These filters catch over 95% of SPAM without breaking a sweat!

I doubt that FireTrust will ever allow the user to auto-report or even auto-set-checkmark based on other Spam Tools if that's your concern.
Many have asked with steadfast rejection from FireTrust.

AbdLomax wrote:
So it is essential in the First Alert system, as was said, that a reporter have looked at the actual mail sufficiently to clearly and unmistakeably identify it as spam. Sometimes this only requires looking at the Subject line: "Impress your girlfriend!" Sometimes it may be necessary to look at the mail content: "Order information." Mailwasher Pro now makes all this really easy and fast.

Well said! But the same goes for the second part, the FA! adminstrator! Can you imagine that poor sod's eyes after an 8 hr shift? Christmas Shocked

_________________
I like SPAM ... on my sandwich!
Back to top
View users profile Send private message Send email
tbenton

Cadet
Cadet



Joined: Oct 30, 2003
Posts: 7
Location: USA

PostPosted: Thu Mar 18, 2004 8:04 am    Post subject: First Alert
Reply with quote

Thanks so much for all the great replies/suggestions. I think I need to get some some filters installed.

One question to ABDLomax....how do I know which spam signatures I have already reported to avoid repetition?

Bottom line is that my spam email list in MW keeps growing and growing no matter what I do or what First Alert does. Its driving me MAD. Evil or Very Mad

Terri
Back to top
View users profile Send private message
stan_qaz

General
General
Premium Member
Premium Member


Joined: Mar 31, 2003
Posts: 4099
Location: USA

PostPosted: Thu Mar 18, 2004 8:01 pm    Post subject:
Reply with quote

Keep reporting all the spam that FA until it gets listed, the more they get the better they can figure out what changes they need to make.

Go with the filters, put a bunch (less than 10 to start) in and let them run. Keep an eye on them and rearrange them to suit yourself. The only way to evaluate a filter is to put it first in the list for a week and see how it performs, that is because the second and following filters don't get a shot at all the incoming spam and their hit rate suffers.
Back to top
View users profile Send private message Visit posters website
AbdLomax

Private
Private



Joined: Mar 10, 2004
Posts: 35
Location: USA

PostPosted: Thu Mar 18, 2004 8:49 pm    Post subject:
Reply with quote

Ikeb wrote:
AbdLomax wrote:
The name of First Alert implies something about how it works or should work. When it is working well, it will quickly identify spam and add the spam signature to the database. In such an environment, repetitive reports are useless. I.e., once mail is tagged by First Alert, reporting it will just add to the mail burden. (It shouldn't add to the aeministrative load, since presumably reports going to admin will be prefiltered to remove already-tagged spam reports.)


I keep thinking that these repeated reports should be worth something! Perhaps the FA! system already takes this into account but if not it seems to me that the higher the number of reports regarding the same SPAM should guide the admins' priorities.


I think what I wrote may be worth re-reading. Once a piece of content has been identified as spam content and has been added to the First Alert database, additional reports will do nothing. The additional reports "add to the mail burden," i.e., increase traffic, but that is a small harm. They will not harm the administrators because presumably administrators will never see additional reports on already confirmed spam.

The user need not worry about this; the only thing the user would need to know is to not report mail that is already tagged, which they will know from what they see in Mailwasher. I don't know, it is possible that the system won't even allow such reports. Now, it is possible that MW will report the incidence of tagged mail, but this would take place invisibly to the user. That's valuable information. A filter that is not tagging any mail might be retired after a time.

Ikeb wrote:
I agree with Stan: blacklist - forget it; local filters - not so fast! My top ten filters look for SPAM "fingerprints" in the header (largely based on info posted by Denn988), the next ten or so look for indicators in the message body (mostly stuff I worked out and posted). These filters catch over 95% of SPAM without breaking a sweat!


Question is, should you be allowed to automatically report based on those filters? I'd say No. You might be assisted in your own identification of spam by those filters, but if a filter is good enough to have effectively zero false positives, it should simply be one of the First Alert filters!

Ikeb wrote:
I doubt that FireTrust will ever allow the user to auto-report or even auto-set-checkmark based on other Spam Tools if that's your concern.
Many have asked with steadfast rejection from FireTrust.


I'll say it again. If a filter is good enough to be used for autoreporting, it is good enough to simply be one of the First Alert filters.

But what if it is *almost* good enough? Someone will still need to look at the mail. And the First Alert system will break down if that first look is a duty Administrator. Much better if it is a user, the burden is widely distributed that way.

There is no necessity, as I understand the First Alert concept, that everyone report every spam. If you report one fresh spam every few days, you'd be doing a major service. It should be *easy*. If you have filters that are detecting, say, 95% of the spam that is not detected by
First Alert, then you can look at what is easy for you and simply delete the rest. *Easy.* If there are a million users, each one detecting a couple of fresh spams a day and reporting it, spam will be knocked silly.

Ikeb wrote:
[Pity] the FA! adminstrator! Can you imagine that poor sod's eyes after an 8 hr shift? Christmas Shocked


FA has a fairly simple system. A user reports, an administrator verifies. Maybe the administrator is assisted by aggregate reporting, i.e., the administrator first looks at what has been multiply reported. Good, but I'd do something a little different. I'd have user validation so that some users are given greater credence, and the coincidence of multiple users, perhaps as few as two, of high credence would result in tagging without administrator intervention (though there would certainly be a log, maybe even a user-accessible log, for review). Non-credentialed users whose reports were validated by credentialed users would, after a time, become credentialed uses. In this model, the administrator simply watches the system to make sure it is working and is on hand for emergencies, false tagging, etc. If the administrator has time, yes, they could look at singletons, reports which have come in from a single reporter, and they could verify those reports. But administrator verification would no longer be an essential part of the system.

As to rewarding reporters, which has been mentioned under another topic, effective reporters could be honored and could receive service extensions. Beyond that, some might become administrators, trusted to take on some administrative duties, for which they would, of course, be paid. Certain kinds of administrative work could be done anywhere, even with a dial-up connection. Validating reports, for example, would make great work for a shut-in or a retiree, perhaps one who wants a few hours of work on a schedule that fits their needs. But I'm not sure that the system really needs administrators to do primary mail validation.
Back to top
View users profile Send private message Send email
stan_qaz

General
General
Premium Member
Premium Member


Joined: Mar 31, 2003
Posts: 4099
Location: USA

PostPosted: Thu Mar 18, 2004 9:14 pm    Post subject:
Reply with quote

There is no such thing as a "FirstAlert filter" that isn't how the system works.

You got the two tasks you mentioned for FA right but there are a bunch of others that need to be done as well, if you are interested I posted on some of them as have others.

If you don't have administrators you have another spamcop type service with a false positive problem. Not what most FA users want.
Back to top
View users profile Send private message Visit posters website
Ikeb

General
General
Premium Member
Premium Member


Joined: Apr 20, 2003
Posts: 3503
Location: Canada

PostPosted: Fri Mar 19, 2004 12:40 am    Post subject:
Reply with quote

Stan I don't think Abd's suggestion does away with Adminstrators. It just allows them to focus on the "intervention required" situations. So what if the administrator doesn't see a SPAM already reported by two accredited reporters.

True I don't understand what he's on about WRT FA! filters, perhaps you mean "filter which is good enough to autoreport to FA!" Abd?

I like the idea of having an official user credential although I can't see any clear distinction from similar suggestions you've already made Stan. Abd, perhaps it would be useful if you reviewed previous suggestions regarding user accreditation as a means of clarifying how your idea enhances or shifts the basic concept.

The idea of trusting users to become administrators is definitely novel and really intrigues me. This concept would clearly allow FA! to scale as required. And it would allow 24x365 operation of FA!, the lack of which has been noted during Kiwi holidays. Wink

_________________
I like SPAM ... on my sandwich!
Back to top
View users profile Send private message Send email
AbdLomax

Private
Private



Joined: Mar 10, 2004
Posts: 35
Location: USA

PostPosted: Sat Mar 20, 2004 11:16 pm    Post subject:
Reply with quote

Thanks, Ikester. Maybe I don't understand how First Alert works. This is what I thought. When a piece of spam that is not already tagged by First Alert is found and confirmed, a filter is created; that is, a signature is prepared which theoretically will identify the spam even if substantially modified. This signature/filter, whatever you call it, allows the spam to be identified, tagged. Whether the filter is sent to the user or the filter operates on the FA site I don't know; as far as processing power is concerned, it would theoretically be more powerful if the filter is running on the user computer.

My point was that if an automatic filter ("spam identifying tool") was good enough to allow its use for automatic reporting of spam, the filter could simply be one of a collection of filters that would comprise the First Alert spam-tagging system. So First Alert administration should not allow user reporting of spam based on a user-written local filter. However, it might accept submissions of user-written filters, which it could test against large mail traffic to determine the false positive level.

First Alert doesn't call their spam tagging technology a "filter." But it is nevertheless, as I read about it, a collection of filters that are maintained and which grow as new spam is identified.

This is the situation: there are many more users than spammers. By harnessing the user base in a way that places a very small burden on each user, spam can be overwhelmed. Trying to do it through a small company without effective harnessing of user power is not likely to work, there are too many spammers and they have too many resources (more than the resources of a small company, not more than the resources of the users).

If you look at it from a financial point of view, FA has proposed, if I'm correct, a user fee of something like $7 per year. If the average user's labor is worth $7 per hour (it ought to be worth quite a bit more than that!), $7 per year is 2 cents per day, or roughly a minute per day. Would I put more than a minute per day into fighting spam if I though it would be effective? Of course I would! There are SpamCop users who spend hours a day copying and pasting headers....

*Harness that energy.*

_________________
Abd ul-Rahman Lomax
Back to top
View users profile Send private message Send email
stan_qaz

General
General
Premium Member
Premium Member


Joined: Mar 31, 2003
Posts: 4099
Location: USA

PostPosted: Sun Mar 21, 2004 12:14 am    Post subject:
Reply with quote

Ikeb, Spamcop.net requires several reports from users before an address is tagged as a spam source and it still gets bunches of false positives. False positives on addresses that is which is different than false positives on e-mails which is another matter entirely.

Abd, You are completely confused on the first alert operation. A digital fingerprint is prepared by the FA portion of the mailwasher program and sent to firetrust when an e-mail arrives. That digital fingerprint is compared to other fingerprints in the FA database and if it matches closely enough you get a response back indicating it is a known spam. No filter is ever created either on your system or in the FA database.
Back to top
View users profile Send private message Visit posters website
Ikeb

General
General
Premium Member
Premium Member


Joined: Apr 20, 2003
Posts: 3503
Location: Canada

PostPosted: Sun Mar 21, 2004 12:45 am    Post subject:
Reply with quote

AbdLomax wrote:
Thanks, Ikester. Maybe I don't understand how First Alert works. This is what I thought. When a piece of spam that is not already tagged by First Alert is found and confirmed, a filter is created; that is, a signature is prepared which theoretically will identify the spam even if substantially modified. This signature/filter, whatever you call it, allows the spam to be identified, tagged. Whether the filter is sent to the user or the filter operates on the FA site I don't know; as far as processing power is concerned, it would theoretically be more powerful if the filter is running on the user computer.

OK. It's a matter of terminology apparently. Sure anything that analyses a stream of data and flags an attribute of the message is a filter. The FA! filter has been termed a signature. I guess Stan and I, as well as other MWP users I'm sure, are so used to the user Spam Tool known as "My Filters" (aka sidepanel "Filter" tab) that generic use of the term is not considered.

AbdLomax wrote:
My point was that if an automatic filter ("spam identifying tool") was good enough to allow its use for automatic reporting of spam, the filter could simply be one of a collection of filters that would comprise the First Alert spam-tagging system. So First Alert administration should not allow user reporting of spam based on a user-written local filter. However, it might accept submissions of user-written filters, which it could test against large mail traffic to determine the false positive level.

Sounds intriguing. But I'm not sure this would work. Many of my regex filters are unique to the headers as structured by my ISP's mail servers. I can't imagine how a regex filter I wrote could be applied in another context.

AbdLomax wrote:
First Alert doesn't call their spam tagging technology a "filter." But it is nevertheless, as I read about it, a collection of filters that are maintained and which grow as new spam is identified.

Yes I caught that from your first paragraph.

AbdLomax wrote:
This is the situation: there are many more users than spammers. By harnessing the user base in a way that places a very small burden on each user, spam can be overwhelmed. Trying to do it through a small company without effective harnessing of user power is not likely to work, there are too many spammers and they have too many resources (more than the resources of a small company, not more than the resources of the users).

Interesting concept. Stan mentioned Vipul\'s Razor which seems to parallel FA! WRT detection and reporting but diverges WRT distributed vs. centrallized validation. Perhaps that's the model you're looking for.

AbdLomax wrote:
If you look at it from a financial point of view, FA has proposed, if I'm correct, a user fee of something like $7 per year. If the average user's labor is worth $7 per hour (it ought to be worth quite a bit more than that!), $7 per year is 2 cents per day, or roughly a minute per day. Would I put more than a minute per day into fighting spam if I though it would be effective? Of course I would! There are SpamCop users who spend hours a day copying and pasting headers....

*Harness that energy.*

The concept has one tragic flaw - users are human. Humans gravitate towards the most efficient solution to a problem. In this situation, if someone else is willing to bear my load, it's more efficient to let them do so rather than me lifting my finger. In a large-scale anonymous system folks will naturally think this way. Of course the falicy is that since most folks naturally think this way, it turns out very few actually lift their finger. So the workload isn't distributed evenly, performance suffers, and the service suffers.

_________________
I like SPAM ... on my sandwich!
Back to top
View users profile Send private message Send email
Display posts from previous:   
Post new topic   Reply to topic       Computer Cops Forum Index -> FirstAlert! All times are GMT - 5 Hours
Goto page 1, 2, 3, 4  Next
Page 1 of 4

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
You cannot attach files in this forum
You can download files in this forum


Powered by phpBB 2.0.8a © 2001 phpBB Group

Version 2.0.6 of PHP-Nuke Port by Tom Nitzschner © 2002 www.toms-home.com
Version 2.2 by Paul Laudanski © 2003-2004 Computer Cops