It is currently Thu Sep 02, 2010 7:41 pm

All times are UTC - 5 hours




 Page 1 of 4 [ 39 posts ]  Go to page 1, 2, 3, 4  Next
Author Message
 Post subject: Unclassified Real Time Test No.1 (10+ Programs)
PostPosted: Tue Aug 04, 2009 10:46 am 
Site Admin
User avatar

Joined: Sun Aug 02, 2009 5:05 pm
Posts: 346
Location: Serbia/Switzerland
This test is based on the most trusted list of Anti-Malware applications made by our users, the poll was conducted in the past 2 months and after more then 10.000 votes we picked the top ten.

1. AVIRA
2. a-squared
3. Avast
4. Kaspersky
5. G Data
6. COMODO
7. Nod32
8. Norton
9. AVG
10 Dr.Web


We wanted to put this lineup trough a Real Time test to check out how effective they are when day have to block real time threats.

List of programs and program versions:

1. Avira AntiVir Premium Version: 9.0.0.441
2. a-squared Anti-Malware Version: 4.5.0.19
3. avast! Professiona Edition Version: 4.8.1335
4. Kaspersky Anti-Virus 2010 Version: 9.0.0.463
5. G Data AntiVirus 2010 Version: 20.0.1.1
6. COMODO Internet Security Version: 3.10.102363.531
7. ESET NOD32 Antivirus System Version: 4.0.437
8. Norton AntiVirus 2009 Version: 16.5.0.134
9. AVG Anti-Virus Professional Edition: 8.5.406/1617
10. Dr.Web anti-virus Version: 5.00.1.08030


We used 22 malicious applications in this test.

List of malware samples used in this test:

1. Trojan-Dropper.gen
MD5: 3c75ba631a2dc028c3e5fa0cecad09c2
2.Trojan.Win32.Obfuscated.gx
MD5: ef89d307be646bd47fb962ca00501c44
3. Backdoor.Win32.Bifrose.belf
MD5: ea14ff0df82fdd6278b2a5245f505adf
4. Trojan.Downloader.Win32.FraudLoad.eoj
MD5: 2fa6484fa509be89286d1c217b50a154
5. Trojan.Win32.Agent.cllv
MD5: 9717362718984a7e162f138ca5d1bb6f
6. Worm.Win32.AutoRun.gas
MD5: 520356f2a753375bd2819668fef04984
7. Trojan.Spy.Win32.Zbot.wcs
MD5: fd89ca4d6cd72c7dc8cb684902f56dc0
8. Trojan.Downloader.Win32.FraudLoad.eys
MD5: e329fd89ac7d0973ea384febee8b9de5
9. Trojan.Dropper.Win32.Agent.auoy
MD5: effe8947b3d694bf92e314778fc26497
10. Backdoor.Win32.Bifrose.baor
MD5: d8b1f0123196595bafa539b3c70b74c9
11. Email.Worm.Win32.Joleee.bvv
MD5: a8401d0c6bafa5cd81aaa18fef770084
12. Trojan.Spy.Win32.Zbot.vyo
MD5: bc652ab21de0bc50b26ddc4c231a978b
13. Net.Worm.Win32.Koobface.ahz
MD5: 26c8d8272bab57f8e525193d7084ae24
14. Rootkit.Win32.Agent.mos
MD5: c08a2004119382e89bda8bbf68d8fb76
15. Backdoor.Win32.SdBot.nng
MD5: 4fd364e00a98ce49205043cbbd2bee31
16. Rootkit.Win32.Small.acd
MD5: d608bc383e507f68f5e04964472c9503
17. Trojan.Downloader.Win32.FraudLoad.exw
MD5: c5b1f6ebb38577fa2840ac1cc9d423b3
18. Backdoor.Win32.UltimateDefender.hux
MD5: 97219653a5bbac138fcb96dee90f6ddb
19. Backdoor.Win32.Bifrose.bksm
MD5: 151a51b0f0d76b3c6f1e6ed9ba4fcae3
20. Trojan.Win32.Inject.ahdt
MD5: 9e992be5953f717b7a48c45d7c0229d3
21. Exploit.Win32.Pidief.asz
MD5: 3d84e94ecd92fe4650c11340ec5f639d
22. Trojan.Dropper.Tiny.ck
MD5: 8836c9bed08a5d0f861597bbef7d53ca


Methodology used in this test:

1.Windows XP Professional Service Pack 3 is installed and updated with all important updates.
2. An image of the Operating System is created.
3. A clone of the Imaged system is made for each program to be used in the test.
4. An individual program is installed on each of the Cloned systems.
5. On each Cloned system the package containing 22 samples of malware is placed.
6. All the programs are fully updated.
7. Real Time protection/On Access scanners are turned on prior to the start of the test.
8. All 22 samples of malware are packed inside exe files (executable files).
9. The test is conducted by trying to run (execute) the malicious applications (samples).
10. After each program was tested on all 22 samples, the system is checked for potential infections/malicious leftovers in all vulnerable system areas.
11. Programs that manage to successfully block all 22 samples of malware will get a System Protected Award.
12. Programs which were not able to block all malicious applications from running will automatically fail this test, we will list all the samples that were not blocked.


System Protected Award winners:

a-squared Anti-Malware successfully blocked all 22 malicious applications, no harmful objects found on the system after the test was completed.

Avira AntiVir Premium successfully blocked all 22 malicious applications, no harmful objects found on the system after the test was completed.

List of applications which have failed this test:

avast! Professiona Edition failed to block the flowing malware samples:
Exploit.Win32.Pidief.asz
Backdoor.Win32.Bifrose.bksm

Kaspersky Anti-Virus failed to block the flowing malware samples:
Trojan-Dropper.gen
Trojan.Dropper.Tiny.ck

G Data AntiVirus failed to block the flowing malware samples:
Backdoor.Win32.Bifrose.bksm

COMODO Internet Security (Defense+ turned off) failed to block the flowing malware samples:
Trojan-Dropper.gen
Backdoor.Win32.Bifrose.belf
Trojan.Win32.Agent.cllv
Backdoor.Win32.Bifrose.baor
Backdoor.Win32.UltimateDefender.hux
Backdoor.Win32.Bifrose.bksm

ESET NOD32 Antivirus System failed to block the flowing malware samples:
Trojan-Dropper.gen
Backdoor.Win32.Bifrose.bksm

Norton AntiVirus failed to block the flowing malware samples:
Trojan.Win32.Obfuscated.gx
Backdoor.Win32.Bifrose.bksm
Trojan.Dropper.Tiny.ck

AVG Anti-Virus failed to block the flowing malware samples:
Trojan-Dropper.gen
Exploit.Win32.Pidief.asz

Dr.Web anti-virus failed to block the flowing malware samples:
Trojan.Win32.Obfuscated.gx
Exploit.Win32.Pidief.asz

Additional information:
COMODO Internet Security didn't have Defense+ enabled as it wouldn't be fair to other programs.


Last edited by Sveta on Thu Aug 06, 2009 10:16 am, edited 3 times in total.


_________________
Malware Research Group
Internet Security & Solutions
Offline
 Profile  
 
 Post subject: Re: Unclassified Real Time Test No.1 (10 Programs)
PostPosted: Tue Aug 04, 2009 12:06 pm 
Site Admin
User avatar

Joined: Sun Aug 02, 2009 5:03 pm
Posts: 90
Location: UK
As an addendum to this test the following aplications were tested, using the same samples and methodology.

1. Prevx 3.0.1.65
2. MSE 1.0.1407.00


The tests were conducted within 30 minutes of the original test above, so as to ensure any cloud databases were approximately the same age as the local signatures used by the programmes in that test.

System Protected Award winner:

Prevx 3.0 successfully blocked all 22 malicious applications, no harmful objects found on the system after the test was completed.

Application which failed this test:

MSE failed to block the flowing malware samples:

Trojan.Win32.Obfuscated.gx
Rootkit.Win32.Agent.mos.sys
Rootkit.Win32.Small.acd.sys
Backdoor.Win32.Bifrose.bksm
Trojan.Win32.Inject.ahdt
Trojan.Dropper.Tiny.ck



_________________
Malware Research Group
Internet Security & Solutions
Offline
 Profile  
 
 Post subject: Re: Unclassified Real Time Test No.1 (10 Programs)
PostPosted: Tue Aug 04, 2009 12:27 pm 

Joined: Mon Aug 03, 2009 8:59 pm
Posts: 9
Nice test! No surprise for Avira & A2.

Toby


Offline
 Profile  
 
 Post subject: Re: Unclassified Real Time Test No.1 (10 Programs)
PostPosted: Tue Aug 04, 2009 12:46 pm 
User avatar

Joined: Mon Aug 03, 2009 10:52 am
Posts: 34
Nice test ! I'm not really surprised to see that A-squared and Avira pass this one with ease.
Also thanks to Chris, I really wanted to see a test for Prevx, and it seems that they're doing fine.

Keep up the good work !
eXPerience


Offline
 Profile  
 
 Post subject: Re: Unclassified Real Time Test No.1 (10 Programs)
PostPosted: Tue Aug 04, 2009 1:04 pm 

Joined: Sun Aug 02, 2009 5:03 pm
Posts: 4
not real surprises, i would like to see how Panda Cloud AV works in the type of test.

maybe next time :ugeek:


Offline
 Profile  
 
 Post subject: Re: Unclassified Real Time Test No.1 (10 Programs)
PostPosted: Tue Aug 04, 2009 3:14 pm 
Site Admin
User avatar

Joined: Sun Aug 02, 2009 5:05 pm
Posts: 346
Location: Serbia/Switzerland
Let me assure you all that this test was just beginning of what is coming :arrow:
We plan to test many more applications in various scenarios, sometimes we will use many applications, sometimes less, sometimes we will use 0-day malware samples, sometimes we will use samples that are in the "wild", we will create as many scenarios as possible...
But lets talk about this test here:
1. COMODO Internet Security Defense+ off/result lower, but the result would be different indeed if we turned on Defense+ which would be unfair to other programs, of course some may disagree with this.
2. Samples used in this test are a mix of new (few days old) and a bit older (about one month old), and by no means we wanted to make them easy to detect/block, now I know that some people will say that some samples are relatively unknown/not in mass distribution as we like to say, but let me just point out that all 22 samples used came from infected machines, to be more precised the items that caused the infection.
3. We used only 10+2 programs in this test simply because it was an unofficial test and we didn't have to include the whole lineup that we normally use. Also don't mix the results of MSE and Prevx with the others, MSE is not a final yet and Prevx is not a standard Anti-Malware application (but showed excellent result).



_________________
Malware Research Group
Internet Security & Solutions
Offline
 Profile  
 
 Post subject: Re: Unclassified Real Time Test No.1 (10+2 Programs)
PostPosted: Wed Aug 05, 2009 2:36 am 
Site Admin
User avatar

Joined: Sun Aug 02, 2009 5:05 pm
Posts: 346
Location: Serbia/Switzerland
By the request of COMODO Team, we have repeated the test with COMODO Internet Security, this time Defense+ was turned on.

COMODO Internet Security with Defense+ enabled successfully blocked all 22 malicious applications, no harmful objects found on the system after the test was completed.



_________________
Malware Research Group
Internet Security & Solutions
Offline
 Profile  
 
 Post subject: Re: Unclassified Real Time Test No.1 (10+2 Programs)
PostPosted: Wed Aug 05, 2009 3:28 am 
Site Admin
User avatar

Joined: Sun Aug 02, 2009 5:05 pm
Posts: 346
Location: Serbia/Switzerland
In addition to this test, we are adding the results from Emsi Software's Mamutu, which blocks malware by monitoring live all active programs for dangerous behavior, it does not use signature based detection methods.

We used the latest version, Mamutu Version 2.0.0.10

Mamutu successfully blocked all 22 malicious applications, no harmful objects found on the system after the test was completed.



_________________
Malware Research Group
Internet Security & Solutions
Offline
 Profile  
 
 Post subject: Re: Unclassified Real Time Test No.1 (10+2 Programs)
PostPosted: Wed Aug 05, 2009 4:37 am 
User avatar

Joined: Wed Aug 05, 2009 2:30 am
Posts: 40
great test, thanks.... ;)
I am glad with including PrevX and Microsoft Security Essentials



_________________
Regards to all
z25blink
Offline
 Profile  
 
 Post subject: Re: Unclassified Real Time Test No.1 (10+2 Programs)
PostPosted: Wed Aug 05, 2009 4:42 am 
User avatar

Joined: Wed Aug 05, 2009 2:30 am
Posts: 40
I understand only programs included in poll were tested,

but I am asking why is not included Tallemu (Online Armor), Agnitum (Outpost) security products. An moreover noone from Symantec (Norton), SoftWin (BitDefender),
Trustport (Internet Security 2009),Iobit (Security 360)

Hopefully we see these programs in MRG No.20

;)



_________________
Regards to all
z25blink
Offline
 Profile  
 
Display posts from previous:  Sort by  
 Page 1 of 4 [ 39 posts ]  Go to page 1, 2, 3, 4  Next

All times are UTC - 5 hours


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  

cron