Improving comment management

26. February 2010 16:53 by rtur.net in Spam Protection  //  Tags: ,   //   Comments (15)

tune-up

Looking at stats in several BlogEngine.Net 1.6 based sites, it seems like Akismet scores around 80% in accuracy on average, killing some 8 out of 10 spam comments. Which is pretty good but not outstanding. "Stop forum spam" filter blocks may be another 5%. Still, quite a lot of spam comments get through the filters. You can eliminate most of automated spam by adding captcha to your site, but it does require some basic skills and time. May be, given a surge in recent spam bots activity, it is time to include captcha to the main distribution out of the box? Also, number of enhancements to the current comment management have been suggested in the forum and few bugs found that need to be fixed. I think I might put together a little patch that improves and polishes comment management. Here is my to-do list, if you see good fit - feel free to add your suggestion. 

  • Integrate captcha control with option to enable/disable.
  • Do not generate email if added comment marked as spam
  • Spammers IP automatically added to the filter with "delete" action (black list)
  • If admin restores comment, IP and email added to the filter (white list)
  • Add option to show/hide pingbacks and trackbacks in the comments list
  • Fix comment counter in the post footer (spam doesn’t count)
  • Fix spam messing recent comments widget #
  • Add "Delete all spam" button
  • Disable action buttons when grid filter applied
  • Make "author" field editable
  • Integrate with intense debate or disqus to provide an option to outsource comments all together?

Comments (15) -

Thomas D
Thomas D
2/27/2010 2:19:28 AM #

That list looks real good. I can't think of anything to add.

lawmacs
lawmacs
2/27/2010 4:17:18 AM #

This is a brilliant list just a question here would inco-operating disqus or intense debate still save your comments to our own database another thing is this i read a post some where and it was pointed out that the spammers target that "Notify me when new comments are added" this is the search term they use thanks for your support.

adrian
adrian
2/27/2010 8:17:57 AM #

Well, regarding a captcha outr-of-the-box in BE, I think this would be great.
I've added on my blog a solution found on the web, now I'm using the recaptcha one from Filip Stanek, and since adding the captcha in place, about 9 days ago, I only received 4 spam comments. Without it in place, I would have received at least over 1000 spam comments during those 9 days.

As a suggestion, I think it would be nice to be able to deny the adding of comments based on some criteria. Usually spam is similar to a black campaign, they try to promote something, either raise a specific web site rank, sell something, etc. Simply put, is primarily all about the links they link. Sometimes such campaigns are aggressive(even with a captcha in place as this cannot stop human made spam), so it can be quite handy to deny/reject comments based on specific elements. To compare with something, say like mail servers who can reject certain email messages, thus reduce what actually gets into the inbox.

Cheers!
--Adrian

rtur.net
rtur.net
2/27/2010 9:45:02 AM #

I'm thinking about creating a service that will verify against such criteria, so that link for campaign blocked on one site would go straight to the black list available to everyone. Similar to "stop forum spam", but not based on IP. Just don't have time for it right now.

adrian
adrian
2/27/2010 12:45:30 PM #

That sounds like a neat service and idea. :)

Mathias
Mathias
2/27/2010 2:20:12 PM #

Having the Captcha, black/white list as part of the standard blogengine.net would really be great! Some spam is inevitable, but with the recent wave of garbage comments, I have spent way more time than I would like just deleting these. Keep up with the great job!

Steven
Steven
2/28/2010 9:54:24 PM #

Maybe I've missed something obvious here, but I don't see where I can edit my Akismet settings anymoe without going to the old commentor extension, so maybe you could add that to the list?

rtur.net
rtur.net
2/28/2010 10:29:37 PM #

Similar - just go to AkismetFilter settings and enter your key. Here is link to documentation: http://blogengine.codeplex.com/wikipage?title=CommentManagement&referringTitle=Documentation

Steven
Steven
3/4/2010 1:17:12 PM #

thanks for the info.  for some reason I just looked over it.

I do have quite a bit of spam comming through marked as whitelist rule but I do think the new design gives a lot of flexibility.

Steven
Steven
3/20/2010 6:44:47 AM #

It's be nice if you could add a page size setting as well go through potentially hundreds of comments 5 at a time is painful.

rtur.net
rtur.net
3/21/2010 10:46:43 PM #

If you talking about comments grid, you can set page size in the comments/configuration/comments per page. Filter grid does not have it, but you can change it pretty easily by changing page size in the control markup (settings.aspx).

Pravesh Soni
Pravesh Soni
3/21/2010 6:56:39 AM #

Great post. I'm looking for antispam for my blog. May be you can help as I'm struggling with them. I've added CAPTCHA but no success as there are paid spamming through humans. Can you help how to integrate IntenseDebate in BE1.6?

rtur.net
rtur.net
3/21/2010 10:23:55 AM #

Well, I'm done with everything on the list except captcha and intense debate/disqus. So I'd just say stay tuned, in a couple weeks I'll put together some kind of service pack.

lawmacs
lawmacs
3/23/2010 12:47:01 PM #

Thanks for the effort just drop me a line when it is ready i can't wait.

Filip Stanek
Filip Stanek
3/23/2010 10:50:50 PM #

Those are some nice fixes! I generally don't do the incremental updates, so hopefully you guys have a 1.61 or some similar release in the near future with these changes integrated.

One thing I would love to see is the ability to split the comments into different tabs - a tab for approved comments, a tab for trackbacks/pingbacks, and a tab for unapproved comments ( visible if you are logged in ).  I put something like this into my current blog (my changes are available for download ). The only problem with my solution is that I have a currently non-working comment rating system integrated with those changes.  It should be pretty simple to fix as it is just not saving the data properly, but I just haven't had any time in the past couple of weeks to work on it.  Removing the rating code or implementing it in your own way shouldn't be too much of a problem either. A description of what I'm talking about is located at: http://www.bloodforge.com/post/New-and-Improved-Comment-System-for-BlogEngineNET.aspx

One "issue" I've ran into when creating the rating extension is that it is not possible to add custom properties to a comment. For example, adding a "rating" field that is associated with the comment required changes in more places than I expected - the main problem being that BE.Core had to be modified. It would be nice if at some point in the future we could add our own properties to the comment (maybe create a field that is a StringDictionary or something similar). This will make it easier for people to create extensions for BE.NET, which should be one of the goals of the BE.NET team.

BTW, I did reply to you about the reCaptcha - sorry for the slow reply, but I haven't been checking my personal email in the past few days. Apart from the "manual moderation" (possible) bug that I wrote to you about, I had a couple other things on my to-do list. The first was making it so that you can add/remove the recaptcha from the contact page via a checkbox. The other was that you can add the recaptcha to the login page. I do have the contact page (standard theme only) updated with the recaptcha, although there is no toggle checkbox [http://www.bloodforge.com/post/Updated-Contact-Page-e28093-Now-with-a-reCaptcha.aspx]. I haven't written any code for the login page yet.

Pingbacks and trackbacks (3)+

Comments are closed

Recent Comments

Comment RSS