{"id":2441,"date":"2017-08-31T08:14:00","date_gmt":"2017-08-31T08:14:00","guid":{"rendered":"https:\/\/blog.kindgeek.com\/?p=2441"},"modified":"2024-03-22T13:18:45","modified_gmt":"2024-03-22T13:18:45","slug":"time-to-save-you-from-spam","status":"publish","type":"post","link":"https:\/\/www.kindgeek.com\/blog\/post\/time-to-save-you-from-spam","title":{"rendered":"Time to save you from Spam"},"content":{"rendered":"

Recently updated on March 22, 2024<\/p><\/div>\n

Spam affects our lives all over the internet. Sometimes you don\u2019t even know that this is spam in front of you. So, what spam actually is? This is the use of e-messaging systems to send an unclaimed message, especially advertising, as well as sending messages repeatedly on the same site.<\/p>\n\n\n\n

Nobody likes spam, and the market for anti-spam software is huge counting into billions and expected to grow exponentially. Spam is not something that is black or white, the line is drawn very differently in many systems. For example, a message about some brand new soccer ball characteristics can be spam for personal messages, but in Facebook, group soccer might very appropriate information. That\u2019s one of the reasons why anti-spam software should be customized for specific needs.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Spam in numbers<\/h2>\n\n\n\n

It accounts for 14.5 billion messages globally per day (on average 2 spam messages to a person per day), this is around 45% of all emails. The United States is the number one generator of spam email, with Korea clocking in as the second-largest contributor of unwanted email. According to a study by the Radicati Research Group Inc., a research firm based in Palo Alto, California, spam costs businesses $20.5 billion annually in decreased productivity as well as in technical expenses. But, spam not only impacts our mailboxes. Nowadays, spam is getting much more “popular” on Social networks. Typical social spam includes tricking users into liking\/sharing content (like-jacking), or the promotion of malware from a third party site. The trickiest issue with social spam is that the message generally comes from a user’s actual friends and can be personalized. Facebook<\/a> states that \u201cless than\u201d 4% of all posts are spam Twitter<\/a> notes that 1.5% of all Tweets are spam.<\/p>\n\n\n\n

There\u2019s still ain\u2019t good universal and perfect system to detect spam and save your time from fighting with it. So we decided to take this challenge.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Spam Product<\/h2>\n\n\n\n

KindGeek<\/a>\u2019s\u00a0spam detection\u00a0software is oriented to eliminate spam in our clients’ products, which is social networks. For the first stage of the product development, KindGeeks chose\u00a0Naive Bayes Classifier<\/a>\u00a0which has been proven to be quite effective. The classifier is a\u00a0Machine Learning<\/a>\u00a0tool that is based on statistics. In simple words, a message is converted to a bag of words and based on statistics of those words being mentioned in previous messages that have already been categorized, the probability of the message being spam is calculated.<\/p>\n\n\n\n

Along with simplicity, Naive Bayes is known to outperform even highly sophisticated classification methods. However, this technique working well only if it has been already trained on a good dataset and also when a message doesn\u2019t contain spelling mistakes. Youtube<\/a> comments served a good dataset and ElasticSearch<\/a> for spelling mistakes.<\/p>\n\n\n\n

To complete some gaps on this stage we also use NLP, known as Natural language processing. This is artificial intelligence and computational linguistics related area, which concerned with the interactions between computers and human languages.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Future<\/h2>\n\n\n\n

We believe that the future of anti-spam in social networks lies in targeting not spam but targeting spammers. Users interacting with each other, users type messages that are connected with each other, users have so many things that can help to define whether they are spammers or not. Also, users get annoyed with a message that is interpreted as spam and this wrongfulness leads to a poorer quality of a social network and also the satisfaction of its clientele.<\/p>\n\n\n\n

One of the techniques for detecting spammers is a Graph-Based Classifier. The classifier is taking into account not only individual actions but rather tracking the behavior of users. The Classifier is constructing a huge graph of users’ interconnectivity and personal properties. The spam detection system will also include a review of used URL addresses and numbers.<\/p>\n\n\n\n

\"\"<\/figure>\n","protected":false},"excerpt":{"rendered":"

Spam affects our lives all over the internet. Sometimes you don\u2019t even know that this is spam in front of you. So, what spam actually is? How are we going to detect it? What can we do next?<\/p>\n","protected":false},"author":4,"featured_media":2444,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[103],"tags":[],"class_list":{"0":"post-2441","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-tips"},"yoast_head":"\nTime to save you from Spam | Kindgeek<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/kindgeek.com\/blog\/post\/time-to-save-you-from-spam\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Time to save you from Spam | Kindgeek\" \/>\n<meta property=\"og:description\" content=\"Spam affects our lives all over the internet. Sometimes you don\u2019t even know that this is spam in front of you. So, what spam actually is? How are we going to detect it? What can we do next?\" \/>\n<meta property=\"og:url\" content=\"https:\/\/kindgeek.com\/blog\/post\/time-to-save-you-from-spam\" \/>\n<meta property=\"og:site_name\" content=\"Kindgeek\" \/>\n<meta property=\"article:published_time\" content=\"2017-08-31T08:14:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-03-22T13:18:45+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/kindgeek.com\/blog\/wp-content\/uploads\/2017\/08\/SwErK0MoXsUlq7CYLJyA.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"400\" \/>\n\t<meta property=\"og:image:height\" content=\"400\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Oleksandra Denysenko\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Oleksandra Denysenko\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Time to save you from Spam | Kindgeek","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/kindgeek.com\/blog\/post\/time-to-save-you-from-spam","og_locale":"en_US","og_type":"article","og_title":"Time to save you from Spam | Kindgeek","og_description":"Spam affects our lives all over the internet. Sometimes you don\u2019t even know that this is spam in front of you. So, what spam actually is? How are we going to detect it? What can we do next?","og_url":"https:\/\/kindgeek.com\/blog\/post\/time-to-save-you-from-spam","og_site_name":"Kindgeek","article_published_time":"2017-08-31T08:14:00+00:00","article_modified_time":"2024-03-22T13:18:45+00:00","og_image":[{"width":400,"height":400,"url":"https:\/\/kindgeek.com\/blog\/wp-content\/uploads\/2017\/08\/SwErK0MoXsUlq7CYLJyA.jpg","type":"image\/jpeg"}],"author":"Oleksandra Denysenko","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Oleksandra Denysenko","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/kindgeek.com\/blog\/post\/time-to-save-you-from-spam#article","isPartOf":{"@id":"https:\/\/kindgeek.com\/blog\/post\/time-to-save-you-from-spam"},"author":{"name":"Oleksandra Denysenko","@id":"https:\/\/kindgeek.com\/blog\/#\/schema\/person\/b7e18f6c5e7558eb8b0562524776d397"},"headline":"Time to save you from Spam","datePublished":"2017-08-31T08:14:00+00:00","dateModified":"2024-03-22T13:18:45+00:00","mainEntityOfPage":{"@id":"https:\/\/kindgeek.com\/blog\/post\/time-to-save-you-from-spam"},"wordCount":641,"commentCount":0,"publisher":{"@id":"https:\/\/kindgeek.com\/blog\/#organization"},"image":{"@id":"https:\/\/kindgeek.com\/blog\/post\/time-to-save-you-from-spam#primaryimage"},"thumbnailUrl":"https:\/\/www.kindgeek.com\/blog\/wp-content\/uploads\/2017\/08\/SwErK0MoXsUlq7CYLJyA.jpg","articleSection":["Tips"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/kindgeek.com\/blog\/post\/time-to-save-you-from-spam","url":"https:\/\/kindgeek.com\/blog\/post\/time-to-save-you-from-spam","name":"Time to save you from Spam | Kindgeek","isPartOf":{"@id":"https:\/\/kindgeek.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/kindgeek.com\/blog\/post\/time-to-save-you-from-spam#primaryimage"},"image":{"@id":"https:\/\/kindgeek.com\/blog\/post\/time-to-save-you-from-spam#primaryimage"},"thumbnailUrl":"https:\/\/www.kindgeek.com\/blog\/wp-content\/uploads\/2017\/08\/SwErK0MoXsUlq7CYLJyA.jpg","datePublished":"2017-08-31T08:14:00+00:00","dateModified":"2024-03-22T13:18:45+00:00","breadcrumb":{"@id":"https:\/\/kindgeek.com\/blog\/post\/time-to-save-you-from-spam#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/kindgeek.com\/blog\/post\/time-to-save-you-from-spam"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/kindgeek.com\/blog\/post\/time-to-save-you-from-spam#primaryimage","url":"https:\/\/www.kindgeek.com\/blog\/wp-content\/uploads\/2017\/08\/SwErK0MoXsUlq7CYLJyA.jpg","contentUrl":"https:\/\/www.kindgeek.com\/blog\/wp-content\/uploads\/2017\/08\/SwErK0MoXsUlq7CYLJyA.jpg","width":400,"height":400},{"@type":"BreadcrumbList","@id":"https:\/\/kindgeek.com\/blog\/post\/time-to-save-you-from-spam#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/kindgeek.com\/blog"},{"@type":"ListItem","position":2,"name":"Time to save you from Spam"}]},{"@type":"WebSite","@id":"https:\/\/kindgeek.com\/blog\/#website","url":"https:\/\/kindgeek.com\/blog\/","name":"Kindgeek","description":"Blog | Kindgeek","publisher":{"@id":"https:\/\/kindgeek.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/kindgeek.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/kindgeek.com\/blog\/#organization","name":"Kindgeek","url":"https:\/\/kindgeek.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/kindgeek.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/kindgeek.com\/blog\/wp-content\/uploads\/2026\/02\/kg-logo-updated.png","contentUrl":"https:\/\/kindgeek.com\/blog\/wp-content\/uploads\/2026\/02\/kg-logo-updated.png","width":300,"height":60,"caption":"Kindgeek"},"image":{"@id":"https:\/\/kindgeek.com\/blog\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/kindgeek.com\/blog\/#\/schema\/person\/b7e18f6c5e7558eb8b0562524776d397","name":"Oleksandra Denysenko","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/kindgeek.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/2caa7a2fa3801c6f8a0b39da2f107736?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/2caa7a2fa3801c6f8a0b39da2f107736?s=96&d=mm&r=g","caption":"Oleksandra Denysenko"},"url":"https:\/\/www.kindgeek.com\/blog\/post\/author\/oleksandra-denysenko"}]}},"_links":{"self":[{"href":"https:\/\/www.kindgeek.com\/blog\/wp-json\/wp\/v2\/posts\/2441","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.kindgeek.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.kindgeek.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.kindgeek.com\/blog\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/www.kindgeek.com\/blog\/wp-json\/wp\/v2\/comments?post=2441"}],"version-history":[{"count":4,"href":"https:\/\/www.kindgeek.com\/blog\/wp-json\/wp\/v2\/posts\/2441\/revisions"}],"predecessor-version":[{"id":4723,"href":"https:\/\/www.kindgeek.com\/blog\/wp-json\/wp\/v2\/posts\/2441\/revisions\/4723"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.kindgeek.com\/blog\/wp-json\/wp\/v2\/media\/2444"}],"wp:attachment":[{"href":"https:\/\/www.kindgeek.com\/blog\/wp-json\/wp\/v2\/media?parent=2441"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.kindgeek.com\/blog\/wp-json\/wp\/v2\/categories?post=2441"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.kindgeek.com\/blog\/wp-json\/wp\/v2\/tags?post=2441"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}