Exploring gray web forums: Analysis and investigation of forum-based communities in Taiwan

Jau Hwang Wang, Tianjun Fu, Hong Ming Lin, Hsinchun Chen

Research output: Chapter in Book/Report/Conference proceedingChapter

1 Citation (Scopus)

Abstract

Our society is in a state of transformation toward a "virtual society". However, due to the nature of anonymity and less observability, internet activities have become more diverse and obscure. As a result, unscrupulous individuals or criminals may exploit the internet as a channel for their illegal activities to avoid the apprehension by law enforcement officials. This paper examines the "Gray Web Forums" in Taiwan. We study their characteristics and develop an analysis framework for assisting investigations on forum communities. Based on the statistical data collected from online forums, we found that the relationship between a posting and its responses is highly correlated to the forum nature. In addition, hot threads extracted based on posting activity and our proposed metric can be used to assist analysts in identifying illegal or inappropriate contents. Furthermore, a member's role and his/her activities in a virtual community can be identified by member level analysis. In addition, two schemes based on content analysis were also developed to search for illegal information items in gray forums. The experiment results show that hot threads are correlated to illegal information items, but the retrieval effectiveness can be significantly improved by search schemes based on content analysis.

Original languageEnglish (US)
Title of host publicationStudies in Computational Intelligence
Pages121-134
Number of pages14
Volume135
DOIs
StatePublished - 2008

Publication series

NameStudies in Computational Intelligence
Volume135
ISSN (Print)1860949X

Fingerprint

Internet
Observability
Law enforcement
Experiments

Keywords

  • Content analysis
  • Crime lead discovering
  • Forum analysis and investigation
  • Forum-based community
  • Gray web forum

ASJC Scopus subject areas

  • Artificial Intelligence

Cite this

Wang, J. H., Fu, T., Lin, H. M., & Chen, H. (2008). Exploring gray web forums: Analysis and investigation of forum-based communities in Taiwan. In Studies in Computational Intelligence (Vol. 135, pp. 121-134). (Studies in Computational Intelligence; Vol. 135). https://doi.org/10.1007/978-3-540-69209-6_7

Exploring gray web forums : Analysis and investigation of forum-based communities in Taiwan. / Wang, Jau Hwang; Fu, Tianjun; Lin, Hong Ming; Chen, Hsinchun.

Studies in Computational Intelligence. Vol. 135 2008. p. 121-134 (Studies in Computational Intelligence; Vol. 135).

Research output: Chapter in Book/Report/Conference proceedingChapter

Wang, JH, Fu, T, Lin, HM & Chen, H 2008, Exploring gray web forums: Analysis and investigation of forum-based communities in Taiwan. in Studies in Computational Intelligence. vol. 135, Studies in Computational Intelligence, vol. 135, pp. 121-134. https://doi.org/10.1007/978-3-540-69209-6_7
Wang JH, Fu T, Lin HM, Chen H. Exploring gray web forums: Analysis and investigation of forum-based communities in Taiwan. In Studies in Computational Intelligence. Vol. 135. 2008. p. 121-134. (Studies in Computational Intelligence). https://doi.org/10.1007/978-3-540-69209-6_7
Wang, Jau Hwang ; Fu, Tianjun ; Lin, Hong Ming ; Chen, Hsinchun. / Exploring gray web forums : Analysis and investigation of forum-based communities in Taiwan. Studies in Computational Intelligence. Vol. 135 2008. pp. 121-134 (Studies in Computational Intelligence).
@inbook{293fff17387b4db997f4786aae77879d,
title = "Exploring gray web forums: Analysis and investigation of forum-based communities in Taiwan",
abstract = "Our society is in a state of transformation toward a {"}virtual society{"}. However, due to the nature of anonymity and less observability, internet activities have become more diverse and obscure. As a result, unscrupulous individuals or criminals may exploit the internet as a channel for their illegal activities to avoid the apprehension by law enforcement officials. This paper examines the {"}Gray Web Forums{"} in Taiwan. We study their characteristics and develop an analysis framework for assisting investigations on forum communities. Based on the statistical data collected from online forums, we found that the relationship between a posting and its responses is highly correlated to the forum nature. In addition, hot threads extracted based on posting activity and our proposed metric can be used to assist analysts in identifying illegal or inappropriate contents. Furthermore, a member's role and his/her activities in a virtual community can be identified by member level analysis. In addition, two schemes based on content analysis were also developed to search for illegal information items in gray forums. The experiment results show that hot threads are correlated to illegal information items, but the retrieval effectiveness can be significantly improved by search schemes based on content analysis.",
keywords = "Content analysis, Crime lead discovering, Forum analysis and investigation, Forum-based community, Gray web forum",
author = "Wang, {Jau Hwang} and Tianjun Fu and Lin, {Hong Ming} and Hsinchun Chen",
year = "2008",
doi = "10.1007/978-3-540-69209-6_7",
language = "English (US)",
isbn = "9783540692072",
volume = "135",
series = "Studies in Computational Intelligence",
pages = "121--134",
booktitle = "Studies in Computational Intelligence",

}

TY - CHAP

T1 - Exploring gray web forums

T2 - Analysis and investigation of forum-based communities in Taiwan

AU - Wang, Jau Hwang

AU - Fu, Tianjun

AU - Lin, Hong Ming

AU - Chen, Hsinchun

PY - 2008

Y1 - 2008

N2 - Our society is in a state of transformation toward a "virtual society". However, due to the nature of anonymity and less observability, internet activities have become more diverse and obscure. As a result, unscrupulous individuals or criminals may exploit the internet as a channel for their illegal activities to avoid the apprehension by law enforcement officials. This paper examines the "Gray Web Forums" in Taiwan. We study their characteristics and develop an analysis framework for assisting investigations on forum communities. Based on the statistical data collected from online forums, we found that the relationship between a posting and its responses is highly correlated to the forum nature. In addition, hot threads extracted based on posting activity and our proposed metric can be used to assist analysts in identifying illegal or inappropriate contents. Furthermore, a member's role and his/her activities in a virtual community can be identified by member level analysis. In addition, two schemes based on content analysis were also developed to search for illegal information items in gray forums. The experiment results show that hot threads are correlated to illegal information items, but the retrieval effectiveness can be significantly improved by search schemes based on content analysis.

AB - Our society is in a state of transformation toward a "virtual society". However, due to the nature of anonymity and less observability, internet activities have become more diverse and obscure. As a result, unscrupulous individuals or criminals may exploit the internet as a channel for their illegal activities to avoid the apprehension by law enforcement officials. This paper examines the "Gray Web Forums" in Taiwan. We study their characteristics and develop an analysis framework for assisting investigations on forum communities. Based on the statistical data collected from online forums, we found that the relationship between a posting and its responses is highly correlated to the forum nature. In addition, hot threads extracted based on posting activity and our proposed metric can be used to assist analysts in identifying illegal or inappropriate contents. Furthermore, a member's role and his/her activities in a virtual community can be identified by member level analysis. In addition, two schemes based on content analysis were also developed to search for illegal information items in gray forums. The experiment results show that hot threads are correlated to illegal information items, but the retrieval effectiveness can be significantly improved by search schemes based on content analysis.

KW - Content analysis

KW - Crime lead discovering

KW - Forum analysis and investigation

KW - Forum-based community

KW - Gray web forum

UR - http://www.scopus.com/inward/record.url?scp=46049105775&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=46049105775&partnerID=8YFLogxK

U2 - 10.1007/978-3-540-69209-6_7

DO - 10.1007/978-3-540-69209-6_7

M3 - Chapter

AN - SCOPUS:46049105775

SN - 9783540692072

VL - 135

T3 - Studies in Computational Intelligence

SP - 121

EP - 134

BT - Studies in Computational Intelligence

ER -