remove bad words from txt file word list

[face]

i have a list of bad words in .txt format and a list of spell check words in .txt format also

 

how can i remove through the bad words list .txt file words from a 200k spell check .txt file

[JohnOne]

Many ways.

All depends how the lists are formatted.

[UEZ]

Load the file, find each bad words which you have loaded to an array and replace it with whatever you want.

Br,

UEZ

[Valuater]

Maybe...

Global $text1 = "C:\list.doc" ; your list location here
Global $text2 = "C:\spellcheck.doc" ; your spell check location here
 
$list = FileRead($text1)
$list = StringSplit($list, ",") ; for comma delimited text file
For $x = 1 To $list[0] - 1
 If StringInStr($list[$x], $text2) Then
  MsgBox(0, "Found", $list[$x])
  ; do something else here?
 EndIf
Next

 

NOT TESTED

8)

[face]

its 2 text files with 1 column each one of them has 200k+ rows the other around 400+ (bad words)

any ideas?

Edited October 10, 2013 by face

[Blue_Drache]

200 ... thousand?  Oy ... ok, look up

FileOpen()

FileReadLine()

While/WEnd

and

For/Next

Edit:

Also, I'd write the results to a new file with FileWriteLine()

Sure ... it's not going to win any awards for speed, but it'll brute-force the job.

Edited October 10, 2013 by Blue_Drache

[face]

thank you

can anyone post an example plz

[ripdad]

; 2013-10-10_161603
; blanket sanitizer

Local $str, $sFile = @ScriptDir & '\test.txt'
If FileExists($sFile) Then
    $str = FileRead($sFile)
    $str = StringRegExpReplace($str, '(?is)( word1 )|( word2 )|( word3 )', ' ### ')
    FileWrite(@ScriptDir & '\test_result.txt', $str)
EndIf

[JohnOne]

What you really ought to be doing is looking into using a database.

200,000 lines is probably not what .txt files were designed for.

The comment about speed from Blue_Drache is an understatement to say the least.

[face]

any help

[jdelaney]

Use ripdad's regexp.  If there are not leading and trailing spaces separating the words, then use word boundaries wrapping the 'curse' words instead.  Lookup stringregexp in the helpfile.  He already provided the example.

You can loop through the curse words list, and combine them in the format that ripdad provided, to dynamically create the regexp.  I've already shown you similar string concats, and loops before.

Edited October 11, 2013 by jdelaney