Ekyda Posted March 13, 2014 Share Posted March 13, 2014 (edited) I'm looking for the best way to strip a very large file (1+ gig) of all lines with characters less than 6 characters. I know of filereadline and strlen I would like to iterate through the entire file (using a buffer) that will rewrite the good characters to a new file in the quickest most effecient way possible. Doess anyone have an open API or an algorithm free to use? my current code is rather slow and ineffecient.. thanks in advance! so far it goes like this:filereadline x if strlen >= 6 then addtobuffer if buffersize >= buffermaxssize then _writebufferandflushit endif (not actual code but it gets the logic across.) im using filereadline so i dont have to load the entire text file to memory. Edited March 13, 2014 by Ekyda Link to comment Share on other sites More sharing options...
jchd Posted March 13, 2014 Share Posted March 13, 2014 A regular expression filter? This wonderful site allows debugging and testing regular expressions (many flavors available). An absolute must have in your bookmarks.Another excellent RegExp tutorial. Don't forget downloading your copy of up-to-date pcretest.exe and pcregrep.exe hereRegExp tutorial: enough to get startedPCRE v8.33 regexp documentation latest available release and currently implemented in AutoIt beta. SQLitespeed is another feature-rich premier SQLite manager (includes import/export). Well worth a try.SQLite Expert (freeware Personal Edition or payware Pro version) is a very useful SQLite database manager.An excellent eBook covering almost every aspect of SQLite3: a must-read for anyone doing serious work.SQL tutorial (covers "generic" SQL, but most of it applies to SQLite as well)A work-in-progress SQLite3 tutorial. Don't miss other LxyzTHW pages!SQLite official website with full documentation (may be newer than the SQLite library that comes standard with AutoIt) Link to comment Share on other sites More sharing options...
Ekyda Posted March 13, 2014 Author Share Posted March 13, 2014 does autoit still not support multithreading or anything of the sort? Link to comment Share on other sites More sharing options...
BrewManNH Posted March 13, 2014 Share Posted March 13, 2014 No, and it probably never will. If I posted any code, assume that code was written using the latest release version unless stated otherwise. Also, if it doesn't work on XP I can't help with that because I don't have access to XP, and I'm not going to.Give a programmer the correct code and he can do his work for a day. Teach a programmer to debug and he can do his work for a lifetime - by Chirag GudeHow to ask questions the smart way! I hereby grant any person the right to use any code I post, that I am the original author of, on the autoitscript.com forums, unless I've specifically stated otherwise in the code or the thread post. If you do use my code all I ask, as a courtesy, is to make note of where you got it from. Back up and restore Windows user files _Array.au3 - Modified array functions that include support for 2D arrays. - ColorChooser - An add-on for SciTE that pops up a color dialog so you can select and paste a color code into a script. - Customizable Splashscreen GUI w/Progress Bar - Create a custom "splash screen" GUI with a progress bar and custom label. - _FileGetProperty - Retrieve the properties of a file - SciTE Toolbar - A toolbar demo for use with the SciTE editor - GUIRegisterMsg demo - Demo script to show how to use the Windows messages to interact with controls and your GUI. - Latin Square password generator Link to comment Share on other sites More sharing options...
Ekyda Posted March 13, 2014 Author Share Posted March 13, 2014 No, and it probably never will. thanks for the quick response. I just did some searching on the forums and it seems that Valik says it's impossible. Link to comment Share on other sites More sharing options...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now