Large file read to AutoIt again but faster

[maniootek]

I have some large file which I have to read to AutoIt to make some checking but reading same file again and again take a lot of time. I was wondering if I can save that file in some other way to read it in Autoit faster? It's report (text file) with tab character column separator. Maybe I can save it in RAM or something?

Any idea?

Edited June 7, 2021 by maniootek

[Danp2]

There aren't many details in your request. How are you currently reading the file? Have you looked into using FileReadToArray or _FileReadToArray?

[RTFC]

use filemapping

[Zedna]

If your report is some type of LOG file which is incrementally increasing then you may use my FileReadLastChars()

 

 

[maniootek]

20 hours ago, Danp2 said:

There aren't many details in your request. How are you currently reading the file? Have you looked into using FileReadToArray or _FileReadToArray?

My code use FileRead, StringSplit and some loop to convert file to array but I just tried _FileReadToArray and it's very fast. Instead of 60sec I wait now about 1-2 sec. That is incredible change! Thank you very much!

[maniootek]

I am wondring if there is some function to read json file to array or json object in same fast way?

[BigDaddyO]

I've been using this UDF for json stuff recently.

 

[maniootek]

On 6/8/2021 at 1:22 PM, BigDaddyO said:

I've been using this UDF for json stuff recently.

 

I don't see any function to read json from file

[Danp2]

It isn't intended to read the JSON from storage. Do we really need a new function for that? 🤨

[Jos]

57 minutes ago, maniootek said:

I don't see any function to read json from file

And what exactly is the issue with that or do you really need help how to read the whole file content into a variable in Autoit3?

Jos 

[maniootek]

It is all about speed. I am wondering if I can load data from file into AutoIt array with same fast way as function _FileReadToArray() do but with json file.

Local $hFileOpen = FileOpen($sFilePath)
Local $sJson_FileRead = FileRead($hFileOpen)

Local $oJson_Orders = Json_Decode($sJson_FileRead)
Local $a_oJson_Orders = Json_ObjGet($oJson_Orders, "orders")

 

[Jos]

Not sure what the actual question is and guess mine is: Did you try and have issues?

[maniootek]

The code is working. Looking for alternatives to speed up the process.

[Jos]

So how long do these 4 lines actually take to run?
Do you have something to share that is "slow" and we can see/run/test with?
 

[mLipok]

I'm working on JSON anonymizer.
It may took me few days, as I'm busy at other projects in my work.

[junkew]

On 6/22/2021 at 3:01 PM, maniootek said:

It is all about speed. I am wondering if I can load data from file into AutoIt array with same fast way as function _FileReadToArray() do but with json file.

Local $hFileOpen = FileOpen($sFilePath)
Local $sJson_FileRead = FileRead($hFileOpen)

Local $oJson_Orders = Json_Decode($sJson_FileRead)
Local $a_oJson_Orders = Json_ObjGet($oJson_Orders, "orders")

 

But what do you then expect?

see