Large file read to AutoIt again but faster

[maniootek]

I have some large file which I have to read to AutoIt to make some checking but reading same file again and again take a lot of time. I was wondering if I can save that file in some other way to read it in Autoit faster? It's report (text file) with tab character column separator. Maybe I can save it in RAM or something?

Any idea?

Edited June 7, 2021 by maniootek

[Danp2]

There aren't many details in your request. How are you currently reading the file? Have you looked into using FileReadToArray or _FileReadToArray?

[RTFC]

use filemapping

[Zedna]

If your report is some type of LOG file which is incrementally increasing then you may use my FileReadLastChars()

 

 

[maniootek]

  On 6/7/2021 at 11:40 AM, Danp2 said:

There aren't many details in your request. How are you currently reading the file? Have you looked into using FileReadToArray or _FileReadToArray?

Expand  

My code use FileRead, StringSplit and some loop to convert file to array but I just tried _FileReadToArray and it's very fast. Instead of 60sec I wait now about 1-2 sec. That is incredible change! Thank you very much!

[maniootek]

I am wondring if there is some function to read json file to array or json object in same fast way?

[BigDaddyO]

I've been using this UDF for json stuff recently.

 

[maniootek]

  On 6/8/2021 at 11:22 AM, BigDaddyO said:

I've been using this UDF for json stuff recently.

 

Expand  

I don't see any function to read json from file

[Danp2]

It isn't intended to read the JSON from storage. Do we really need a new function for that? 🤨

[Jos]

  On 6/22/2021 at 11:31 AM, maniootek said:

I don't see any function to read json from file

Expand  

And what exactly is the issue with that or do you really need help how to read the whole file content into a variable in Autoit3?

Jos 

[maniootek]

It is all about speed. I am wondering if I can load data from file into AutoIt array with same fast way as function _FileReadToArray() do but with json file.

Local $hFileOpen = FileOpen($sFilePath)
Local $sJson_FileRead = FileRead($hFileOpen)

Local $oJson_Orders = Json_Decode($sJson_FileRead)
Local $a_oJson_Orders = Json_ObjGet($oJson_Orders, "orders")

 

[Jos]

Not sure what the actual question is and guess mine is: Did you try and have issues?

[maniootek]

The code is working. Looking for alternatives to speed up the process.

[Jos]

So how long do these 4 lines actually take to run?
Do you have something to share that is "slow" and we can see/run/test with?
 

[mLipok]

I'm working on JSON anonymizer.
It may took me few days, as I'm busy at other projects in my work.

[junkew]

  On 6/22/2021 at 1:01 PM, maniootek said:

It is all about speed. I am wondering if I can load data from file into AutoIt array with same fast way as function _FileReadToArray() do but with json file.

Local $hFileOpen = FileOpen($sFilePath)
Local $sJson_FileRead = FileRead($hFileOpen)

Local $oJson_Orders = Json_Decode($sJson_FileRead)
Local $a_oJson_Orders = Json_ObjGet($oJson_Orders, "orders")

 

Expand  

But what do you then expect?

see