DoomSack

Restricting StringSplit to only first occurence of delimeter

21 posts in this topic

#1 ·  Posted (edited)

Hello
        I am trying to split a table and store it in excel. I have been successful in accomplishing the task but with a minor bug.

This is the table 

[0]|
 
[1]|



Brodbeck, Dennis
email@someone.com
+1.123.456.2111
Hollowittz, Inc
Clerk
Harrison
OH
United States
Local $sStt = _ArrayToString($aTableData, ",")

                    Global $fFinalArray = _StringSplitToArray($sStt, @CRLF, 0)
                    _ArryRemoveBlanks($fFinalArray)

                    _Excel_RangeWrite($oWorkbook2, $oWorkbook2.ActiveSheet, $fFinalArray, $cells)



Func _StringSplitToArray($String, $Delimiter, $Flag)
    Dim $Display, $NumCols
    Local $sString1 = StringStripWS($String, 1)
    Local $sString2 = StringStripWS($sString1, 4)
    Local $v = 0
    ;---------------------------------------------------------------------
    ;Lets convert a comma delimited string into a single dimension array
    ;---------------------------------------------------------------------
    $Columns = StringSplit($sString2, $Delimiter, $Flag)
    Local $sStt1 = _ArrayToString($Columns, ",")
    $Columns1 = StringSplit($sStt1, ",", 0)
    Local $sStt2 = _ArrayToString($Columns1, ",", 2, 11)

    $Columns2 = StringSplit($sStt2, ",", 0)

    $NumCols = $Columns2[0]
    Dim $array[2][$Columns2[0]]
    For $i = 1 To $Columns2[0]
        $array[1][$i - 1] = $Columns2[$i]
    Next
    ;---------------------------------------------------------------------
    ;Display comma delimited string to a multidimensional Array
    ;---------------------------------------------------------------------
        For $j = 1 To $NumCols
        $Display = $Display & "array[1][" & String($j - 1) & "]" & Chr(9) & " = " & Chr(9) & $array[1][$j - 1] & @CRLF
    Next
    MsgBox(4096, "Your Multidimensional Array", $Display)
    Return $array
EndFunc   ;==>_StringSplitToArray

My problem is that I only want the comma to be separated from first and last name , but not from the company name. And also I am getting the data stored in the 1 index of the array rather than 0. So when i paste into excel there is one empty row after each entry.

Any help would be really appreciated . Thank you .

 

 

Edited by DoomSack

Share this post


Link to post
Share on other sites



I'm not certain, because I'm not sure where you are getting the original table from, but it seems to me that you are making this more complex than it needs to be.

I'm failing to see the value of creating a comma delimited string, which you then seem to pull apart.

Is your original table a file or part of a file with many similar entries?

Are the elements the same type in the same positions? Are any ever missing?

From what I can see, a simple FileRead and then StringSplit might setup the basics for all you want.


AutoIt.4.Life Clubrooms - Life is like a Donut (secret key)

Make sure brain is in gear before opening mouth!
Remember, what is not said, can be just as important as what is said.

Spoiler

What is the Secret Key? Life is like a Donut

If I put effort into communication, I expect you to read properly & fully, or just not comment.
Ignoring those who try to divert conversation with irrelevancies.
If I'm intent on insulting you or being rude, I will be obvious, not ambiguous about it.
I'm only big and bad, to those who have an over-active imagination.

I may have the Artistic Liesense ;) to disagree with you. TheSaint's Toolbox (be advised many downloads are not working due to ISP screwup with my storage)

userbar.png

Share this post


Link to post
Share on other sites

#3 ·  Posted (edited)

24 minutes ago, TheSaint said:

I'm not certain, because I'm not sure where you are getting the original table from, but it seems to me that you are making this more complex than it needs to be.

I'm failing to see the value of creating a comma delimited string, which you then seem to pull apart.

Is your original table a file or part of a file with many similar entries?

Are the elements the same type in the same positions? Are any ever missing?

From what I can see, a simple FileRead and then StringSplit might setup the basics for all you want.

The array is coming through web scrapping . And that is why so much of code .
I don't think we can use FileRead in my case.

Edited by DoomSack

Share this post


Link to post
Share on other sites

#4 ·  Posted (edited)

@TheSaint   I would love to see a simple version for this code . I am still not so good at coding in autoit . So any help would be great.

Edited by DoomSack

Share this post


Link to post
Share on other sites

It seems very convoluted what you are having to do.

What are you doing with all this data? Who is it for?

I am a little concerned that you don't seem have access to the original data.

Do you have permission to use this data ... from those involved?

I say that, because I see there are email addresses and other private data involved.

Even with web scraping, I don't see that you need to do half of what you are doing.


AutoIt.4.Life Clubrooms - Life is like a Donut (secret key)

Make sure brain is in gear before opening mouth!
Remember, what is not said, can be just as important as what is said.

Spoiler

What is the Secret Key? Life is like a Donut

If I put effort into communication, I expect you to read properly & fully, or just not comment.
Ignoring those who try to divert conversation with irrelevancies.
If I'm intent on insulting you or being rude, I will be obvious, not ambiguous about it.
I'm only big and bad, to those who have an over-active imagination.

I may have the Artistic Liesense ;) to disagree with you. TheSaint's Toolbox (be advised many downloads are not working due to ISP screwup with my storage)

userbar.png

Share this post


Link to post
Share on other sites

#6 ·  Posted (edited)

5 minutes ago, TheSaint said:

It seems very convoluted what you are having to do.

What are you doing with all this data? Who is it for?

I am a little concerned that you don't seem have access to the original data.

Do you have permission to use this data ... from those involved?

I say that, because I see there are email addresses and other private data involved.

Even with web scraping, I don't see that you need to do half of what you are doing.

I am Sorry . I seem to have leaked info. I have all the permissions required to do that. since I have paid for the account and that is why i get data,I am supposed to this manually, but i think we can automate it .

I have rectified the mistake and updated my question .

Edited by DoomSack

Share this post


Link to post
Share on other sites

If that is indeed the case, I am having trouble with why you even need to take the web scraping approach?

Why haven't you been given access to the original database files? They should be far easier to work with.


AutoIt.4.Life Clubrooms - Life is like a Donut (secret key)

Make sure brain is in gear before opening mouth!
Remember, what is not said, can be just as important as what is said.

Spoiler

What is the Secret Key? Life is like a Donut

If I put effort into communication, I expect you to read properly & fully, or just not comment.
Ignoring those who try to divert conversation with irrelevancies.
If I'm intent on insulting you or being rude, I will be obvious, not ambiguous about it.
I'm only big and bad, to those who have an over-active imagination.

I may have the Artistic Liesense ;) to disagree with you. TheSaint's Toolbox (be advised many downloads are not working due to ISP screwup with my storage)

userbar.png

Share this post


Link to post
Share on other sites
1 minute ago, TheSaint said:

If that is indeed the case, I am having trouble with why you even need to take the web scraping approach?

Why haven't you been given access to the original database files? They should be far easier to work with.

Because I am no coder. I am supposed to copy paste the data into excel files manually. I am trying to reduce my burden here :|

Share this post


Link to post
Share on other sites

The data that is populating the web page(s) you are scraping, must be coming from a database.

So i don't imagine you necessarily need to be a coder to work with it, just as you don't need to be a coder to use Excel.

So I am struggling to understand why you are needing to do things the seemingly hard way?

What is the reason for that?


AutoIt.4.Life Clubrooms - Life is like a Donut (secret key)

Make sure brain is in gear before opening mouth!
Remember, what is not said, can be just as important as what is said.

Spoiler

What is the Secret Key? Life is like a Donut

If I put effort into communication, I expect you to read properly & fully, or just not comment.
Ignoring those who try to divert conversation with irrelevancies.
If I'm intent on insulting you or being rude, I will be obvious, not ambiguous about it.
I'm only big and bad, to those who have an over-active imagination.

I may have the Artistic Liesense ;) to disagree with you. TheSaint's Toolbox (be advised many downloads are not working due to ISP screwup with my storage)

userbar.png

Share this post


Link to post
Share on other sites
Just now, TheSaint said:

The data that is populating the web page(s) you are scraping, must be coming from a database.

So i don't imagine you necessarily need to be a coder to work with it, just as you don't need to be a coder to use Excel.

So I am struggling to understand why you are needing to do things the seemingly hard way?

What is the reason for that?

If we have the Api and access to db can we directly get the info into excel ? I mean for specified set of persons ? I don't know if that  is easy than automation. because I don't know Java. Perhaps I have to look for different approach.

Share this post


Link to post
Share on other sites

Do you know what type of database is being used?

We have a good range of UDF's and Examples here.

Scraping a web page is like the last thing you try ... when all else has failed.


AutoIt.4.Life Clubrooms - Life is like a Donut (secret key)

Make sure brain is in gear before opening mouth!
Remember, what is not said, can be just as important as what is said.

Spoiler

What is the Secret Key? Life is like a Donut

If I put effort into communication, I expect you to read properly & fully, or just not comment.
Ignoring those who try to divert conversation with irrelevancies.
If I'm intent on insulting you or being rude, I will be obvious, not ambiguous about it.
I'm only big and bad, to those who have an over-active imagination.

I may have the Artistic Liesense ;) to disagree with you. TheSaint's Toolbox (be advised many downloads are not working due to ISP screwup with my storage)

userbar.png

Share this post


Link to post
Share on other sites
Just now, TheSaint said:

Do you know what type of database is being used?

We have a good range of UDF's and Examples here.

Scraping a web page is like the last thing you try ... when all else has failed.

Hmmm .. Seems so to me. I might have to ask someone from engineering team to do.
Or Do it  Manually :(

Share this post


Link to post
Share on other sites

Yep, I would advise that.

If you can find out it is XML or SQL etc we have options to suggest.


AutoIt.4.Life Clubrooms - Life is like a Donut (secret key)

Make sure brain is in gear before opening mouth!
Remember, what is not said, can be just as important as what is said.

Spoiler

What is the Secret Key? Life is like a Donut

If I put effort into communication, I expect you to read properly & fully, or just not comment.
Ignoring those who try to divert conversation with irrelevancies.
If I'm intent on insulting you or being rude, I will be obvious, not ambiguous about it.
I'm only big and bad, to those who have an over-active imagination.

I may have the Artistic Liesense ;) to disagree with you. TheSaint's Toolbox (be advised many downloads are not working due to ISP screwup with my storage)

userbar.png

Share this post


Link to post
Share on other sites
2 minutes ago, TheSaint said:

Yep, I would advise that.

If you can find out it is XML or SQL etc we have options to suggest.

Okay Let me find out. I will reply as soon as I get to know that. I'll leave the website's support team an email now.

Share this post


Link to post
Share on other sites

#15 ·  Posted (edited)

Can you post a screenshot of the arraydisplay,  or is it really:

element 0 is  single pipe character

element 1 is pipe character, some linefeeds, then a few rows of data?

 

I dont think the arraytostring operations are necessary at all, but let us see the display

Edited by iamtheky

,-. .--. ________ .-. .-. ,---. ,-. .-. .-. .-.
|(| / /\ \ |\ /| |__ __||| | | || .-' | |/ / \ \_/ )/
(_) / /__\ \ |(\ / | )| | | `-' | | `-. | | / __ \ (_)
| | | __ | (_)\/ | (_) | | .-. | | .-' | | \ |__| ) (
| | | | |)| | \ / | | | | | |)| | `--. | |) \ | |
`-' |_| (_) | |\/| | `-' /( (_)/( __.' |((_)-' /(_|
'-' '-' (__) (__) (_) (__)

Share this post


Link to post
Share on other sites

Could something like this do the trick ?  :)

#Include <Array.au3>

Local $table = ["[0]|", _
"", _ 
"[1]|", _ 
"", _ 
"", _ 
"", _ 
"Brodbeck, Dennis", _ 
"email@someone.com", _ 
"+1.123.456.2111", _ 
"Hollowittz, Inc", _ 
"Clerk", _ 
"Harrison", _ 
"OH", _ 
"United States"]

_ArrayDisplay($table)

$string = _ArrayToString($table, @crlf)
$string = StringReplace($string, ", ", @crlf, 1)
$res = StringRegExp($string, '(?m)^[^\[]\N+', 3)
_ArrayDisplay($res)

 

Share this post


Link to post
Share on other sites

or:

#Include <Array.au3>

Local $table = ["[0]|", _
"", _
"[1]|", _
"", _
"", _
"", _
"Brodbeck, Dennis", _
"email@someone.com", _
"+1.123.456.2111", _
"Hollowittz, Inc", _
"Clerk", _
"Harrison", _
"OH", _
"United States"]

$aName = stringsplit($table[6] , "," , 2)
_ArrayConcatenate($aName , $table , 7)
_ArrayDisplay($aName)

 


,-. .--. ________ .-. .-. ,---. ,-. .-. .-. .-.
|(| / /\ \ |\ /| |__ __||| | | || .-' | |/ / \ \_/ )/
(_) / /__\ \ |(\ / | )| | | `-' | | `-. | | / __ \ (_)
| | | __ | (_)\/ | (_) | | .-. | | .-' | | \ |__| ) (
| | | | |)| | \ / | | | | | |)| | `--. | |) \ | |
`-' |_| (_) | |\/| | `-' /( (_)/( __.' |((_)-' /(_|
'-' '-' (__) (__) (_) (__)

Share this post


Link to post
Share on other sites

#18 ·  Posted (edited)

He is scraping the Table text, so not in the condition you both are illustrating.

To my mind, the scrape would be a variable that he could just perform StringSplit on using the @CRLF, then weed out the blanks and then work on line numbers (providing they are always the same of course).

The only tricky bit, is if there is more than one subject in a scrape, which would then require some method of separating each grouping out.

However, I still think it best he avoid scraping in the first place ... it also looks less suspicious ... especially as at the moment it looks all too much like he may be gathering details about people ... perhaps even breached the security of a website to do so.

He may indeed be genuine, and I hope he is, but we all know similar bad stuff goes on all the time, and I for one never wish to support that kind of harvesting.

Edited by TheSaint

AutoIt.4.Life Clubrooms - Life is like a Donut (secret key)

Make sure brain is in gear before opening mouth!
Remember, what is not said, can be just as important as what is said.

Spoiler

What is the Secret Key? Life is like a Donut

If I put effort into communication, I expect you to read properly & fully, or just not comment.
Ignoring those who try to divert conversation with irrelevancies.
If I'm intent on insulting you or being rude, I will be obvious, not ambiguous about it.
I'm only big and bad, to those who have an over-active imagination.

I may have the Artistic Liesense ;) to disagree with you. TheSaint's Toolbox (be advised many downloads are not working due to ISP screwup with my storage)

userbar.png

Share this post


Link to post
Share on other sites
2 hours ago, TheSaint said:

He is scraping the Table text, so not in the condition you both are illustrating.

To my mind, the scrape would be a variable that he could just perform StringSplit on using the @CRLF, then weed out the blanks and then work on line numbers (providing they are always the same of course).

The only tricky bit, is if there is more than one subject in a scrape, which would then require some method of separating each grouping out.

However, I still think it best he avoid scraping in the first place ... it also looks less suspicious ... especially as at the moment it looks all too much like he may be gathering details about people ... perhaps even breached the security of a website to do so.

He may indeed be genuine, and I hope he is, but we all know similar bad stuff goes on all the time, and I for one never wish to support that kind of harvesting.

I assure of no such breaching activity. And thank you for putting me in the right direction, to my surprise there is a way to get the data and the website support team is going to assist me on how to do it.
Thank you all for your replies..

1 person likes this

Share this post


Link to post
Share on other sites

That's excellent. :thumbsup:

Thanks for letting us know.

P.S. Don't mind me, I am just suspicious by nature ... even of myself. :lol:


AutoIt.4.Life Clubrooms - Life is like a Donut (secret key)

Make sure brain is in gear before opening mouth!
Remember, what is not said, can be just as important as what is said.

Spoiler

What is the Secret Key? Life is like a Donut

If I put effort into communication, I expect you to read properly & fully, or just not comment.
Ignoring those who try to divert conversation with irrelevancies.
If I'm intent on insulting you or being rude, I will be obvious, not ambiguous about it.
I'm only big and bad, to those who have an over-active imagination.

I may have the Artistic Liesense ;) to disagree with you. TheSaint's Toolbox (be advised many downloads are not working due to ISP screwup with my storage)

userbar.png

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!


Register a new account

Sign in

Already have an account? Sign in here.


Sign In Now

  • Similar Content

    • sree161
      By sree161
      Hi,
      i have a code which generates two numeric outputs.i have to save them in excel.
      Is there any way to export them to specific cells in excel???
    • TotalAuto
      By TotalAuto
      Howdy All
      I've gone around and around in circles wasting hours trying to fix this problem to no avail so I thought I would try posting for help given there are some real smart people in this forum.
      Background
      I have 5 separate .au3 scripts that all do different basic tasks. For example:
      1.au3 = opens Chrome browser to obtain information from a specific website then closes
      2.au3 = opens an Excel workbook to run a macro then saves and closes
      3.au3 = Open two seperate workbooks and transfers data from one to the other then saves and closes
      4.au3 = .......etc
      5.au3 = .......etc
      These 5 separate scripts, doing completely different tasks, need to each run once per day at 5 different designated times within a day and then close. For example:
      1.au3 = 10am
      2.au3 = 12pm
      3.au3 = 2pm
      4.au3 = 4pm
      5.au3 = 5pm
      Problem
      I can not get these different scripts to reliably run at their designated times. When I manually run these scripts individually by using 'Go F5' they work perfectly. If I convert these scripts to an .exe and manually run each one they work about 98% of time.
      How can I schedule these different .au3 files or associated .exe files to reliably run each day at different times?
      Attempts To Fix The Issue
      1. I have tried converting each .au3 script into their own .exe file and use Window's Task Scheduler to run these .exe files at their designated time but the success rate  of running each .exe in full, to completion, without error is very low at about 30%. Things that commonly go wrong include a browser not opening but movement still continues on the desk top. Other times things just do not happen at all.
      2. I have Windows 7 64 bit and have tried creating and running both (x86) and (x64) .exe files but again reliability problems exist;
      3. I have also tried moving each .exe file to the My Documents folder as I read someone that keeping your files on your desktop ties your files to individual Windows user profiles which can cause AutoIt operating errors. Not sure if this is correct but thought I would try it anyway. It did not fix my issue.
      4. I installed a program called AlwaysUp which supposedly always reliably runs in the background and will reliably execute your AutoIt script or .exe files. Still have significant reliability issues.
      Therefore, can someone please provide advice on how I can get my 5 different .au3 files to run at 5 designated times through the day, every day, without fail? Overtime I will be creating more and more different .au3 files to run certain tasks throughout the day and do not want to create one large AutoIt file that continually runs and attempts to do all the different tasks itself.
      Any help is very appreciated.
      Thanks
      Dan
       
       
    • hugomito
      By hugomito
      Hi all,
      I built an AutoIt application that interacts with several other applications/software. Now, it's turn to interfact with Visual Studio Team Services (VSTS).
      Does anyone has a blog, demo, script to share?
      Thanks!
    • Viki
      By Viki
      This is my first time here so please dont bombard me that what a silly question I am asking!!
      I have 500 rows (A1:A500) in a spreadsheet and I just want to copy one by one row and then paste into another application and then press enter, loop should repeat this until finishes all 500 rows.
      I have looked at clipget(), clip(put() but dont know how to select next row in next turn. I also looked at Array to store but again no luck. Can some guide me please..
    • DineshPawar
      By DineshPawar
      0down votefavorite   In my current project, Excel macro open AutoIt script using a function Call Shell("location of autoit script").
      For proper functioning of AutoIt script it's need to be close parent Excel workbook, so this closing Excel action is written in AutoIt script itself.
      But as soon as AutoIt script close parent Excel workbook then script get pause and it do nothing.
      How open the AutoIt script from Excel workbook and after that parent Workbook get close?