Danp2 Posted April 9, 2014 Posted April 9, 2014 I could use some help with a Regex pattern. I am attempting to extract some names and addresses (US format) from some free form text. Examples: Jane Doe PO Box 1234 Pensacola, FL 32524 Jane Doe 123 Sunset Blvd Apt 456 Pensacola, FL 32524 Jane Doe 555 Any Street Pensacola, FL 32524-1234 Second address line is optional. There are instances where the city or state may be missing. I came up with the following pattern through research / trial & error, but it isn't working exactly as I desire: (.+)(?>\r\n)(.+)(?>\r\n)(.+)(?>\r\n)?(.+)?,\h+(\w+)? ([-\d]+) When the second address line is missing, the value for city ends up in the wrong place. Suggestions on how I can fix / improve the pattern? TIA, Dan Latest Webdriver UDF Release Webdriver Wiki FAQs
Moderators Melba23 Posted April 9, 2014 Moderators Posted April 9, 2014 Danp2,First rule when asking for SRE help - give an example of what you want as the result. Each of those addresses has a second line, so the "when second line is missing" comment is not a great deal of help. What exactly do you want to see returned from the RegEx? M23 Any of my own code posted anywhere on the forum is available for use by others without any restriction of any kind Open spoiler to see my UDFs: Spoiler ArrayMultiColSort ---- Sort arrays on multiple columnsChooseFileFolder ---- Single and multiple selections from specified path treeview listingDate_Time_Convert -- Easily convert date/time formats, including the language usedExtMsgBox --------- A highly customisable replacement for MsgBoxGUIExtender -------- Extend and retract multiple sections within a GUIGUIFrame ---------- Subdivide GUIs into many adjustable framesGUIListViewEx ------- Insert, delete, move, drag, sort, edit and colour ListView itemsGUITreeViewEx ------ Check/clear parent and child checkboxes in a TreeViewMarquee ----------- Scrolling tickertape GUIsNoFocusLines ------- Remove the dotted focus lines from buttons, sliders, radios and checkboxesNotify ------------- Small notifications on the edge of the displayScrollbars ----------Automatically sized scrollbars with a single commandStringSize ---------- Automatically size controls to fit textToast -------------- Small GUIs which pop out of the notification area
Danp2 Posted April 9, 2014 Author Posted April 9, 2014 Hey Melba, Sorry for being vague. When I said second line, I'm actually meant the optional address line (Apt 456 in the second example). I'm trying to extract the following elements: name, address1, address2, city, state, and zip. Dan Latest Webdriver UDF Release Webdriver Wiki FAQs
Danp2 Posted April 9, 2014 Author Posted April 9, 2014 This appears to mostly work, although the 3rd group is capturing the CRLF. (.+)(?>\R)(.+)(?>\R)((?:.+)(?>\R))?(.+)?,\h+(\w+)?\h([-\d]+) Latest Webdriver UDF Release Webdriver Wiki FAQs
Moderators Melba23 Posted April 9, 2014 Moderators Posted April 9, 2014 Danp2,I would not bother with an SRE for this - just split the address and read the required lines: #include <StringConstants.au3> Global $aAddress[3] = ["Jane Doe" & @CRLF & "PO Box 1234" & @CRLF & "Pensacola, FL 32524", _ "Jane Doe" & @CRLF & "123 Sunset Blvd" & @CRLF & "Apt 456" & @CRLF & "Pensacola, FL 32524", _ "Jane Doe" & @CRLF & "555 Any Street" & @CRLF & "Pensacola, FL 32524-1234"] For $i = 0 To 2 $aSplit = StringSplit($aAddress[$i], @CRLF, $STR_ENTIRESPLIT) ; Combine the first 2 and last lines $sExtract = $aSplit[1] & @CRLF & $aSplit[2] & @CRLF & $aSplit[$aSplit[0]] ConsoleWrite($sExtract & @CRLF & @CRLF) NextNow wait for a real SRE guru to show you how it should be done! M23 Any of my own code posted anywhere on the forum is available for use by others without any restriction of any kind Open spoiler to see my UDFs: Spoiler ArrayMultiColSort ---- Sort arrays on multiple columnsChooseFileFolder ---- Single and multiple selections from specified path treeview listingDate_Time_Convert -- Easily convert date/time formats, including the language usedExtMsgBox --------- A highly customisable replacement for MsgBoxGUIExtender -------- Extend and retract multiple sections within a GUIGUIFrame ---------- Subdivide GUIs into many adjustable framesGUIListViewEx ------- Insert, delete, move, drag, sort, edit and colour ListView itemsGUITreeViewEx ------ Check/clear parent and child checkboxes in a TreeViewMarquee ----------- Scrolling tickertape GUIsNoFocusLines ------- Remove the dotted focus lines from buttons, sliders, radios and checkboxesNotify ------------- Small notifications on the edge of the displayScrollbars ----------Automatically sized scrollbars with a single commandStringSize ---------- Automatically size controls to fit textToast -------------- Small GUIs which pop out of the notification area
Danp2 Posted April 9, 2014 Author Posted April 9, 2014 I mentioned the free form text, but failed to add that the text contains other details unrelated to the address I am attempting to capture. It's essentially a series of form letters where the data has already been merged, and I'm trying to capture the separate portions of the mailing address. Latest Webdriver UDF Release Webdriver Wiki FAQs
jchd Posted April 9, 2014 Posted April 9, 2014 Having fought with international addresses for a long time, I wouldn't be surprised if even addresses in "US format" would prove very hard to deal with in general. Sure one can come up with a fairly good pattern but I strongly suspect that you'll get exceptions that would ruin your efforts. Here a more pedestrian approach is best, AFAICT. This wonderful site allows debugging and testing regular expressions (many flavors available). An absolute must have in your bookmarks.Another excellent RegExp tutorial. Don't forget downloading your copy of up-to-date pcretest.exe and pcregrep.exe hereRegExp tutorial: enough to get startedPCRE v8.33 regexp documentation latest available release and currently implemented in AutoIt beta. SQLitespeed is another feature-rich premier SQLite manager (includes import/export). Well worth a try.SQLite Expert (freeware Personal Edition or payware Pro version) is a very useful SQLite database manager.An excellent eBook covering almost every aspect of SQLite3: a must-read for anyone doing serious work.SQL tutorial (covers "generic" SQL, but most of it applies to SQLite as well)A work-in-progress SQLite3 tutorial. Don't miss other LxyzTHW pages!SQLite official website with full documentation (may be newer than the SQLite library that comes standard with AutoIt)
Moderators Melba23 Posted April 9, 2014 Moderators Posted April 9, 2014 Danp2,Second rule (applicable to all requests for help) - give all the necessary data when posing the question so people do not waste their time coding solutions which are obviously not going to work. M23 Any of my own code posted anywhere on the forum is available for use by others without any restriction of any kind Open spoiler to see my UDFs: Spoiler ArrayMultiColSort ---- Sort arrays on multiple columnsChooseFileFolder ---- Single and multiple selections from specified path treeview listingDate_Time_Convert -- Easily convert date/time formats, including the language usedExtMsgBox --------- A highly customisable replacement for MsgBoxGUIExtender -------- Extend and retract multiple sections within a GUIGUIFrame ---------- Subdivide GUIs into many adjustable framesGUIListViewEx ------- Insert, delete, move, drag, sort, edit and colour ListView itemsGUITreeViewEx ------ Check/clear parent and child checkboxes in a TreeViewMarquee ----------- Scrolling tickertape GUIsNoFocusLines ------- Remove the dotted focus lines from buttons, sliders, radios and checkboxesNotify ------------- Small notifications on the edge of the displayScrollbars ----------Automatically sized scrollbars with a single commandStringSize ---------- Automatically size controls to fit textToast -------------- Small GUIs which pop out of the notification area
Danp2 Posted April 9, 2014 Author Posted April 9, 2014 I tried to be detailed in my post, but obviously I left out some critical details. My bad. Latest Webdriver UDF Release Webdriver Wiki FAQs
mikell Posted April 9, 2014 Posted April 9, 2014 A possible way could be to get rid of all the 'unwanted details', it depends a lot on the shape of the original text Otherwise considered jchd's comment this looks like an impossible task
Moderators Melba23 Posted April 9, 2014 Moderators Posted April 9, 2014 Danp2,Following on from mikell's comment: is there any way you can distinguish the address lines from the rest of the text? Are they the only lines surrounded by blank lines? Are they in a specific place in the document? Do they have an indentation? Anything of that sort would help extract those particular lines for further analysis. M23 Any of my own code posted anywhere on the forum is available for use by others without any restriction of any kind Open spoiler to see my UDFs: Spoiler ArrayMultiColSort ---- Sort arrays on multiple columnsChooseFileFolder ---- Single and multiple selections from specified path treeview listingDate_Time_Convert -- Easily convert date/time formats, including the language usedExtMsgBox --------- A highly customisable replacement for MsgBoxGUIExtender -------- Extend and retract multiple sections within a GUIGUIFrame ---------- Subdivide GUIs into many adjustable framesGUIListViewEx ------- Insert, delete, move, drag, sort, edit and colour ListView itemsGUITreeViewEx ------ Check/clear parent and child checkboxes in a TreeViewMarquee ----------- Scrolling tickertape GUIsNoFocusLines ------- Remove the dotted focus lines from buttons, sliders, radios and checkboxesNotify ------------- Small notifications on the edge of the displayScrollbars ----------Automatically sized scrollbars with a single commandStringSize ---------- Automatically size controls to fit textToast -------------- Small GUIs which pop out of the notification area
jdelaney Posted April 9, 2014 Posted April 9, 2014 If you use option 4, in stringregexp, you can then fix the ubound of the array of arrays as the city, state, zip, and depending on the size of the array of arrays, you can infer if an address2 exists. IEbyXPATH-Grab IE DOM objects by XPATH IEscriptRecord-Makings of an IE script recorder ExcelFromXML-Create Excel docs without excel installed GetAllWindowControls-Output all control data on a given window.
Danp2 Posted April 9, 2014 Author Posted April 9, 2014 Yes, they are surrounded by blank lines. They are in the same general vicinity for each letter, but the positioning may vary slightly at times. I believe that I can make it work using the SRE I posted earlier. Thanks for the help! Latest Webdriver UDF Release Webdriver Wiki FAQs
BrewManNH Posted April 10, 2014 Posted April 10, 2014 The best thing I ever learned about RegEx was knowing when not to use it. This is one of those places where a RegEx isn't going to help all that much, and may in fact take far longer to develop than just a FileReadToArray and parsing each line. If I posted any code, assume that code was written using the latest release version unless stated otherwise. Also, if it doesn't work on XP I can't help with that because I don't have access to XP, and I'm not going to.Give a programmer the correct code and he can do his work for a day. Teach a programmer to debug and he can do his work for a lifetime - by Chirag GudeHow to ask questions the smart way! I hereby grant any person the right to use any code I post, that I am the original author of, on the autoitscript.com forums, unless I've specifically stated otherwise in the code or the thread post. If you do use my code all I ask, as a courtesy, is to make note of where you got it from. Back up and restore Windows user files _Array.au3 - Modified array functions that include support for 2D arrays. - ColorChooser - An add-on for SciTE that pops up a color dialog so you can select and paste a color code into a script. - Customizable Splashscreen GUI w/Progress Bar - Create a custom "splash screen" GUI with a progress bar and custom label. - _FileGetProperty - Retrieve the properties of a file - SciTE Toolbar - A toolbar demo for use with the SciTE editor - GUIRegisterMsg demo - Demo script to show how to use the Windows messages to interact with controls and your GUI. - Latin Square password generator
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now