JREPL.BAT v8.6 - regex text processor with support for text highlighting and alternate character sets

[dbenham]

Is it possible yet to tell jrepl to only search line numbers 3 thru 10?
I have the latest 8.2 version

It is all documented within the built in help.

Option /INC 3:10 will restrict the search to lines 3 through 10


Dave Benham

[onlinestatements]

It is not possible to use the /INC switch because my data has NULL bytes.
How can I use the PFLAG "i" option to only process the first found match and quit after that?

Code: Select all

for /R %%I in ("*.out") do (
call C:\qsi\jrepl.bat "\f" "" /xseq /INC "3:10" /F "%%I" /L /O -
call C:\qsi\jrepl.bat "ESCE" "" /xseq /INC "3:10" /F "%%I" /L /O -
)

[dbenham]

OK, I remember this situation now.

No, I don't have a solution for you. JScript has an inherent problem reading lines if the data contains null bytes. The only way JScript can reliably read null bytes is to read the entire file into memory as binary data, which is how the JREPL /M option works.

I can see why it would be useful to be able to read lines containing null bytes, but I am not eager to perform the significant design and coding required to circumvent the inherent JScript limitation.

I have a rough idea how it might be done within the current JREPL architecture, but I am not ready to tackle that task at the moment. I'll think about it, and I may change my mind over the next couple weeks.


Dave Benham

[Izya Kurvitch]

Hi Mr. Dave. Excuse my English. Really respect what are you doing, not only in IT sphere but in native music .
I have a question with my batch script replacing data from a file or list of files which doesn't work and unfortunately exits cycle loop... Could you explain where is a mistake? Here the code:

Code: Select all

@echo off
setlocal enabledelayedexpansion
set "int=000"
set "int_new=111"
for %%i in ("c:\text.txt") do (
jrepl "!int!" "!int_new!" /m /f "c:\text.txt" /o "c:\text_2.txt"
)
pause

It replaces the text but exits of the script. Thank you very much!

[onlinestatements]

Do you think SED or GREP from GNUWIN32 tools might help me with my problem?

[dbenham]

It replaces the text but exits of the script. Thank you very much!

JREPL.BAT is a batch script (that just happens to incorporate JSCRIPT). Like any other batch script, you must use CALL JREPL if you want to execute JREPL within another batch script and return.


Dave Benham

[dbenham]

Do you think SED or GREP from GNUWIN32 tools might help me with my problem?

Certainly not grep, as it only does searches, not replace.

I believe sed will work, but I wouldn't know how to do it. You should probably look elsewhere for help with sed.


Dave Benham

[dbenham]

@onlinestatements

Oh my goodness - I just realized there is a simple solution for reading files with null bytes without using the /M option

It is the Windows Script Host's TextStream.ReadLine method that is unable to read binary data with null bytes. But JREPL already gives you the option to read/write files via ADO instead of TextStream. ADO has no problem reading the binary data with null bytes

So you can drop the /M option and use ADO by appending the correct character set name to the file name. For example, if your input is ASCII, then you can simply use

Code: Select all

jrepl "search" "replace" ...options... /F "input.txt|ascii"

You can also use ADO for the output, but it is not necessary - TextStream.WriteLine has no problem writing null bytes.


I need to update the JREPL documentation to account for this issue. Currently the docs say binary input requires the /M option.


Dave Benham

[dbenham]

I replaced v8.2 with v8.3 - The only change is to the documentation - Binary files with null bytes may be read with either the /M option, or else via ADO.


Dave Benham

[Izya Kurvitch]

It replaces the text but exits of the script. Thank you very much!

JREPL.BAT is a batch script (that just happens to incorporate JSCRIPT). Like any other batch script, you must use CALL JREPL if you want to execute JREPL within another batch script and return.


Dave Benham

Thank you very much for your answer! I've just found the same solution of the problem. Anyway, like to you for right realization!

Izya Kurvitch

[onlinestatements]

how would I implement that solution into my code?

Code: Select all

for /R %%I in ("*.out") do (
call C:\qsi\jrepl.bat "\f" "" /xseq /INC "3:10" /F "%%I" /L /O -
call C:\qsi\jrepl.bat "ESCE" "" /xseq /INC "3:10" /F "%%I" /L /O -
)

Also I posted my question on stack overflow website and somebody gave me a solution using binary

for /R %%I in ("*.out") do call C:\qsi\jrepl.bat "\x1BE([\s\S]+?)\f" "$1" /M /F "%%I" /O -

see the page here that describes the above solution:
https://stackoverflow.com/questions/569 ... 5#57012495

[onlinestatements]

When I do this code it:

Code: Select all

call C:\qsi\jrepl.bat "\f" "" /F "%%I|ascii" /O -

it eliminates all the FF and keeps the null bytes intact

But if I do this code with /INC option added like:

Code: Select all

call C:\qsi\jrepl.bat "\f" "" /INC "3:9" /F "%%I|ascii" /O -

it doesn't eliminate anything at all.

What am I doing wrong?

@onlinestatements

Oh my goodness - I just realized there is a simple solution for reading files with null bytes without using the /M option

It is the Windows Script Host's TextStream.ReadLine method that is unable to read binary data with null bytes. But JREPL already gives you the option to read/write files via ADO instead of TextStream. ADO has no problem reading the binary data with null bytes

So you can drop the /M option and use ADO by appending the correct character set name to the file name. For example, if your input is ASCII, then you can simply use

Code: Select all

jrepl "search" "replace" ...options... /F "input.txt|ascii"

You can also use ADO for the output, but it is not necessary - TextStream.WriteLine has no problem writing null bytes.


I need to update the JREPL documentation to account for this issue. Currently the docs say binary input requires the /M option.


Dave Benham

[mwaychoff]

I am writing MediaWiki to PMwiki converter and am finding JREPL extremely useful. I have found two syntax that v8.3 does not handle correctly. Any suggestions would be greatly appreciated.

::SYNTAX EXAMPLES MEDIAWIKI PMWIK

::Images [[Image:wiki.jpg]] Attach:foo.jpg
jrepl_v8_3.bat "[[Image:" "Attach:" /f C:\Temp\jrepl\test.txt /o -

::Internal Link [[a link|with title]] [[page name | link text]]
jrepl_v8_3.bat "|" " | " /f C:\Temp\jrepl\test.txt /o -

[dbenham]

I am writing MediaWiki to PMwiki converter and am finding JREPL extremely useful. I have found two syntax that v8.3 does not handle correctly. Any suggestions would be greatly appreciated.

::SYNTAX EXAMPLES MEDIAWIKI PMWIK

::Images [[Image:wiki.jpg]] Attach:foo.jpg
jrepl_v8_3.bat "[[Image:" "Attach:" /f C:\Temp\jrepl\test.txt /o -

::Internal Link [[a link|with title]] [[page name | link text]]
jrepl_v8_3.bat "|" " | " /f C:\Temp\jrepl\test.txt /o -

[ and | are regular expression meta characters. If you want to search for those literal characters, then you must either add the /L option (literal option), or else escape them in your search string as \[ and \|

Code: Select all

jrepl_v8_3.bat "[[Image:" "Attach:" /f C:\Temp\jrepl\test.txt /o - /l
jrepl_v8_3.bat "|" " | " /f C:\Temp\jrepl\test.txt /o - /l

or

Code: Select all

jrepl_v8_3.bat "\[\[Image:" "Attach:" /f C:\Temp\jrepl\test.txt /o -
jrepl_v8_3.bat "\|" " | " /f C:\Temp\jrepl\test.txt /o -

If you are not using regular expressions, then you are missing the real power of JREPL. They are worth learning.


Dave Benham

[mwaychoff]

OK I follow & this works fine. Thanks for being patient with me.

How do I deal with quote mark replacement?

::SYNTAX EXAMPLES MEDIAWIKI PMWIK

::Notice Format <p class="Notice">Notice</p> || border=0 align=center bgcolor=pink width=100% \\ || ||

call jrepl_v8_3.bat "<p class="Notice">" "|| border=0 align=center bgcolor=pink width=100% \\ ||" /f C:\Temp\jrepl\output.rtf /o - /l

call jrepl_v8_3.bat "</p>" " ||" /f C:\Temp\jrepl\output.rtf /o - /l