question, how to make sure that line of command will not stop the rest of noscript .

there && that make sure the next command will run either the earlier one is executed or not.

i need to put like of two command , how to make sure then those two command 'all in 1 line' if they not executed , the rest of the noscript will keep continue and not affected by this line ?

for instance a line with 'date && cal' .

if those by any chance not executed how to make sure the rest of the noscript will continue ?

should i add what at the end of the line or just as it is will not halt the rest of noscript weather such a line like this 'COMMAND && COMMAND' executed or not ?

https://redd.it/10dhdcg
@r_bash

Why can't I operate on the return of my ssh call using the eq comparison operator?

Hello, I've got a problem with using the return of an ssh call and comparing it with numbers and thought maybe someone can help me.
I have two different calls that I make in a noscript, one of them is a mkdir call like this:
RET=ssh user@system -t "mkdir -p <path>"
And the other one does the following
RET=ssh user@system -t "ls -l <path>"

When I now call $?, I will get a 0 in both cases if the command has been executed successfully, but if I want to compare that 0 with the eq (or -eq) operator, I get an error in the first command, but not in the second.
I get that -eq is used to compare numbers, which I assumed is what is getting returned.
Is there any explanation that I'm not seeing why the first command isn't return such a number but rather a string?

If I use the != operator, I can do the comparison no problem, but not with eq.

Any ideas?

https://redd.it/10dg0s2
@r_bash

Is there a good way to programmatically determine how many inputs some function can support?

WHAT I WANT TO DO

Programs like sha256sum accept a list of inputs and will apply whatever the function does (e.g., compute the sha256sum) to each (non-option) input independently. You can do, for example:

sha256sum file1 file2 file3 ...

or

find ./ -type f | xargs -P<N> sha256sum

Other programs, for example, basename, only support 1 non-option input. you cant use

basename file1 file2 file3 ...

nor

find ./ -type f | xargs -P<N> basename

instead, you have to use

for file in file1 file2 file3 ...; do
basename "$file
done

or

find ./ -type f | xargs -l1 -P<N> basename

Im trying to figure out a good way to determine, for some generic function, which of the above is the case (and in the "multiple inputs" case what the maximum number of inputs is) without requiring any user interaction.

Any good way to do this?

WHY

I put together a shell function for parallelizing loops called forkrun. Instead of forking off individual processes it initially forks off N coprocs (for N worker threads) and then pipes data to them. Its usage is much the same as using parallel or xargs -P, though with fewer bells and whistles (it has flags that support changing the number of parallel worker threads and producing output that is ordered the same as the inputs).

Right now it sends 1 input at a time to the worker coprocs, making it equivalent to xargs -l1 -P<N>, an d comared to xargs -l1 -P<N> it is considerably faster (4-5x on my hardware). BUT, xargs -P<N> is still ~2x as fast (but only works on functions like sha256sum that accept many inputs). I could add a user parameter to set how many lines to group together and send to the worker coprocs (much like xargs -L parameter), but would like to, if possible, be able to dynamically choose an optimal value for this on a function-by-function basis.

https://redd.it/10dtkao
@r_bash

Is there a good way to programmatically determine how many inputs some function can support?

WHAT I WANT TO DO

Programs like sha256sum accept a list of inputs and will apply whatever the function does (e.g., compute the sha256sum) to each (non-option) input independently. You can do, for example:

sha256sum file1 file2 file3 ...

or

find ./ -type f | xargs -P<N> sha256sum

Other programs, for example, basename, only support 1 non-option input. you cant use

basename file1 file2 file3 ...

nor

find ./ -type f | xargs -P<N> basename

instead, you have to use

for file in file1 file2 file3 ...; do
basename "$file
done

or

find ./ -type f | xargs -l1 -P<N> basename

Im trying to figure out a good way to determine, for some generic function, which of the above is the case (and in the "multiple inputs" case what the maximum number of inputs is) without requiring any user interaction.

Any good way to do this?

WHY

I put together a shell function for parallelizing loops called forkrun. Instead of forking off individual processes it initially forks off N coprocs (for N worker threads) and then pipes data to them. Its usage is much the same as using parallel or xargs -P, though with fewer bells and whistles (it has flags that support changing the number of parallel worker threads and producing output that is ordered the same as the inputs).

Right now it sends 1 input at a time to the worker coprocs, making it equivalent to xargs -l1 -P<N>, an d comared to xargs -l1 -P<N> it is considerably faster (4-5x on my hardware). BUT, xargs -P<N> is still ~2x as fast (but only works on functions like sha256sum that accept many inputs). I could add a user parameter to set how many lines to group together and send to the worker coprocs (much like xargs -L parameter), but would like to, if possible, be able to dynamically choose an optimal value for this on a function-by-function basis.

https://redd.it/10dtkao
@r_bash

Is there a good way to programmatically determine how many inputs some function can support?

WHAT I WANT TO DO

Programs like sha256sum accept a list of inputs and will apply whatever the function does (e.g., compute the sha256sum) to each (non-option) input independently. You can do, for example:

sha256sum file1 file2 file3 ...

or

find ./ -type f | xargs -P<N> sha256sum

Other programs, for example, basename, only support 1 non-option input. you cant use

basename file1 file2 file3 ...

nor

find ./ -type f | xargs -P<N> basename

instead, you have to use

for file in file1 file2 file3 ...; do
basename "$file
done

or

find ./ -type f | xargs -l1 -P<N> basename

Im trying to figure out a good way to determine, for some generic function, which of the above is the case (and in the "multiple inputs" case what the maximum number of inputs is) without requiring any user interaction.

Any good way to do this?

WHY

I put together a shell function for parallelizing loops called forkrun. Instead of forking off individual processes it initially forks off N coprocs (for N worker threads) and then pipes data to them. Its usage is much the same as using parallel or xargs -P, though with fewer bells and whistles (it has flags that support changing the number of parallel worker threads and producing output that is ordered the same as the inputs).

Right now it sends 1 input at a time to the worker coprocs, making it equivalent to xargs -l1 -P<N>, an d comared to xargs -l1 -P<N> it is considerably faster (4-5x on my hardware). BUT, xargs -P<N> is still ~2x as fast (but only works on functions like sha256sum that accept many inputs). I could add a user parameter to set how many lines to group together and send to the worker coprocs (much like xargs -L parameter), but would like to, if possible, be able to dynamically choose an optimal value for this on a function-by-function basis.

https://redd.it/10dtkao
@r_bash

Is there a good way to programmatically determine how many inputs some function can support?

WHAT I WANT TO DO

Programs like sha256sum accept a list of inputs and will apply whatever the function does (e.g., compute the sha256sum) to each (non-option) input independently. You can do, for example:

sha256sum file1 file2 file3 ...

or

find ./ -type f | xargs -P<N> sha256sum

Other programs, for example, basename, only support 1 non-option input. you cant use

basename file1 file2 file3 ...

nor

find ./ -type f | xargs -P<N> basename

instead, you have to use

for file in file1 file2 file3 ...; do
basename "$file
done

or

find ./ -type f | xargs -l1 -P<N> basename

Im trying to figure out a good way to determine, for some generic function, which of the above is the case (and in the "multiple inputs" case what the maximum number of inputs is) without requiring any user interaction.

Any good way to do this?

WHY

I put together a shell function for parallelizing loops called forkrun. Instead of forking off individual processes it initially forks off N coprocs (for N worker threads) and then pipes data to them. Its usage is much the same as using parallel or xargs -P, though with fewer bells and whistles (it has flags that support changing the number of parallel worker threads and producing output that is ordered the same as the inputs).

Right now it sends 1 input at a time to the worker coprocs, making it equivalent to xargs -l1 -P<N>, an d comared to xargs -l1 -P<N> it is considerably faster (4-5x on my hardware). BUT, xargs -P<N> is still ~2x as fast (but only works on functions like sha256sum that accept many inputs). I could add a user parameter to set how many lines to group together and send to the worker coprocs (much like xargs -L parameter), but would like to, if possible, be able to dynamically choose an optimal value for this on a function-by-function basis.

https://redd.it/10dtkao
@r_bash

Is there a good way to programmatically determine how many inputs some function can support?

WHAT I WANT TO DO

Programs like sha256sum accept a list of inputs and will apply whatever the function does (e.g., compute the sha256sum) to each (non-option) input independently. You can do, for example:

sha256sum file1 file2 file3 ...

or

find ./ -type f | xargs -P<N> sha256sum

Other programs, for example, basename, only support 1 non-option input. you cant use

basename file1 file2 file3 ...

nor

find ./ -type f | xargs -P<N> basename

instead, you have to use

for file in file1 file2 file3 ...; do
basename "$file
done

or

find ./ -type f | xargs -l1 -P<N> basename

Im trying to figure out a good way to determine, for some generic function, which of the above is the case (and in the "multiple inputs" case what the maximum number of inputs is) without requiring any user interaction.

Any good way to do this?

WHY

I put together a shell function for parallelizing loops called forkrun. Instead of forking off individual processes it initially forks off N coprocs (for N worker threads) and then pipes data to them. Its usage is much the same as using parallel or xargs -P, though with fewer bells and whistles (it has flags that support changing the number of parallel worker threads and producing output that is ordered the same as the inputs).

Right now it sends 1 input at a time to the worker coprocs, making it equivalent to xargs -l1 -P<N>, an d comared to xargs -l1 -P<N> it is considerably faster (4-5x on my hardware). BUT, xargs -P<N> is still ~2x as fast (but only works on functions like sha256sum that accept many inputs). I could add a user parameter to set how many lines to group together and send to the worker coprocs (much like xargs -L parameter), but would like to, if possible, be able to dynamically choose an optimal value for this on a function-by-function basis.

https://redd.it/10dtkao
@r_bash

Bash Scripting training/certification

Hi everyone,

Could someone please let me know a possible training or certification that can be done to learn bash shell noscripting better? While a wealth of information is accessible online, I would like a course that can bring me and my team from zero to pros. We don't mind paying for it, but would like it to be recognized by the wider IT community; something like what CompTIA does.

Thanks!

https://redd.it/10dud81
@r_bash

Okay.. At a bit of a loss here. Numbers in variable names?....

This is not valid according to my shell2_4GHzAdapter=wlp35s0But this isGHzAdapter=wlp35s0I have for years used numbers in variable names but my system has decided not to allow it. It was my understanding that underscores and numbers were fine but any other symbols aside numbers, letters, and underscores were not... Or is my memory a lie..?

Solution:

Apparently variables cannot start with a number. Something I have never come accross and something that all the guides on variable names I have read trying to solve this issue failed to mention. I hope this helps someone... this issue has held me up for an hour and I am mad enough to stop for the day... I feel stupid now.

https://redd.it/10e583a
@r_bash

Finding files based on number inside

HW assignment: I have 100 files, all named accordingly from 1 to 100. In each of the files, there's a random number. I need to find 15 files with largest random numbers then write the names of the said files inside some .txt file.

I have tried adding the filename into the file itself upon randomizing the numbers. Something like this:

for x in $(1 100)

do

shuf -i 1-10000 -n 1 -o $x.txt

echo "$x.txt" >> $x.txt

done

That way I could somehow sort all of these random numbers into a separate .txt file without losing the names of the files the numbers initially belonged to. Then I could maybe use head command to find the values I need, but I don't understand the logistics of it. Maybe I don't need to write the filename inside the file itself in the first place? I can't think of any convenient way to do this.

https://redd.it/10e9wjz
@r_bash

Creating a grep pattern that would work like this: <Keyword><any amount of special characters or lowercase leters><any numbers and uppercase letters>

I wanted to create a scipt that can find Invoice number from text. It basically converts PDF to txt and then searches for company name and Invoice number. And I have a problem with invoice number.

&#x200B;

For now I used this to get the invoice number (output.txt is the converted PDF)

&#x200B;

```

\#!/bin/bash

\#some code before

&#x200B;

keyword1="Rechnung"

keyword2="Invoice"

&#x200B;

\# Use grep to search for the pattern in the file and extract only the matched (non-empty) parts of a matching line

output=$(grep -ioE "$keyword1[\^0-9\]*([A-Z\]*[0-9\]+)|$keyword2[\^0-9\]*([A-Z\]*[0-9\]+)" "$path/$fileName/output.txt")

&#x200B;

&#x200B;

\# Use sed to extract the first set of letters and numbers that comes after keyword

result_array=($(echo $output | awk -F '[\^[:alnum:\]\]' '{for (i=1; i<=NF; i++) if ($i \~ /[A-Z\]*[0-9\]+/) print $i}'))

&#x200B;

\#some code after, where it finds the longest elemnt in the array

```

THe $output get the line with keyword, and then $result_array gets only the number

&#x200B;

&#x200B;

And it works if, for example the invoice number itself only has number (91895851851) or if it has letter at the start (RE19515515). But some of the invoices have letter beetween the bumbers, for example AA1111AA11. And if this is the case, rhis noscript will only take AA1111 and leave everything else.

&#x200B;

So I need a pattern that would work like this:

<Keyword><any amount of spaces, special characters or lowercase leters><any numbers and uppercase letters>

And it should return only the invoice number

&#x200B;

It should work on all cases below:

&#x200B;

"invoice nunmber is RE5050AE5050" ==> "RE5050AE5050"

&#x200B;

"invoiceNumber: - . | RE5050AE5050" ==> "RE5050AE5050"

&#x200B;

and so on.

https://redd.it/10e8mh7
@r_bash

Unix/Linux Command Combinations That Every Developer Should Know
https://levelup.gitconnected.com/unix-linux-command-combinations-that-every-developer-should-know-9ae475cf6568?sk=8f264980b4cb013c5536e23387c32275

https://redd.it/10efm3n
@r_bash

vim in a while loop gets remaining lines as a buffer... can anyone help explain?

So I'm trying to edit a bunch of things, one at a time slowly, in a loop. I'm doing this with a while loop (see wooledge's explainer on this `while` loop pattern and ProcessSubstitution). Problem: I'm seeing that vim only opens correctly with a for loop but not with a while loop. Can someone help point out what's happening here with the while loop and how to fix it properly?


Here's exactly what I'm doing, in a simple/reproducible case:

# first line for r/bash folks who might not know about printf overloading
$ while read f; do echo "got '$f'" ;done < <(printf '%s\n' foo bar baz)
got 'foo'
got 'bar'
got 'baz'

# Okay now the case I'm asking for help with:
$ while read f; do vim "$f" ;done < <(printf '%s\n' foo bar baz)

expected: when I run the above, I'm expecting it's equivalent to doing:

# opens vim for each file, waits for vim to exit, then opens vim for the next...
for f in foo bar baz; do vim "$f"; done

actual/problem: strangely I find myself on a blank vim buffer ([No Name]) with two lines bar followed by baz; If I inspect my buffers (to see if I got any reference to foo file, I do see it in the second buffer:

:ls
1 %a + "No Name" line 1
2 "foo" line 0

I'm expecting vim to just have opened with a single buffer: editing foo file. Anyone know why this isn't happening?

### Debugging

So I'm trying to reason about how it is that vim is clearly getting ... rr... more information. Here's what I tried:

note 1: print argument myself, to sanity check what's being passed to my command; see dummy argprinter func:


$ function argprinter() { printf 'arg: "%s"\n' $@; }
$ while read f; do argprinter "$f" ;done < <(printf '%s\n' foo bar baz)
arg: "foo"
arg: "bar"
arg: "baz"


note 2: So the above seems right, but I noticed if I do :ar in vim I only see [foo] as expected. So it's just :ls buffer listing that's a mystery to me.

https://redd.it/10egdhk
@r_bash

What tool is it ?

I changed my computer and re-install everything from scratch a month ago.

But I am missing a command/tool/setting or whatever that I had on the old computer that is related to browsing/scrolling up/down the output in terminal . There was a key bind that makes the cursor jump to the begging of the previous command in the terminal. I am not talking of a simple Page Up, the thing knows exactly how many pages to scroll up on terminal output to the beginning of previous command.

Which is this one ?

I really don't remember if it is something specific to bash (I only use bash) or it is something related to KDE/konsole....

https://redd.it/10egz0w
@r_bash

Name of that utility which generates DAGs from text to SVG?

I've forgotten the name of the utility which generates DAGs from text, can you remember it?


You can give it a mydag.txt like:

a -> b
b -> c

In fact I'm very confident that was the basic syntax.

And then you can call:

cat mydag.txt | program -t noscript -o out.noscript

And a DAG will be drawn in SVG format

I'm pretty sure this image used the same utlity because it matches the default style exactly:


https://en.wikipedia.org/wiki/Directed\_acyclic\_graph#/media/File:Tred-G.noscript

(p.s its not gnuplot as far as I can remember)

https://redd.it/10eraf3
@r_bash

trying to delete some apks and directories that malware placed on my phone keep getting access denied

https://redd.it/10evlv8
@r_bash

Another noscript

Hi everyone. Hope you all are doing well.

I am working on another noscript and I am having an issue. Sharing the noscript below:

#!/bin/bash

###########################
# Created by Diego Castro #
# and Ryan Curran #
###########################

<<'Tip'

Tip: instead of running the noscript like this: ./swaks..., you can do the following

Instead of running the noscript like this: ./swaks..., you can do the following:

1. vi ~/.bashrc
2. Add this line at the bottom: alias swaks='~/./swaks-core-lab1.sh' <- The directory changes depending on the folder you are saving the noscript.
3. Save changes - :x
4. source ~/.bashrc

Tip

# This noscript will just use the server to get the email in the lab for CORE - lab1

server=xx.xx.xxx.xx (can't share the IP)

ehlo="xxx.xxxxx" (another thing I can't share)

at="--attach"

read -p "Recipient: " recipient

read -p "Any attachments Y/n: " name

if [ ${name} == "y" ]
then
read -p "Attachment location Documents | Downloads | etc: " location

if [ ${location} == "Documents" ]
then
read -p "Name of the file: " fileDocument
$docLoc= "cd /mnt/c/Users/$USER/Documents/"
fileDoc=${docLoc}${fileDocument}
swaks -t ${recipient} -s ${server} -h ${ehlo} ${at} ${fileDoc}

elif [ ${location} == "Downloads" ]
then
read -p "Name of the file: " fileDownloads
$downLoc="/mnt/c/Users/$USER/Downloads/"
fileDown=${downLoc}${fileDownloads}
swaks -t ${recipient} -s ${server} -h ${ehlo} ${at} ${fileDown}

else
read -p "Location of the file: " fileDir
read -p "Name of the file: " fileName
otherLoc="/mnt/c/Users/$USER/"
slash="/"
fileElse="${otherLoc}${fileDir}${slash}${fileName}"
swaks -t ${recipient} -s ${server} -h ${ehlo} ${at} ${fileElse}
fi

elif [ ${name} == "n" ]
then
swaks -t ${recipient} -s ${server} -h ${ehlo}

else
echo "Error. Closing the program now."
exit 1
fi


The issue I am having now is when getting an attachment for the noscript, just for the options Downloads and Documents, the noscript gives an error on this line ${downLoc}${fileDownloads} for the Downloads options and, this one fileDoc=${docLoc}${fileDocument} for the Documents option. The only one that works is the first else which you can choose the directory. Any idea guys?

&#x200B;

Thank you so much for your collaboration and effort.

https://redd.it/10f36rr
@r_bash

CTRL-R not working?? :x

I got a new system set up and have a really weird behaviour.

- Ubuntu 22.04.1 LTS
- Bash: 5.1.16

When I hit CTRL-R I get:

bash: bash_execute_unix_command: cannot find keymap

okay.. So I guess I need a mapping for this (I thought default) hotkey.

I ran

bind -x '"\C-r": "reverse-search-history"'

After hitting ctrl-r I get:

reverse-search-history: command not found


I would be really happy about any advice or ideas!

https://redd.it/10f5n9w
@r_bash

Dynamically exclude dirs in the find command

Hi, I have made a small noscript so that given a list of directories it executes find excluding these, the corpus of the noscript is this:


EXCLUDIRS=(dira dirb 'hello word');

if [ ${#EXCLUDIRS[@} -gt 0 ]]; then
declare -a INDXS=("${!EXCLUDIRS@}");
declare -i LASTINDX="${INDXS*: -1}";

for I in "${INDXS@}"; do
EXCLUDIRSTR+="-path ./${EXCLUDIRS$I} -prune";
((I != LASTINDX)) && EXCLUDIRSTR+=' -o ';
done

EXCLUDIRSTR="( $EXCLUDIRSTR ) -o -print";
fi

# shellcheck disable=SC2086
find . $EXCLUDIRSTR;

As you can infer, EXCLUDIRSTR ends up becoming a string of the type:

'(' -path ./dira -prune -path ./dirb -prune -path ./hello word -prune ')'

This works as expected, as long as EXCLUDIRS does not have names with spaces, in this case "hello world" will flag the problem since that space could not be escaped. I have tried several ways, does anyone know what is the correct way for this?

https://redd.it/10fc6af
@r_bash