Using a bash noscript to streamline GitHub Actions

Using a bash noscript (based on bashew framework) to centralize the GitHub Action setup (e.g. pip install), Action payload and Action wrap-up (commit/push the results) in one place, so that the Action config YML becomes this simple:

- name: gha:before
run: |
./bashewgithubaction.sh gha:before
- name: gha:execute
run: |
./bashewgithubaction.sh gha:execute
- name: gha:after
run: |-
./bashewgithubaction.sh gha:after

Advantages:

Single Responsibility. You edit your setup code in the same file as the payload or the wrap-up code. You don’t touch the `action.yml` file anymore after initial setup.
Cleaner Code. The YML syntax forces you to a do this && do that && do the other
one-liner format. A bash noscript allows you to do if/then, for/do, while/do, recursion … in an easy and clean way.
Easy Debugging. `bashew` has built-in support for log files and optional verbose mode. It also cleans up log files after 30 days, so they don’t clog up your repo.
Self-Contained. You don’t need external libraries or runtimes. bash runs on most Action Runners (Linux/MacOS) and each bashew noscript contains the entire framework.

More details on blog.forret.com

https://redd.it/y5t8me
@r_bash

Linux/Ubuntu Commands To Speed Up Your Daily Work
https://levelup.gitconnected.com/linux-ubuntu-commands-to-speed-up-your-daily-work-32f0d2517e8b?sk=5fb5bb58871e03926a6e089ac8fefc27

https://redd.it/y60r0l
@r_bash

inline noscript runs as expected, however not when read from file

I am at a loss here. I write my code inline and it just works. Then I transfer the code into a .sh file and it no longer does.

I am in a directory /foo/bar and there is a subdirectory present named cfg

while true; do { if -d ./cfg ; then cd ./cfg/; break; fi; } done

Running this, it changes into the director cfg as expected. However after transferring it to a file:

1 #!/bin/bash
2
3 while true; do
4 {
5 if -d ./cfg ; then
6 cd ./cfg/; else
7 break;
8 fi;
9 }
10 done

it does nothing, outputs no errors and merely rests in the directory /foo/bar.

Any tips would be appreciated


Edit: Obviously it works fine while being run in the same shell with source noscript.sh . However I am looking for a way that it executes without the source command.

https://redd.it/y64byl
@r_bash

Suggest courses for learning bash

Hi , im very new to using bash. I know basic commands in terminal such as ls , cd , mkdir , vi editor , chmod .
I was to be able to use if conditions and awk ,sed and regular expression more flexibly since that would make my work alot more easier . Can anyone suggest a site to learn them ?

https://redd.it/y66ij2
@r_bash

Curl sse streaming output in a do loop input

I am trying to figure out how to use Curl output in a loop.

while IFS= read -r linestream
do
//Some logic
done < $(curl https://some.url)

The source URL is a Server Side Event, which constantly streams data. The problem is that Curl is outputting the progress bar. How do I feed the standard output to the loop instead of the apparently standard error?

&#x200B;

Edit: Typo in the tile while instead of do

https://redd.it/y6a8sx
@r_bash

Add trailing slashes to all arguments for rsync

Hi,

I’m using the following function to rsync a ton of media from one location to another:

nsync () {

sdir=“${1%/}/”
ddir=“${2%/}/”
command rsync -avvhP --remove-source-files “$sdir” “$ddir”

}

I’m trying to change this so that I can add multiple source directories and adding a trailing slash to them all (technically it wouldn’t matter whether the destination dir has a slash), but I’m not sure how to set this up to handle an unknown amount of source directories, most likely between 2 and 6, but really not sure. I’m assuming I’d need to loop through all the arguments, which I can do, but I’m not sure how I could get a variable for each one, name it, and have it included in the rsync command.

Any help would be appreciated.

Thank you!

https://redd.it/y6mhzi
@r_bash

Automating ssh using a file with IP addresses

I am trying to automate sending commands to machines in a local cluster. I have the IPs saved in a file and I am using this noscript to simply make a file on the Desktop. See below:

#!bin/bash
input="/home/user/Desktop/deploy/IPs.txt"
while read -r line
do
echo "connecting to $line"
sshpass -pPASSWORD ssh remoteUser@$line mkdir ~/Desktop/folder || echo "error occured on IP:$line"
echo "$line setup!"
done < "$input"

This however, only works for the first IP listed in the file and then quits before doing the same thing for all the other IPs. Why does this happen and how can I fix it?

https://redd.it/y6nah9
@r_bash

Newbie question

https://redd.it/y6qnas
@r_bash

help: delete largest duplicate file

Hi everyone, I'm struggling with a little bash noscript this morning and while I often like to experiment and find it myself, I'm stuck.

I have a directory that contains about 1k video files. Each file is duplicated and have different encodings and frame sizes. Since it's for archival I only want to keep the smallest file for each video.

Both duplicates of a file have the same name until the last 16 characters which are a random string of characters/timestamp. And the extensions are inconsistent.

I can list all files, ordered by name which places the duplicates next to each other, but then how do i find the one with the largest filesize and delete that one?
Also i can't just go though the list 2 by 2 because not 100% of the files have a duplicate. But I can't think of another way to traverse the file list with my current skillset.

I'm a beginner at bash, have only written 4-5 complex noscripts and that was while constantly looking at basic documentation just to get a ''if statement'' syntax right. So any help would be greatly appreciated.

https://redd.it/y70r7j
@r_bash

Bash help

I need urgent help with bash for an upcoming assessment. I usually wouldn't ask help but I've no clue how bash works. If anyone can help please dm

https://redd.it/y753m9
@r_bash

Problem with handling with datetimes in Bash

I'm quite new to bash noscripting, and test in general. I'm writing a noscript to automatically update Docker images, when I get this error:

/home/misery/update-images.sh: line 31: [[: 2022-10-07T02: value too great for base (error token is "07T02")

Before I call test, I logged the timestamp I extract from the Docker API:

Remote image created on 2022-10-07T02:22:37
                        ^^^^^^^^^^^^^^^^^^^
                        In a variable called 'remoteImage'

For debugging purposes, I tried echoing localImage too:

"2022-10-07T02:22:37

Yet why am I getting an error in line 31?

Here's the code where I do an if

if [[ "$remoteImage" -eq "${localImage:1}" ]]; then
 echo $image is outdated!
else
 echo $image is up-to-date
fi

https://redd.it/y78wln
@r_bash

What is this local and where I can learn more

Is this maybe obsolete?




pause(){

local message="$@"

[ -z $message ] && message="Press Enter key to continue..."


read -p "$message" readEnterKey
}

https://redd.it/y7afy6
@r_bash

Newbie question, How do I convert a string to numeric

For example.

$username =?

Im trying to give each user a UID that matches to the numaric value of its name.

Any help will be appricated

https://redd.it/y7e7uo
@r_bash

Help: I need the equivalent bash line of this PowerShell noscript

dir -exclude old_a | %{git mv $_.Name old_a}

from https://stackoverflow.com/a/14470212

https://redd.it/y7hahk
@r_bash

Error during a noscript, but running fine when doing it manually.

In my noscript I have a line which goes

read -s password

When I execute the noscript it gives me an error "read: illegal option -s"

But when I type it manually into the terminal it works fine. I tried running the noscript as sudo didn't solve it.
Any help would be appricated.

https://redd.it/y7kabe
@r_bash

Check if a string match given name together with a arimetic expression in one line.

I have this Script which compares numbers.
to see if they are between or equal to a set of Numbers.

And in the end of the noscript i would also like to
add variable b to compare to see if variable b
is equal to the "hello" string

/tmp/numbers.txt

9 #c

2 #d

19 #body

2022-10-18 23:17 #time1

Hello #hello string which i want to compare if it exists.

exec 4</tmp/numbers.txt
IFS= read -ru4 body #body
IFS= read -ru4 c
IFS= read -ru4 d
IFS= read -ru4 time1
IFS= read -ru4 b
exec 4<&-

if (( c >= 7 && c<= 10 && d >= 0 && d <= 3 && body >= 18 && body <= 20 && b == "Hello")); then
echo "Hello parameter exists"
fi


I know that if you want to compare strings you have to use the []

But what if i want for conveince to compare it inside the (()) expression.

https://redd.it/y7jgsu
@r_bash

Help to nodify bash noscript

\#!/bin/bash

riclist=(

''

)

\#Message depends on riclist ID

declare -A rcmsg

rcmsg[\]=''

\# Raw log filename

RAWSTAMP="$(date '+%Y_%m_%d')"

RAWLOG="raw_$RAWSTAMP.log"

while IFS='' read -r line; do

\# check for all strings in $riclist

# Raw logging

echo "\\date '+%Y-%m-%d %T'` $line" >> $RAWLOG`

double_filter="$double_filter"

double_filter2="$double_filter2"

double_filter3="$double_filter3"

double_filter4="$double_filter4"

count=0

while [ "${riclist[count\]}" != "" \]; do

if [ "${line/${riclist[count]}}" != "$line" ] ; then # if $line minus first apperence of $riclist is diffrent from $line

if [ "${line##*Alpha: }" != "$double_filter4" ] ; then double_filter4="$double_filter3"

if [ "${line##*Alpha: }" != "$double_filter3" ] ; then double_filter3="$double_filter2"

if [ "${line##*Alpha: }" != "$double_filter2" ] ; then double_filter2="$double_filter"

if [ "${line##*Alpha: }" != "$double_filter" ] ; then

&#x200B;

TIMESTAMP="$(date '+%Y-%m-%d %T')"

TIMESTAMP2="$(date '+%Y-%m-%d %T')"

id=${riclist[count\]}

RAW="${line##*Alpha: }"

RAW2="${line##*Alpha: }"

NOTNUL="$( echo "$RAW" | sed --regexp-extended 's/<(CR|NUL)>//g; s/<(LF|SYN)>/\\ /g' )"

NOTNUL2="$( echo "$RAW2" | sed --regexp-extended 's/<(CR|NUL)>//g; s/<(LF|SYN)>/\\ /g' )"

ADDBOT="$NOTNUL - ${rcmsg[$id\]}"

ADDBOT2="$NOTNUL2 - ${rcmsg[$id\]}"

echo "$TIMESTAMP2 $ADDBOT2" | mail -s "$TIMESTAMP $ADDBOT" mail@mail

&#x200B;

printf -v filename "rtj_\\date +%Y_%m_%d`.log"`

echo "\\date '+%Y-%m-%d %T'` ${line##*Alpha: }" >> $filename`

double_filter="${line##*Alpha: }"

fi

fi

fi

fi

fi

count=$(( $count + 1 ))

done

done

The best solution to not send an email if ${line##*Alpha: } contain specific words in this noscript. How would you do it?

https://redd.it/y7t4qb
@r_bash

remove the character before a specific string or append contents of a file to another file without adding a newline character after?

im trying to write a noscript to auto update an avahi service whenever a program on another pc changes the port it is listening on and restart the daemon - and i'm almost there. i have gotten batch files monitoring and updating a file with the current ports on the windows pc, i network shared the file with the ports

#!/bin.sh
echo "<?xml version=\\"1.0\\" standalone=\\'no\\'?><!--\*-nxml-\*-->\n<!DOCTYPE service-group SYSTEM \\"avahi-service.dtd\\">" > /etc/avahi/services/oculus.service
echo -n "<service-group>\n<name replace-wildcards=\"yes\">oculus</name>\n<service>\n<service protocol=\"ipv4\">\n<type>_oculusal_sp._tcp</type>\n<port>" >> /etc/avahi/services/oculus.service
tail --lines 1 /mnt/win_share/port.txt | cut -d\n -f1 >> /etc/avahi/services/oculus.service
echo -n "</port>\n<host-name>vr-pc.local</host-name>\n</service>\n</service-group>\n" >> /etc/avahi/services/oculus.service
service avahi-daemon restart

outputs the following

<?xml version="1.0" standalone=\\'no\\'?><!--\*-nxml-\*-->
<!DOCTYPE service-group SYSTEM "avahi-service.dtd">
<service-group>
<name replace-wildcards="yes">oculus</name>
<service>
<service protocol="ipv4">
<type>_oculusal_sp._tcp</type>
<port>56199
</port>
<host-name>vr-pc.local</host-name>
</service>
</service-group>

i need it to say <port>56199</port>

instead of

<port>56199

</port>


&#x200B;

ive tried a bunch of different ways to do it and i just cant figure it out. someone help?

https://redd.it/y7uq18
@r_bash

Send signal to itself

My noscript:

trap "rm -rf '$CACHE'; exit 1" 15
my_program || kill -15 "$$"

Does this work? I want to exit my noscript if my program fails, but also delete the temp directory before the noscript exits.

Also I am talking about posix dash noscripting and not bash noscripting.

Thank you

https://redd.it/y7xqc4
@r_bash