r_bash – Telegram
How can I get a clean output from echo, without hidden characters?

Hi there,
I am working with lua and bash, and trying to set a variable in lua from a bash command, but this is not working. When I set the variable manually works, so my guess is that there are hidden characters (maybe encoding characters).


This is my line:

local vim.g.kubernetes_cluster = vim.fn.system('echo -n "$(kubectl config current-context 2>/dev/null)"')

So the command bash would be


echo -n "$(kubectl config current-context 2>/dev/null)"

Any advice is welcome! Thanks!

https://redd.it/17r7a91
@r_bash
How to find the youngest file in dir1 and then find all files younger than that in dir2, recursively?

Like the noscript says. I am hard-pressed to add more details without also adding confusion.

If the youngest file in dir1 and all its subdirs is from Nov 1 00:00:00, I want to find all files in dir2 (and all its subdirs) which are younger than that.

Is there a quick oneliner which could solve this?

Solutions for finding the youngest file are available. To use the modification date of this file for another search seems to be a lot more tricky, though.

https://redd.it/17rarw1
@r_bash
Grep/Sed from hit until 2nd newline

Hello,

Im fairly new to linux and bash/noscripting in general. Now i need to search through a large text file, and i want to filter out relevant information. So far i've been using: grep with the -A and -B flags, both taking a number and then including the lines Before and After the hit with grep. Now i have the following challenge:


I want to search the text file, and i want to include a few set amount of lines before the hit (-A flag) but i want to include a varying amount of lines after the hit, namely everything until the 2nd newline. How do i go about this?

Example:
Text.txt is the following:
Apple
Banana
Error
Delta

Echo

Romeo
More stuff
BlaBla

=====================

​

I want to execute the command, something like grep -B 1 'Error' ??SomeMoreFlags/Hacks here??

And in return i expect:
Banana
Error
Delta

Echo

​

Is anyone able to help me? I've heard people mention sed/cat/grep/regex matching and i feel this should be possible, but im having trouble finding the solution.

​

​

https://redd.it/17rihm0
@r_bash
wc, piping & stdout

Upon learning the wc command, I've seen a couple of ways to extract data based on the option(s) passed in. Is there anyway to get result of the second example with how the command is written in the first? I'm confused why the second example just prints the number for words without the filename.

~/project$ wc -w kittyipsum1.txt
332 kittyipsum1.txt

VS.

~/project$ cat kittyipsum1.txt | wc -w
332

​

https://redd.it/17rmcyl
@r_bash
JQ merge changes from one json to another

I have two JSON files

Source

{
"version": 122,
"GeneralData":
{
"disableBaseDamage": false,
"disableContainerDamage": false,
"disableRespawnDialog": false,
"disableRespawnInUnconsciousness": false
},
"PlayerData":
{
"disablePersonalLight": false,
"StaminaData":
{
"sprintStaminaModifierErc": 1.0,
"sprintStaminaModifierCro": 1.0,
"staminaWeightLimitThreshold": 6000.0,
"staminaMax": 100.0,
"staminaKgToStaminaPercentPenalty": 1.75,
"staminaMinCap": 5.0,
"sprintSwimmingStaminaModifier": 1.0,
"sprintLadderStaminaModifier": 1.0,
"meleeStaminaModifier": 1.0,
"obstacleTraversalStaminaModifier": 1.0,
"holdBreathStaminaModifier": 1.0
},
"ShockHandlingData":
{
"shockRefillSpeedConscious": 5.0,
"shockRefillSpeedUnconscious": 1.0,
"allowRefillSpeedModifier": true
},
"MovementData":
{
"timeToStrafeJog": 0.1,
"rotationSpeedJog": 0.3,
"timeToSprint": 0.45,
"timeToStrafeSprint": 0.3,
"rotationSpeedSprint": 0.15,
"allowStaminaAffectInertia": true
},
"DrowningData":
{
"staminaDepletionSpeed": 10.0,
"healthDepletionSpeed": 10.0,
"shockDepletionSpeed": 10.0
}
},
"WorldsData":
{
"lightingConfig": 1,
"objectSpawnersArr": ,
"environmentMinTemps": -3.0, -2.0, 0.0, 4.0, 9.0, 14.0, 18.0, 17.0, 12.0, 7.0, 4.0, 0.0,
"environmentMaxTemps": 3.0, 5.0, 7.0, 14.0, 19.0, 24.0, 26.0, 25.0, 21.0, 16.0, 10.0, 5.0,
"wetnessWeightModifiers": 1.0, 1.0, 1.33, 1.66, 2.0
},
"BaseBuildingData":
{
"HologramData":
{
"disableIsCollidingBBoxCheck": false,
"disableIsCollidingPlayerCheck": false,
"disableIsClippingRoofCheck": false,
"disableIsBaseViableCheck": false,
"disableIsCollidingGPlotCheck": false,
"disableIsCollidingAngleCheck": false,
"disableIsPlacementPermittedCheck": false,
"disableHeightPlacementCheck": false,
"disableIsUnderwaterCheck": false,
"disableIsInTerrainCheck": false,
"disallowedTypesInUnderground": "FenceKit","TerritoryFlagKit","WatchtowerKit"
},
"ConstructionData":
{
"disablePerformRoofCheck": false,
"disableIsCollidingCheck": false,
"disableDistanceCheck": false
}
},
"UIData":
{
"use3DMap": false,
"HitIndicationData":
{
"hitDirectionOverrideEnabled": false,
"hitDirectionBehaviour": 1,
"hitDirectionStyle": 0,
"hitDirectionIndicatorColorStr": "0xffbb0a1e",
"hitDirectionMaxDuration": 2.0,
"hitDirectionBreakPointRelative": 0.2,
"hitDirectionScatter": 10.0,
"hitIndicationPostProcessEnabled": true
}
},
"MapData":
{
"ignoreMapOwnership": false,
"ignoreNavItemsOwnership": false,
"displayPlayerPosition": false,
"displayNavInfo": true
}
}

and changes

{
"version": 122,
"GeneralData":
{
"disableBaseDamage": false,
"disableContainerDamage": false,
"disableRespawnDialog": false,
"disableRespawnInUnconsciousness": false
},
"PlayerData":
{
"disablePersonalLight": false,
"StaminaData":
{
"sprintStaminaModifierErc": 1.0,
"sprintStaminaModifierCro": 1.0,
"staminaWeightLimitThreshold": 6000.0,
"staminaMax": 100.0,
"staminaKgToStaminaPercentPenalty": 1.75,
"staminaMinCap": 5.0,
"sprintSwimmingStaminaModifier": 1.0,
"sprintLadderStaminaModifier": 1.0,
"meleeStaminaModifier": 1.0,
"obstacleTraversalStaminaModifier": 1.0,
"holdBreathStaminaModifier": 1.0
},
"ShockHandlingData":
{
"shockRefillSpeedConscious": 5.0,
"shockRefillSpeedUnconscious": 1.0,
"allowRefillSpeedModifier": true
},
"MovementData":
{
"timeToStrafeJog": 0.1,
"rotationSpeedJog": 0.3,
"timeToSprint": 0.45,
"timeToStrafeSprint": 0.3,
"rotationSpeedSprint": 0.15,
"allowStaminaAffectInertia": true
},
"DrowningData":
{
"staminaDepletionSpeed": 10.0,
"healthDepletionSpeed": 10.0,
"shockDepletionSpeed": 10.0
}
},
"WorldsData":
{
"lightingConfig": 1,
"objectSpawnersArr": ,
"environmentMinTemps": -3.0, -2.0, 0.0, 4.0, 9.0, 14.0, 18.0, 17.0, 12.0, 7.0, 4.0, 0.0,
"environmentMaxTemps": 3.0, 5.0, 7.0, 14.0, 19.0, 24.0, 26.0, 25.0, 21.0, 16.0, 10.0, 5.0,
"wetnessWeightModifiers": 1.0, 1.0, 1.33, 1.66, 2.0
},
"BaseBuildingData":
{
"HologramData":
{
"disableIsCollidingBBoxCheck": true,
"disableIsCollidingPlayerCheck": true,
"disableIsClippingRoofCheck": true,
"disableIsBaseViableCheck": true,
"disableIsCollidingGPlotCheck": true,
"disableIsCollidingAngleCheck": true,
"disableIsPlacementPermittedCheck": true,
"disableHeightPlacementCheck": true,
"disableIsUnderwaterCheck": true,
"disableIsInTerrainCheck": true,
"disallowedTypesInUnderground": "FenceKit","TerritoryFlagKit","WatchtowerKit"
},
"ConstructionData":
{
"disablePerformRoofCheck": true,
"disableIsCollidingCheck": true,
"disableDistanceCheck": true
}
},
"UIData":
{
"use3DMap": false,
"HitIndicationData":
{
"hitDirectionOverrideEnabled": false,
"hitDirectionBehaviour": 1,
"hitDirectionStyle": 0,
"hitDirectionIndicatorColorStr": "0xffbb0a1e",
"hitDirectionMaxDuration": 2.0,
"hitDirectionBreakPointRelative": 0.2,
"hitDirectionScatter": 10.0,
"hitIndicationPostProcessEnabled": true
}
},
"MapData":
{
"ignoreMapOwnership": true,
"ignoreNavItemsOwnership": true,
"displayPlayerPosition": true,
"displayNavInfo": true
}
}


If I run

jq -c --slurpfile f2 cfggameplaychanges.json '. + $f2[0]' cfggameplaysource.json

I get

{
"version": 122,
"GeneralData": {
"disableBaseDamage": false,
"disableContainerDamage": false,
"disableRespawnDialog": false,
"disableRespawnInUnconsciousness": false
},
"PlayerData": {
"disablePersonalLight": false,
"StaminaData": {
"sprintStaminaModifierErc": 1,
"sprintStaminaModifierCro": 1,
"staminaWeightLimitThreshold": 6000,
"staminaMax": 100,
"staminaKgToStaminaPercentPenalty": 1.75,
"staminaMinCap": 5,
"sprintSwimmingStaminaModifier": 1,
"sprintLadderStaminaModifier": 1,
"meleeStaminaModifier": 1,
"obstacleTraversalStaminaModifier": 1,
"holdBreathStaminaModifier": 1
},
"ShockHandlingData": {
"shockRefillSpeedConscious": 5,
"shockRefillSpeedUnconscious": 1,
"allowRefillSpeedModifier": true
},
"MovementData": {
"timeToStrafeJog": 0.1,
"rotationSpeedJog": 0.3,
"timeToSprint": 0.45,
"timeToStrafeSprint": 0.3,
"rotationSpeedSprint": 0.15,
"allowStaminaAffectInertia": true
},
"DrowningData": {
"staminaDepletionSpeed": 10,
"healthDepletionSpeed": 10,
"shockDepletionSpeed": 10
}
},
"WorldsData": {
"lightingConfig": 1,
"objectSpawnersArr": ,
"environmentMinTemps":
-3,
-2,
0,
4,
9,
14,
18,
17,
12,
7,
4,
0
,
"environmentMaxTemps":
3,
5,
7,
14,
19,
24,
26,
25,
21,
16,
10,
5
,
"wetnessWeightModifiers":
1,
1,
1.33,
1.66,
2

},
"BaseBuildingData": {
"HologramData": {
"disableIsCollidingBBoxCheck": true,
"disableIsCollidingPlayerCheck": true,
"disableIsClippingRoofCheck": true,
"disableIsBaseViableCheck": true,
"disableIsCollidingGPlotCheck": true,
"disableIsCollidingAngleCheck": true,
"disableIsPlacementPermittedCheck": true,
"disableHeightPlacementCheck": true,
"disableIsUnderwaterCheck": true,
"disableIsInTerrainCheck": true,
"disallowedTypesInUnderground":
"FenceKit",
"TerritoryFlagKit",
"WatchtowerKit"

},
"ConstructionData": {
"disablePerformRoofCheck": true,
"disableIsCollidingCheck": true,
"disableDistanceCheck": true
}
},
"UIData": {
"use3DMap": false,
"HitIndicationData": {
"hitDirectionOverrideEnabled": false,
"hitDirectionBehaviour": 1,
"hitDirectionStyle": 0,
"hitDirectionIndicatorColorStr": "0xffbb0a1e",
"hitDirectionMaxDuration": 2,
"hitDirectionBreakPointRelative": 0.2,
"hitDirectionScatter": 10,
"hitIndicationPostProcessEnabled": true
}
},
"MapData": {
"ignoreMapOwnership": true,
"ignoreNavItemsOwnership": true,
"displayPlayerPosition": true,
"displayNavInfo": true
}
}


Which is sooooo close to what I need. How do I turn these

"wetnessWeightModifiers":
1,
1,
1.33,
1.66,
2


into this

"wetnessWeightModifiers": 1,1,1.33,1.66,2

and preferably keep the decimals from the original "1.0,1.0,1.33,1.66,2.0" thank you so much for your assistance in advance.

https://redd.it/17rpl3z
@r_bash
Issue making JSON string

So I need to make a pure JSON string using a variable, and I'm bashing (no pun intended) my head against the wall trying to get the result I want:

The desired result looks like this:

'{"app":"app-version.tar","db":"db-version.tar"}'

The variable I have would contain the version info (so like, $VERSION), and I CANNOT get a proper JSON out of something like

'{"app":"app-'$VERSION'.tar","db":"db-'$VERSION'.tar"}'

Anyone able to help?


Edit: I also need to echo the EXACT string being generated at some earlier point as well, for making sure everything is correct.

https://redd.it/17rpjsh
@r_bash
Back to being a little confused about quoting

Could some kind soul take look here and maybe improve it to be "good". In particular, why doesn't it work if I double quote the use of ${OPTS} ? I'm probably mixing up differnt bash styles as this was made from cut and paste of answers on SO for each bit.

​

>\#!/usr/bin/env bash
>
>\# Maintained in linux-config.org
>
>LOGFILE="${HOME}/rclone-bisync-$(date +"%Y_%m_%d_%I_%M_%p").log"
>
>OPTS="--log-file=${LOGFILE} --log-level INFO --checkers=16 --drive-pacer-min-sleep=10ms --resilient --links --ignore-listing-checksum --check-sync=false --tpslimit=10 --drive-chunk-size=256M --drive-use-trash=false --fast-list ${HOME}/cloud cloud:"
>
>if pgrep -x "rclone" > /dev/null
>
>then
>
>echo "rclone already running. Bye." >> "$LOGFILE"
>
>exit 0
>
>fi
>
>mv rclone-bisync*.log "$HOME/tmp" 2>/dev/null
>
>rclone bisync ${OPTS}
>
>retVal=$?
>
>if [ $retVal -ne 0 \]; then
>
>echo "Error (${retVal}) last bisync. Doing a resync." >> "$LOGFILE"
>
>rclone bisync --resync ${OPTS}
>
>else
>
>echo "rclone bisync finished without error." >> "$LOGFILE"
>
>fi

​

https://redd.it/17rzabs
@r_bash
Syntax error due to wrong parsing

Is there a way to fix the syntax in the *SEARCH\_STRING* to avoid the error ?

Script:

*SEARCH\_STRING="search sourcetype="datasource" "denied" earliest=-60m | rex field=\_raw* ***"from (?<from>.\*)"*** *|table from |stats count by from |sort -count"*

*curl -H "Authorization: Bearer $TOKEN" -X POST https://$SPLUNK\_HOST:8089/services/search/jobs -d search="$SEARCH\_STRING";*

&#x200B;

Output:

*$ ./splunk\_search.bash*

*./splunk\_search.bash: line 9: syntax error near unexpected token \`('*

*./splunk\_search.bash: line 9: \`SEARCH\_STRING="search sourcetype="datasource" "denied" earliest=-60m | rex field=\_raw "from (?<from>.\*)" |table from |stats count by from |sort -count"'*

https://redd.it/17s0yjf
@r_bash
remove "" char from filenames

Hi,

this might seem like a dumb question but I can't find a way to do this.

I have a folder with a bunch of files, some of them contain asterisks in their names (\
). Is there a way to remove them ? (maybe with mv)

https://redd.it/17s2w0n
@r_bash
Is there a way to save executed keyboard shortcuts from the cli to a file or to stdout?

Sometimes I'd be exploring the different keybinding I have and I accidentally pressed a combination (like Alt + U or I'd change from emacs to vim or whatever) but I wouldn't know what I'd press because I'm just messing around or I pressed this keyboard shortcut by accident.

Is there a way to output to stdout or save to a file that, for example, says I pressed alt + u and give a short denoscription that mentions I changed the text to upper case or I pressed ctrl + y and that yanks the line.

I accidentally fat finger my keyboard shortcuts all the time and I can't figure out what I just pressed. It would help me debug my keyboard shortcut and learn what I actually pressed.

https://redd.it/17sagaf
@r_bash
A few common shell functions (cat, mktemp, wc -c, and sleep) re-implemented in pure bash

I re-implemented a few common shell functions (that dont bash builtins with equivalent functionality) in pure bash. Anyone else do this? Anyone have any to add?

My use case for these tends to be to use them as "backups" when I want a code to be able to run on an embedded machine that has bash but everything else is not guaranteed. i.e.,

type -p FUNC >&/dev/null || {
FUNC() {
...
}
}

Here are the re-implemented functions. Each has a quick test along with it to ensure it is working. The functionality is not always an exact match to the original (not all flags are implemented...just the core functionality). But, for what is implemented it should (I think) be a drop-in replacement.

mktemp() {
local tmpFile

# generate tempfile name, and repeat until we get one that doesnt exist.
tmpFile=/tmp/.tmp.${RANDOM}
while [ -f "$tmpFile" ]; do
tmpFile=/tmp/.tmp.${RANDOM}
done

# touch tmpfile then echo its path
touch "${tmpFile}"
echo "${tmpFile}"
}

# test mktemp
file="$(mktemp)"
[ -f "${file}" ] && echo "tmpfile exists" >&2
echo


cat() {
if [ -t 0 ] && [ $# == 0 ]; then
# no input
return
elif [ $# == 0 ]; then
# only stdin
printf '%s\n' "$(</proc/self/fd/0)"
elif [ -t 0 ]; then
# only function inputs
source <(printf 'echo '; printf '"$(<"%s")" ' "$@"; printf '\n')
else
# both stdin and function inputs. fork printing stdin.
{ printf '%s\n' "$(</proc/self/fd/0)" >&9 & } 9>&1
source <(printf 'echo '; printf '"$(<"%s")" ' "$@"; printf '\n')
fi
}

# test cat
printf '%s\n' hi bye > "${file}"
printf '%s\n' hola adios | cat "${file}"
echo


wc() {
# only char/byte count (-c flag) implemented

# check for no input case
[ -t 0 ] && [ $# == 0 ] && return

# make tmpfile
local tmpFile fd waitFlag
tmpFile="$(mktemp)"

(
waitFlag=false

# add stdin, if anything is there
[ -t 0 ] || {
if [ $# == 0 ]; then
cat >&${fd}
else
# if we also are adding files then fork adding stdin
waitFlag=true
{ cat <&9 >&${fd} & } 9<&0
fi
}

# add function inputs that are files
for nn in "$@"; do
[ -f "$nn" ] && echo "$(<"${nn}")" >&${fd}
done

# wait for forked cat of stdin (if needed)
${waitFlag} && wait

# get the current position of fd
read </proc/self/fdinfo/${fd}
echo "${REPLY##$'\t'}"

) {fd}>>"${tmpFile}"

# remove tmpfile
[[ -f "${tmpFile}" ]] && \rm -f "${tmpFile}"

}

# test wc
printf '%s\n' hola adios | wc "${file}"
echo

sleep() {
local dur
# get sleep duration. default to 1 if missing.invalid
[[ "$1" =~ ^[0-9]
\.?0-9+$ ]] && dur="$1" || dur=1
(
# read from empty anonymous pipe with timeout
read -u ${fd} -t "$dur"
) {fd}<><(:)
}

# test sleep
echo "hi - ${EPOCHREALTIME}"
sleep 2
echo "bye - ${EPOCHREALTIME}"
echo

https://redd.it/17scg3v
@r_bash
Deferring process substitution

So here is a very basic example of process substitution:

bash --init-file <(echo "echo 4")

This will result in the number 4 being printed at the onset of a new bash session. However, in the following case, the number is not printed:

docker exec -it ubuntu_container bash --init-file <(echo "echo 4")

For anyone unfamiliar, this command connects to an existing docker container named 'ubuntu_container' and executes the bash command. Although this successfully results in starting a bash session within the container, the number 4 is not printed.

My best guess is that the process substitution executes immediately, resulting in a filepath that is valid outside the container, but invalid within the container. Thus it cannot be used when starting a bash session inside the container.

Does anyone know of a way to get this second example to work? My topic noscript refers to 'deferring' the process substitution because if I could defer it until after entering the docker container, I believe everything would work.

Thank you.

&#x200B;

(EDIT: For anyone curious, what I'm actually trying to do is to launch bash inside a docker container with a custom prompt by setting the PS1 environmental variable.)

https://redd.it/17smxs8
@r_bash
Help with basic folder perms (beginner)

Hey !
Im kinda new to bash, and im having a pretty basic problem here.
I have a minecraft server that restart, calling start.sh on restart.


When my ssh user do a bash start.sh, it works fine.
However, when the server execute it itself, the first instructions dont execute.
I'm pretty certain its a permission problem, but i cant figure why, because it should be accessible by everyone (first pic), and somehow, when the server restarts, the perms change (second pic)
Here is the bash i execute.



rm -r ./world
sleep 3

unzip -o lobby.zip -d world

sleep 3
java -Xmx3G -jar paper.jar #This get executed anyway


(sorry if there is code blocs, i dont know how)

&#x200B;

When user execute bash noscript

After restart

https://redd.it/17spxh4
@r_bash
PS1

I have recently started to use oh my bash and now I want to change the color of my PS1 (custome prompt) how should I do it.

I do not seem to have anything regarding PS1 in my .bashrc .

Please help

https://redd.it/17sqrm5
@r_bash
Glassfish/payara domain restart project, any improvements you would say?

function domain_action() {

    case $1 in

    1)

        echo "instruction received to start domain $2"

        /home/techyman/glassfish4/bin/asadmin start-domain "$2"

        ;;

    2)

        echo "instruction received to stop domain $2"

        /home/techyman/glassfish4/bin/asadmin stop-domain "$2"

        ;;

    3)

        echo "instruction received to restart domain $2"

        /home/techyman/glassfish4/bin/asadmin stop-domain "$2" && /home/techyman/glassfish4/bin/asadmin start-domain "$2"

        ;;

    esac



}

echo "What action do you want to perform? (1 for Start, 2 for Stop, 3 for Restart)"

read actionToPerform

echo "On which domains do you want to perform these actions?"

read -a arrayOfDomains

# https://stackoverflow.com/a/56146307/21719190

for domain in "${arrayOfDomains[@]}"; do

    domain_action "$actionToPerform" "$domain"

    #echo "$domain"

    #https://ryanstutorials.net/bash-noscripting-tutorial/bash-if-statements.php

    #if [ "$actionToPerform" = "1" ]; then

    #   echo "Starting $domain"

    #  domain_action "$actionToPerform" "$domain"

    #elif [ "$actionToPerform" = "2" ]; then

    #   echo "Stopping $domain"

    #  domain_action "$actionToPerform" "$domain"

    #else

    #   [ "$actionToPerform" = "3" ]

    #  echo "Restarting $domain"

    # domain_action "$actionToPerform" "$domain"

    #fi

done

https://redd.it/17tinew
@r_bash
man tool | cat | grep "string"

Out of curiosity, why doesn't grep work after cat? Isn't the stdout just a "textfile"? Ok, now thinking about this, I actually didn't try to run it with root privileges. But would it matter though?

https://redd.it/17tntom
@r_bash
How to remove single new lines from the end of a line in a text file, but ignore double new lines

I have been tearing my hair out trying to process some text files that have too many new lines.

I have a text file that look s something like this:

The quick brown fox jumps Over the
lazy dog. The quick brown fox.

The quick brown fox
jumps over the lazy dog.

I want to remove the single newlines but ignore the doubles.

In a text editor I can find and place using regex like this:

Find: \n(?!\n) Replace with: <space>

But I have a bunch of files, so I’m looking for a way I can create a noscript to do it.

I’ve tried see/gsed, but it is ignoring my regular expressions, even with the -E option. Even a simple search for a newline fails:

sed -i -E 's/\n/ /g' test.txt

Does anyone have a solution?

Many thanks.

https://redd.it/17twwyv
@r_bash
weird behaviors

curl -s https://english-e-reader.net/level/pre-intermediate | grep "/book/.*>" | sed 's/<a.*="//' | sed 's/">//' |sed 's|\^|https://english-e-reader.net|' | xargs -n 1 curl -s | grep -E "\^words: " >> out

I cannot write anything to the out file, but without redirecting to the file, everything went right.

https://redd.it/17v73mz
@r_bash