comet

colab introduced "compute units" which are issued once a month on a pro subnoscription, but with my current throughput, burned in a day. This is an equivalent of a 30-fold price increase. Time to look for a self-hosted training solution.
(TBH I can train NCA even on my laptop, which performs better than colab's free tier on all specs, except vmem, but then I have difficulties to run shaders on the same time)

https://arxiv.org/pdf/2302.10197.pdf
I've had the exact same idea about controlling rotation of the sobel kernels via a parameter in a hidden states! Nice to see it validated
(btw did anyone already tried to train a vision model with filters defined as an sdf?)

defined sobel filters in perception phase as sdf, now I can compute convolutions of any size.
Although after 11x11 performance starts to drop a little (I have 8 of them in each agent)

WIP on implementing rotation for SDF perception filters.
In my imagination, the SDF for a sobel x filter would look something like
x = pow(dot(normalize(dx, dy)), vec2(0, 1)) 2.) * 2. * sign(dx)
and the direction of the filter is determined by rotation of the unit vector

Experimenting with different types of channel attention, that would actually reduce the amount of computation needed, by throwing out most of the input.
The idea is to save on buffer reads on inference, by applying some function + gated activation to internal state, and using this result to determine if we should perceive anything

btw there is a whole NCA section on ALIFE 2023 (started today)

https://webgpufundamentals.org/webgpu/lessons/webgpu-wgsl-function-reference.html
handy cheat sheet of WGSL functions

translation operator (random input, fixed shift)

day 2