I was wondering if anyone knows of a resource in the same vein as [1] or [2] but to implement a prolog interpreter instead of lisp.

1: https://github.com/kanaka/mal

2: http://www.buildyourownlisp.com/

There is more to visual programming than simple wire diagrams and "code-blocks-as-visual-blocks":

https://www.youtube.com/watch?v=6orsmFndx_o

https://www.youtube.com/watch?v=I9LZ6TnSP40

https://alumni.media.mit.edu/~mt/thesis/mt-thesis-Contents.h...

http://worrydream.com/

And yes, this: http://www.fantasticcontraption.com/ This is not 100% real programming, because it does not include sensors, but you do create constructs that interact with the environment and accomplish goals. It's close enough to show what's possible with certain interfaces.

Long-term: https://dynamicland.org/

There have been much fewer resources allocated to the development of these concepts. Mostly for historic reasons.

The sad reality is that both critics and proponents of visual programming are often uninformed about prior work, user studies and related research rooted in cognitive and developmental psychology.

Pretty cool, this is actually a great reference for a lot of things. Even if you're familiar with RL, you might be reminded of something or learn something new.

Sutton and Barto's book is also good if you want to do more than dip your toes into RL: http://incompleteideas.net/book/the-book-2nd.html That page has the PDF with links to code, problem solutions, and course material.

If you just want an idea of what an RL algorithm looks like, I've got a (heavily) documented version of TD(λ) for linear function approximation here: https://github.com/rldotai/rl-algorithms/blob/master/py3/td....