Hey Daniel Rose Mille,
You can install any required packages using cli option in the container/app built using the docker image...
For Example: In my above article, you can see glue_jupyter is the container/app.
you can click on cli option (high-lighted in yellow color in below pic) and a new terminal will open, run the required package install command:

eg: pip install fastavro

The package installs and you can access it.
You can import the installed packages in jupyter notebook and use it.

This way you can work on avro files.