The Astronomer CLI on the Windows Subsystem for Linux
Astronomer CLI in WSL
This guide will walk you through the setup and configuration process for using the Astronomer CLI in the windows subsystem for linux on windows 10. In this guide, we assume you have already enabled the WSL and are running in the bash terminal.
We're using Ubuntu as our linux flavor of choice, however this giude should work for other distrubutions as well.
Much of the setup process is borrowed from a guide written by Nick Janetakis. Find the full guide here: Setting Up Docker for Windows and WSL to Work Flawlessly
Step 1. Install docker ce for windows
Follow the docker for windows install guide here: Install Docker for windows
Step 2. Expose the docker daemon
In your docker settings, under general, enable the
Expose daemon on tcp://localhost:2375 without TLS setting. This will allow the docker daemon running on windows to act as a remote docker service for our WSL instance.
Step 3. Install docker for linux in WSL
In your WSL termninal, follow the Docker CE for Ubuntu install guide here: Install Docker CE for Ubuntu
Docker wil lnot run in the WSL instance, however this will give us access to the docker cli through our linux environment.
Step 4. Connect your WSL instance to Docker on windows
We now need to point our docker host route to the remote docker daemon running in windows. To do this we need to add an export path to our
echo "export DOCKER_HOST=tcp://0.0.0.0:2375" >> ~/.bashrc && source ~/.bashrc to add a new line to your bashrc file pointing the docker host to your exposed daemon and re-source your bashrc file.
Step 5. Custom mount points
To ensure docker can properly mount volumes, we need to create custom mount paths which work in the WSL instance.
The process differs depending on the version of Windows 10 you're running. In our case we're running build 1709. See the full guide for more details about later builds.
Create a new mount point directory:
sudo mkdir /c
Then bind this mount point:
sudo mount --bind /mnt/c /c
You're all set. You can now run
docker run hello-world through your WSL instance to ensure everything works as expected. Keep in mind you will need to bind your mount point each time you start up a new WSL instance.
You can now setup the Astronomer CLI and begin deploying DAGs following our guide here: Astronomer CLI