mirrord will relay file access (except for some exceptions) to the
target pod by default. (this functionality can be disabled using
--fs-mode local flag on the command line or by
mode in the configuration file in the IDE plugin.)
For example, the following python script calls the built-in
open function which translate to something like
openat(AT_FDCWD, "/tmp/test", O_RDWR|O_CLOEXEC) at a lower level:
with open("/tmp/test", "r+") as rw_file: read_str = rw_file.read(42) print(read_str)
When we run that python script with mirrord:
mirrord exec -c --target py-serv-deployment-cfc458fd4-bjzjx python3 test.py
mirrord overrides that
openat call and opens
/tmp/test on the remote pod.
How does it work? #
Once a request to open a new file is received by
mirrord-layer, the agent forwards the request
to the container in the remote pod in context of the provided path for the open system call, prefixed with path to the
root directory of the container.
mirrord-agent uses APIs provided by docker and containerd runtimes to get the PID of the remote container, and
refers to the root directory of the remote container through
mirrord overrirdes calls to the following libc functions/system calls:
int open(const char *pathname, int flags);
Open files on the remote pod. Functionality when opening with different types of paths might differ. In the case when
pathname is specified to be a relative path, the call to open is sent to libc instead of the remote pod.
import os fd = os.open("/tmp/test", os.O_WRONLY | os.O_CREAT)
int openat(int dirfd, const char *pathname, int flags);
openat works the same as
dirfd is specified as
AT_FDCWD or if the path is absolute. If a valid
dirfd is provided, files relative to the directory referred to by the
dirfd can be opened.
dir = os.open("/tmp", os.O_RDONLY | os.O_NONBLOCK | os.O_CLOEXEC | os.O_DIRECTORY) os.open("test", os.O_RDWR | os.O_NONBLOCK | os.O_CLOEXEC, dir_fd=dir)
ssize_t read(int fd, void *buf, size_t count);
Read from a file on the remote pod.
fd = os.open("/tmp/test, os.O_RDWR | os.O_NONBLOCK | os.O_CLOEXEC) read = os.read(fd, 1024)
ssize_t write(int fd, const void *buf, size_t count);
Write to a file on the remote pod.
with open("/tmp/test", "w") as file: file.write(TEXT)
off_t lseek(int fd, off_t offset, int whence);
Reposition the file offset of an open file on the remote pod. lseek through mirrord-layer supports all valid options for whence as specified in the Linux manpages.
with open("/tmp/test", "w") as file: file.seek(10) file.write(TEXT)
Note: For read, write, and lseek if the provided
fdis a valid file descriptor i.e. it refers to a file opened on the remote pod then the call is forwarded to the remote pod, otherwise the call is sent to libc.