Frequently Asked Questions
- Can I use multiple containers?
- Can I mix device types in an application?
- How do I push a new git repo to an Application
- Why does
/datareport weird usage?
- What NTP servers do the devices use?
- What Network Ports are required?
- Can I access /dev and things like GPIO from the container?
- Can I set a static IP address for my device?
- Why can't I SSH into or run code in older versions of the host OS?
- How can I forward my container ports?
- Which data is persisted on devices across updates/power cycles?
- Why does /data disappear when I move a device between applications?
- It appears that there is a centralized master running (in cloud) and agents running on devices. Is that accurate?
- What type of encryption do you use over OpenVPN? SSL/TLS/AES-256? Mutual key authentication? over SSH?
- What is the performance impact on the gateway device due to encryption?
- How long does the update process run typically? For now it appears to be quick for small updates.
- How does the device registration work over the VPN and how do you ensure the identity of the device on the first-time registration?
- If the device is installed behind a proxy/firewall and can’t be reachable on Internet via direct connection, what are the pitfalls?
- How do you secure your own “cloud” to prevent malicious attack which may allow attacker to break-in our systems?
- What does it mean when a device type is discontinued?
- I have a device that is not on the supported devices list. Can it run on balena?
Can I use multiple containers?
Multiple container applications are supported, beginning with balenaOS v2.12.0. To run multiple containers, you will need to create or upgrade to a starter or microservices type application and include a
docker-compose.yml file at the root of your project. You can reference the multicontainer documentation for more details on the supported configurations.
Note: If you do not see an option to choose a starter or microservices application type, a multicontainer compatible OS version has not yet been released for the selected device type.
If you are running a Docker-in-Docker setup, which builds a single application container on the balena servers but has a
docker-compose.yml file at the root of the project, you'll want to rename the file to something like
dind-compose.yml. Then when you run Docker Compose in your container, you can use the
-f flag with the new file name:
docker-compose -f dind-compose.yml up.
Can I mix device types in an application?
It is possible to have devices of different types in the same application, as long as the devices share the same architecture. For example, you could have an application with both Raspberry Pi 3 and BeagleBone Black devices, as they both use an ARMv7 processor. However, you could not have any Intel NUC devices as part of the same application, as those devices have x86-64 processors.
Regardless of type, all devices in your application will get the same container images. This means that if you have mixed device types you'll need to use an architecture-specific base image in your Dockerfile, rather than one based on device type.
How do I push a new git repo to an application?
If you have pushed a repository called
project-A to your application and at a later stage you would like to push a new project called
project-B, you can do this by adding the application remote (
git remote add balena <USERNAME>@git.balena-cloud.com:<USERNAME>/<APPNAME>.git) to
project-B's local repository. You can then easily push
project-B to your application by just doing
git push balena master -f. The extra
-f on the command forces the push and resets the git history on the git remote on balena's backend. You should now have
project-B running on all the devices in the application fleet. Note that once you have successfully switched to
project-B you no longer need to add the
-f on every push, for more info check out the docs on forced git pushes.
Why does /data report weird usage?
On the device we have a writable data partition that uses all the free space remaining after reserving the required amount for the host os. This data partition contains the Docker images for the balena device supervisor and the user applications so that they can be updated, along with containing the persistent
/data for the application to use, this way it avoids reserving a specific amount of space for either images or data and then finding out that we have reserved too much or too little for one. So the space usage in
/data being used but not accounted for will likely be due to the Docker images. (As a side note if you want the most accurate usage stats you should use
btrfs fi df /data as
df is not accurate for btrfs partitions).
What NTP servers do the devices use?
Up to balenaOS v2.0.6, the NTP service connects to the following time servers:
Starting from balenaOS v2.0.7, the devices connect to the following NTP servers:
What network ports are required?
In order for a balena device to get outside of the local network and connect to the balena API, there are a few core network requirements.
Balena makes use of the following ports:
443TCP - This is the most fundamental requirement - it is used to connect to the VPN and the web terminal, and many web endpoints using TLS (https://.)
123UDP - For NTP time synchronisation.
53UDP - For DNS name resolution.
Each of these should work with outward only (and inward once outward connection established) firewall settings.
Additionally, you should whitelist the following domains for the relevant ports above:
Additionally, an outgoing connection to
mixpanel.com is made. This is not a functional requirement for balena, but allows tracking of some useful metrics.
Can I access /dev and things like GPIO from the container?
If you're application uses a single container, it will be run in privileged mode by default and will have access to hardware in the same way as a vanilla Linux system.
For applications running multiple containers, you will either need to define services as privileged or use the
devices settings in the
docker-compose.yml file to map in the correct hardware access to the container.
Can I set a static IP address for my device?
Yes! It's actually pretty easy. Have a look at the network setup section of our documentation. In general, most network configurations can be achieved by changing the NetworkManager configuration file.
Why can't I SSH into or run code in older versions of the host OS?
While you’ve always been able to SSH into your container, we had previously restricted SSH access to the host OS. We had a number of reasons for doing this:
- Code in the host OS currently isn't kept inside a container, so we are unable to track or update it at all.
- If code run in the host OS inadvertently kills our supervisor or overwrites critical data (such as data used to identify it), the device could become inaccessible and no longer updateable.
- Configuration of network device drivers, mount points, security provisions, and many other details have been carefully chosen to serve the balena ecosystem and your containers. Rogue code running in the host OS might interfere with this, leading to issues or degradation of performance which we would likely not be able to help you with.
- When troubleshooting issues we base our assumptions on the host OS behaving as we expect it to. If you have made changes here, there's a good chance we won't be able to reproduce the issues locally and therefore won't be able to help you.
However, we've heard from users that they would still like to be able to SSH into the host OS on their devices, so we decided to add that capability starting with balenaOS version 2.7.5. This gives you access to logs and tools for services that operate outside the scope of your application container, such as NetworkManager, Docker, the VPN, and the supervisor. For more details, please check out this documentation.
How can I forward my container ports?
It's usually not necessary to forward ports within the container because the container is bound to the host networking. However if you do need to do something like
docker run -p [host port]:[container port], it can be achieved with
For example, mapping port 80 to 8080 can be achieved with the following:-
iptables -t nat -A PREROUTING -i eth0 -p tcp --dport 80 -j REDIRECT --to-port 8080
Which data is persisted on devices across updates/power cycles?
The only data we guarantee to be persisted across reboot, shutdown and device update/container restart is the contents of the
/data folder, or any named volumes on devices running balenaOS v2.12.0 and above.
However, when a device is restarted or power cycled the container is not recreated, meaning all the data that was present in the container's filesystem before, remains.
It's very important not to rely on this behaviour, as containers are recreated on application updates, when environment variables are changed in the UI or API, or when an application restart is requested.
Why does /data disappear when I move a device between applications?
Persistent data is specific to an application. If you move devices between applications running different code, then keeping persistent data from the old application could potentially cause issues.
On devices running balenaOS versions before 2.12.0, if you move the device back to the old application you'll find
/data remains intact. Newer balenaOS versions automatically purge named volumes when a device is moved to a new application.
It appears that there is a centralized master running (in cloud) and agents running on devices. Is that accurate?
Yes. In fact there are multiple services running on the cloud and the devices communicate with some of them. On the device we run our agent in a Docker container, like a user application.
What type of encryption do you use over OpenVPN? SSL/TLS/AES-256? Mutual key authentication? over SSH?
The VPN connection is TLS with the default ciphersuite negotiation settings which today boil down to DHE-RSA-AES256-SHA. We use certificates to authenticate the server to the client and API keys to authenticate the client to the server.
What is the performance impact on the gateway device due to encryption?
There isn't any. The VPN connection is only used for short messages sent by our servers to the device and for device URL traffic. Internet traffic is routed normally, outside the VPN, therefore doesn't go through the encryption/decryption process.
How long does the update process run typically? Do you have any benchmark data? For now it appears to be quick for small updates.
The update process currently depends on the size of the update and the speed of the Internet connection. The size of the update is currently the size of the Docker layers that differ between the Docker image on the device and the Docker image of the newly pushed code. We currently have a delta-mechanism, which calculates binary difference between two images, which will drop the update size significantly, even on cases where no Docker layers are shared. If you are interested in testing this out, check out the the delta updates documentation.
How does the device registration work over the VPN and how do you ensure the identity of the device on the first-time registration?
The OS image you download from the UI has embedded credentials that allow the device to register to your application without user input on boot. You should keep your downloaded images private.
If the device is installed behind a proxy/firewall and can’t be reachable on internet via direct connection, what are the pitfalls?
The balena device supervisor needs to be able to access our cloud services in order for you to be able to manage your device. When the device is disconnected from the internet it still runs the application it has installed.
How do you secure your own cloud to prevent malicious attack which may allow attacker to break-in our systems?
Generally, we try to follow good OPSEC practices for our systems. We support 2FA for user accounts and force all the connections to be over HTTPS. More details on our approach can be found on our security page.
What does it mean when a device type is discontinued?
Discontinued devices will no longer be actively supported by balena. This means we will no longer provide prebuilt versions of balenaOS for these devices, and we will not be resolving any issues related to these boards. In addition, it will no longer be possible to create applications for these device types, although existing applications and their devices will still function. If you would like to keep your discontinued devices updated with the latest balenaOS changes, you can build your own board-specific versions using our open source repos. Please contact email@example.com with any questions regarding continued device support.
I have a device that is not on the supported devices list. Can it run on balena?
There are a few options for devices that do not have an official device type on balena. If your device has an x86 architecture, you can try the Intel NUC image, which is built to support generic x86 devices. For other devices, you can build your own version of balenaOS using our open source repos. To discuss custom board support, please contact firstname.lastname@example.org.