we needed more RoboCop
[discourse_docker.git] / README.md
1 ### About
2
3 - [Docker](https://www.docker.io/) is an open source project to pack, ship and run any Linux application in a lighter weight, faster container than a traditional virtual machine.
4
5 - Docker makes it much easier to deploy [a Discourse forum](https://github.com/discourse/discourse) on your servers and keep it updated. For background, see [Sam's blog post](http://samsaffron.com/archive/2013/11/07/discourse-in-a-docker-container).
6
7 - The templates and base image configure Discourse with the Discourse team's recommended optimal defaults.
8
9
10 ### IMPORTANT: Before You Start
11
12 1. Run Docker and launcher as **root**.
13 2. Use [Ubuntu 12.04 LTS](http://releases.ubuntu.com/precise/) or [Ubuntu 13.04](http://releases.ubuntu.com/13.04/) or [Ubuntu 13.10](http://releases.ubuntu.com/13.10/). Device mapper support in Docker is still rough.
14 3. Upgrade to the [latest version of Docker](http://docs.docker.io/en/latest/installation/ubuntulinux/).
15 4. Install Discourse Docker into the expected path `/var/docker`
16
17 If you do not do any of the above, as RoboCop one said, "there will be ... problems."
18
19 ### Getting Started
20
21 The simplest way to get started is the **standalone** template:
22
23 1. **Clone** this project from github: `git clone https://github.com/SamSaffron/discourse_docker.git /var/docker`
24 2. **Copy** the standalone sample into the containers directory: `cp samples/standalone.yml containers/app.yml`
25 3. **Edit** `containers/app.yml` with your environment specific information
26 - [bindings](#expose)
27 - [volumes](#volumes) (make sure you create the appropriate directories on the host)
28 4. **Bootstrap** the image: `sudo ./launcher bootstrap app`
29 5. **Start** the image: `sudo ./launcher start app`
30
31 Note: you can add yourself to the Docker group if you wish to avoid `sudo` with `usermod -aG docker <your-user-name>`.
32
33 ### Directory Structure
34
35 #### `/cids`
36
37 Contains container ids for currently running Docker containers. cids are Docker's "equivalent" of pids. Each container will have a unique git like hash.
38
39 #### `/containers`
40
41 This directory is for container definitions for your various Discourse containers. You are in charge of this directory, it ships empty.
42
43 #### `/samples`
44
45 Sample container definitions you may use to bootstrap your environment. You can copy and amend templates here into the containers directory.
46
47 #### `/shared`
48
49 Placeholder spot for shared volumes with various Discourse containers. You may elect to store certain persistent information outside of a container, in our case we keep various logfiles and upload directory outside. This allows you to rebuild containers easily without losing important information. Keeping uploads outside of the container allows you to share them between multiple web instances.
50
51 #### `/templates`
52
53 [pups](https://github.com/samsaffron/pups) managed pups templates you may use to bootstrap your environment.
54
55 #### `/image`
56
57 Dockerfile for both the base image `samsaffron/discoruse_base` and discourse image `samsaffron/discourse`.
58
59 - `samsaffron/discourse_base` contains all the OS dependencies including sshd, runit, postgres, nginx, ruby.
60
61 - `samsaffron/discourse` builds on the base image and configures a discourse user and `/var/www/discourse` directory for the Discourse source.
62
63 The Docker repository will always contain the latest built version at: https://index.docker.io/u/samsaffron/discourse/ , you should not need to build the base image.
64
65 ### Launcher
66
67 The base directory contains a single bash script which is used to manage containers. You can use it to "bootstrap" a new container, ssh in, start, stop and destroy a container.
68
69 ```
70 Usage: launcher COMMAND CONFIG
71 Commands:
72 start: Start/initialize a container
73 stop: Stop a running container
74 restart: Restart a container
75 destroy: Stop and remove a container
76 ssh: Start a bash shell in a running container
77 logs: Docker logs for container
78 bootstrap: Bootstrap a container for the config based on a template
79 ```
80
81
82 ### Container Configuration
83
84 The beginning of the container definition will contain 3 "special" sections:
85
86 #### templates:
87
88 ```
89 templates:
90 - "templates/cron.template.yml"
91 - "templates/postgres.template.yml"
92 ```
93
94 This template is "composed" out of all these child templates, this allows for a very flexible configuration struture. Furthermore you may add specific hooks that extend the templates you reference.
95
96 #### expose:
97
98 ```
99 expose:
100 - "2222:22"
101 ```
102
103 Expose port 22 inside the container on port 2222 on ALL local host interfaces.
104
105
106 #### volumes:
107
108 ```
109 volumes:
110 - volume:
111 host: /var/docker/data
112 guest: /shared
113
114 ```
115
116 Expose a directory inside the host inside the container.
117
118 ### Upgrading Discourse
119
120 The Docker setup gives you multiple upgrade options:
121
122 1. Use the front end at http://yoursite.com/admin/docker to upgrade an already running image.
123
124 2. Create a new base image by running:
125 - `./launcher bootstrap my_image`
126 - `./launcher destroy my_image`
127 - `./launcher start my_image`
128
129 ### Single Container vs. Multiple Container
130
131 The samples directory contains a standalone template. This template bundles all of the software required to run Discourse into a single container. The advantage is that it is easy.
132
133 The multiple container configuration setup is far more flexible and robust, however it is also more complicated to set up. A multiple container setup allows you to:
134
135 - Minimize downtime when upgrading to new versions of Discourse. You can bootstrap new web processes while your site is running and only after it is built, switch the new image in.
136 - Scale your forum to multiple servers.
137 - Add servers for redundancy.
138 - Have some required services (e.g. the database) run on beefier hardware.
139
140 If you want a multiple container setup, see the `data.yml` and `web_only.yml` templates in the samples directory. To ease this process, `launcher` will inject an env var called `DISCOURSE_HOST_IP` which will be available inside the image.
141
142 WARNING: In a multiple container configuration, *make sure* you setup iptables or some other firewall to protect various ports (for postgres/redis).
143
144 ### Email
145
146 For a Discourse instance to function properly Email must be set up. Use the `SMTP_URL` env var to set your SMTP address, see sample templates for an example. The Docker image does not contain postfix, exim or another MTA, it was omitted because it is very tricky to set up correctly.
147
148 ### Troubleshooting
149
150 We strongly recommend you have ssh access to your running containers, this allows you very easily take a sneak peek at internals. The simplest way to gain access is:
151
152 1. Run a terminal as root
153 2. cd `~/.ssh`
154 3. `ssh-key-gen`
155 4. paste the contents of `id_rsa.pub` into your templates (see placeholder in samples)
156 5. bootstrap and run your container
157 6. `./launcher ssh my_container`
158
159 ### Security
160
161 Directory permissions in Linux are SID based, if your SIDs on the host do not match the SIDs in the guest, permissions will mismatch. On clean installs you can ensure they are in sync by looking at `/etc/passwd` and `/etc/group`, the Discourse account will have the SID 1000.