Commit | Line | Data |
---|---|---|
26da7e20 | 1 | $Cambridge: exim/src/README.UPDATING,v 1.13 2006/09/25 11:25:37 ph10 Exp $ |
0f4f2a88 PH |
2 | |
3 | This document contains detailed information about incompatibilities that might | |
4 | be encountered when upgrading from one release of Exim to another. The | |
5 | information is in reverse order of release numbers. Mostly these are relatively | |
6 | small points, and the configuration file is normally upwards compatible, but | |
7 | there have been two big upheavals... | |
8 | ||
9 | ||
10 | ************************************************************************** | |
11 | * There was a big reworking of the way mail routing works for release * | |
12 | * 4.00. Previously used "directors" were abolished, and all routing is * | |
13 | * now done by routers. Policy controls for incoming mail are now done by * | |
14 | * Access Control Lists instead of separate options. All this means that * | |
15 | * pre-4.00 configuration files have to be massively converted. If you * | |
16 | * are coming from a 3.xx release, please read the document in the file * | |
17 | * doc/Exim4.upgrade, and allow some time to complete the upgrade. * | |
18 | * * | |
19 | * There was a big reworking of the way domain/host/net/address lists are * | |
20 | * handled at release 3.00. If you are coming from a pre-3.00 release, it * | |
21 | * might be easier to start again from a default configuration. Otherwise * | |
22 | * you need to read doc/Exim3.upgrade and do a double conversion of your * | |
23 | * configuration file. * | |
24 | ************************************************************************** | |
25 | ||
26 | ||
27 | The rest of this document contains information about changes in 4.xx releases | |
28 | that might affect a running system. | |
29 | ||
30 | ||
26da7e20 PH |
31 | Exim version 4.64 |
32 | ----------------- | |
33 | ||
34 | 1. Callouts were setting the name used for EHLO/HELO from $smtp_active_ | |
35 | hostname. This is wrong, because it relates to the incoming message (and | |
36 | probably the interface on which it is arriving) and not to the outgoing | |
37 | callout (which could be using a different interface). This has been | |
38 | changed to use the value of the helo_data option from the smtp transport | |
39 | instead - this is what is used when a message is actually being sent. If | |
40 | there is no remote transport (possible with a router that sets up host | |
41 | addresses), $smtp_active_hostname is used. This change is mentioned here in | |
42 | case somebody is relying on the use of $smtp_active_hostname. | |
43 | ||
44 | ||
a5bd321b PH |
45 | Exim version 4.63 |
46 | ----------------- | |
47 | ||
48 | When an SMTP error message is specified in a "message" modifier in an ACL, or | |
49 | in a :fail: or :defer: message in a redirect router, Exim now checks the start | |
50 | of the message for an SMTP error code. This consists of three digits followed | |
51 | by a space, optionally followed by an extended code of the form n.n.n, also | |
52 | followed by a space. If this is the case and the very first digit is the same | |
53 | as the default error code, the code from the message is used instead. If the | |
54 | very first digit is incorrect, a panic error is logged, and the default code is | |
55 | used. This is an incompatible change, but it is not expected to affect many (if | |
56 | any) configurations. It is possible to suppress the use of the supplied code in | |
57 | a redirect router by setting the smtp_error_code option false. In this case, | |
58 | any SMTP code is quietly ignored. | |
59 | ||
60 | ||
47ca6d6c PH |
61 | Exim version 4.61 |
62 | ----------------- | |
63 | ||
8def5aaf PH |
64 | 1. The default number of ACL variables of each type has been increased to 20, |
65 | and it's possible to compile Exim with more. You can safely upgrade to this | |
66 | release if you already have messages on the queue with saved ACL variable | |
67 | values. However, if you downgrade from this release with messages on the queue, | |
68 | any saved ACL values they may have will be lost. | |
69 | ||
70 | 2. The default value for rfc1413_query_timeout has been changed from 30s to 5s. | |
47ca6d6c PH |
71 | |
72 | ||
8857ccfd PH |
73 | Exim version 4.54 |
74 | ----------------- | |
75 | ||
76 | There was a problem with 4.52/TF/02 in that a "name=" option on control= | |
77 | submission terminated at the next slash, thereby not allowing for slashes in | |
78 | the name. This has been changed so that "name=" takes the rest of the string as | |
79 | its data. It must therefore be the last option. | |
80 | ||
81 | ||
f3f0a1f0 PH |
82 | Version 4.53 |
83 | ------------ | |
84 | ||
85 | If you are using the experimental Domain Keys support, you must upgrade to | |
86 | at least libdomainkeys 0.67 in order to run this release of Exim. | |
87 | ||
88 | ||
b5aea5e1 PH |
89 | Version 4.51 |
90 | ------------ | |
91 | ||
c688b954 PH |
92 | 1. The format in which GnuTLS parameters are cached (in the file gnutls-params |
93 | in the spool directory) has been changed. The new format can also be generated | |
b5aea5e1 PH |
94 | externally, so it is now possible to update the values from outside Exim. This |
95 | has been implemented in an upwards, BUT NOT downwards, compatible manner. | |
96 | Upgrading should be seamless: when Exim finds that it cannot understand an | |
97 | existing cache file, it generates new parameters and writes them to the cache | |
98 | in the new format. If, however, you downgrade from 4.51 to a previous release, | |
99 | you MUST delete the gnutls-params file in the spool directory, because the | |
100 | older Exim will not recognize the new format. | |
101 | ||
c688b954 PH |
102 | 2. When doing a callout as part of verifying an address, Exim was not paying |
103 | attention to any local part prefix or suffix that was matched by the router | |
104 | that accepted the address. It now behaves in the same way as it does for | |
105 | delivery: the affixes are removed from the local part unless | |
106 | rcpt_include_affixes is set on the transport. If you have a configuration that | |
107 | uses prefixes or suffixes on addresses that could be used for callouts, and you | |
108 | want the affixes to be retained, you must make sure that rcpt_include_affixes | |
109 | is set on the transport. | |
110 | ||
447d236c PH |
111 | 3. Bounce and delay warning messages no longer contain details of delivery |
112 | errors, except for explicit messages (e.g. generated by :fail:) and SMTP | |
113 | responses from remote hosts. | |
114 | ||
b5aea5e1 | 115 | |
8b5af54d PH |
116 | Version 4.50 |
117 | ------------ | |
118 | ||
4964e932 PH |
119 | The exicyclog script has been updated to use three-digit numbers in rotated log |
120 | files if the maximum number to keep is greater than 99. If you are already | |
121 | keeping more than 99, there will be an incompatible change when you upgrade. | |
122 | You will probably want to rename your old log files to the new form before | |
c3af992c | 123 | running the new exicyclog. |
8b5af54d PH |
124 | |
125 | ||
0f4f2a88 PH |
126 | Version 4.42 |
127 | ------------ | |
128 | ||
129 | RFC 3848 specifies standard names for the "with" phrase in Received: header | |
130 | lines when AUTH and/or TLS are in use. This is the "received protocol" | |
131 | field. Exim used to use "asmtp" for authenticated SMTP, without any | |
132 | indication (in the protocol name) for TLS use. Now it follows the RFC and | |
133 | uses "esmtpa" if the connection is authenticated, "esmtps" if it is | |
134 | encrypted, and "esmtpsa" if it is both encrypted and authenticated. These names | |
135 | appear in log lines as well as in Received: header lines. | |
136 | ||
137 | ||
138 | Version 4.34 | |
139 | ------------ | |
140 | ||
141 | Change 4.31/2 gave problems to data ACLs and local_scan() functions that | |
142 | expected to see a Received: header. I have changed to yet another scheme. The | |
143 | Received: header is now generated after the body is received, but before the | |
144 | ACL or local_scan() is called. After they have run, the timestamp in the | |
145 | Received: header is updated. | |
146 | ||
147 | Thus, change (a) of 4.31/2 has been reversed, but change (b) is still true, | |
148 | which is lucky, since I decided it was a bug fix. | |
149 | ||
150 | ||
151 | Version 4.33 | |
152 | ------------ | |
153 | ||
154 | If an expansion in a condition on a "warn" statement fails because a lookup | |
155 | defers, the "warn" statement is abandoned, and the next ACL statement is | |
156 | processed. Previously this caused the whole ACL to be aborted. | |
157 | ||
158 | ||
159 | Version 4.32 | |
160 | ------------ | |
161 | ||
162 | Change 4.31/2 has been reversed, as it proved contentious. Recipient callout | |
163 | verification now uses <> in the MAIL command by default, as it did before. A | |
164 | new callout option, "use_sender", has been added to request the other | |
165 | behaviour. | |
166 | ||
167 | ||
168 | Version 4.31 | |
169 | ------------ | |
170 | ||
171 | 1. If you compile Exim to use GnuTLS, it now requires the use of release 1.0.0 | |
172 | or greater. The interface to the obsolete 0.8.x releases is no longer | |
173 | supported. There is one externally visible change: the format for the | |
174 | display of Distinguished Names now uses commas as a separator rather than a | |
175 | slash. This is to comply with RFC 2253. | |
176 | ||
177 | 2. When a message is received, the Received: header line is now generated when | |
178 | reception is complete, instead of at the start of reception. For messages | |
179 | that take a long time to come in, this changes the meaning of the timestamp. | |
180 | There are several side-effects of this change: | |
181 | ||
182 | (a) If a message is rejected by a DATA or non-SMTP ACL, or by local_scan(), | |
183 | the logged header lines no longer include the local Received: line, | |
184 | because it has not yet been created. If the message is a non-SMTP one, | |
185 | and the error is processed by sending a message to the sender, the copy | |
186 | of the original message that is returned does not have an added | |
187 | Received: line. | |
188 | ||
189 | (b) When a filter file is tested using -bf, no additional Received: header | |
190 | is added to the test message. After some thought, I decided that this | |
191 | is a bug fix. | |
192 | ||
193 | The contents of $received_for are not affected by this change. This | |
194 | variable still contains the single recipient of a message, copied after | |
195 | addresses have been rewritten, but before local_scan() is run. | |
196 | ||
197 | 2. Recipient callout verification, like sender verification, was using <> in | |
198 | the MAIL FROM command. This isn't really the right thing, since the actual | |
199 | sender may affect whether the remote host accepts the recipient or not. I | |
200 | have changed it to use the actual sender in the callout; this means that | |
201 | the cache record is now keyed on a recipient/sender pair, not just the | |
202 | recipient address. There doesn't seem to be a real danger of callout loops, | |
203 | since a callout by the remote host to check the sender would use <>. | |
204 | ||
205 | ||
206 | Version 4.30 | |
207 | ------------ | |
208 | ||
209 | 1. I have abolished timeout_DNS as an error that can be detected in retry | |
210 | rules, because it has never worked. Despite the fact that it has been | |
211 | documented since at least release 1.62, there was no code to support it. | |
212 | If you have used it in your retry rules, you will now get a warning message | |
213 | to the log and panic log. It is now treated as plain "timeout". | |
214 | ||
215 | 2. After discussion on the mailing list, Exim no longer adds From:, Date:, or | |
216 | Message-Id: header lines to messages that do not originate locally, that is, | |
217 | messages that have an associated sending host address. | |
218 | ||
219 | 3. When looking up a host name from an IP address, Exim now tries the DNS | |
220 | first, and only if that fails does it use gethostbyaddr() (or equivalent). | |
221 | This change was made because on some OS, not all the names are given for | |
222 | addresses with multiple PTR records via the gethostbyaddr() interface. The | |
223 | order of lookup can be changed by setting host_lookup_order. | |
224 | ||
225 | ||
226 | Version 4.23 | |
227 | ------------ | |
228 | ||
229 | 1. The new FIXED_NEVER_USERS build-time option creates a list of "never users" | |
230 | that cannot be overridden. The default in the distributed EDITME is "root". | |
231 | If for some reason you were (against advice) running deliveries as root, you | |
232 | will have to ensure that FIXED_NEVER_USERS is not set in your | |
233 | Local/Makefile. | |
234 | ||
235 | 2. The ${quote: operator now quotes an empty string, which it did not before. | |
236 | ||
237 | 3. Version 4.23 saves the contents of the ACL variables with the message, so | |
238 | that they can be used later. If one of these variables contains a newline, | |
239 | there will be a newline character in the spool that will not be interpreted | |
240 | correctely by a previous version of Exim. (Exim ignores keyed spool file | |
241 | items that it doesn't understand - precisely for this kind of problem - but | |
242 | it expects them all to be on one line.) | |
243 | ||
244 | So the bottom line is: if you have newlines in your ACL variables, you | |
245 | cannot retreat from 4.23. | |
246 | ||
247 | ||
248 | Version 4.21 | |
249 | ------------ | |
250 | ||
251 | 1. The idea of the "warn" ACL verb is that it adds a header or writes to the | |
252 | log only when "message" or "log_message" are set. However, if one of the | |
253 | conditions was an address verification, or a call to a nested ACL, the | |
254 | messages generated by the underlying test were being passed through. This | |
255 | no longer happens. The underlying message is available in $acl_verify_ | |
256 | message for both "message" and "log_message" expansions, so it can be | |
257 | passed through if needed. | |
258 | ||
259 | 2. The way that the $h_ (and $header_) expansions work has been changed by the | |
260 | addition of RFC 2047 decoding. See the main documentation (the NewStuff file | |
261 | until release 4.30, then the manual) for full details. Briefly, there are | |
262 | now three forms: | |
263 | ||
264 | $rh_xxx: and $rheader_xxx: give the original content of the header | |
265 | line(s), with no processing at all. | |
266 | ||
267 | $bh_xxx: and $bheader_xxx: remove leading and trailing white space, and | |
268 | then decode base64 or quoted-printable "words" within the header text, | |
269 | but do not do charset translation. | |
270 | ||
271 | $h_xxx: and $header_xxx: attempt to translate the $bh_ string to a | |
272 | standard character set. | |
273 | ||
274 | If you have previously been using $h_ expansions to access the raw | |
275 | characters, you should change to $rh_ instead. | |
276 | ||
277 | 3. When Exim creates an RFC 2047 encoded word in a header line, it labels it | |
278 | with the default character set from the headers_charset option instead of | |
279 | always using iso-8859-1. | |
280 | ||
281 | 4. If TMPDIR is defined in Local/Makefile (default in src/EDITME is | |
282 | TMPDIR="/tmp"), Exim checks for the presence of an environment variable | |
283 | called TMPDIR, and if it finds it is different, it changes its value. | |
284 | ||
285 | 5. Following a discussion on the list, the rules by which Exim recognises line | |
286 | endings on incoming messages have been changed. The -dropcr and drop_cr | |
287 | options are now no-ops, retained only for backwards compatibility. The | |
288 | following line terminators are recognized: LF CRLF CR. However, special | |
289 | processing applies to CR: | |
290 | ||
291 | (i) The sequence CR . CR does *not* terminate an incoming SMTP message, | |
292 | nor a local message in the state where . is a terminator. | |
293 | ||
294 | (ii) If a bare CR is encountered in a header line, an extra space is added | |
295 | after the line terminator so as not to end the header. The reasoning | |
296 | behind this is that bare CRs in header lines are most likely either | |
297 | to be mistakes, or people trying to play silly games. | |
298 | ||
299 | 6. The code for using daemon_smtp_port, local_interfaces, and the -oX options | |
300 | has been reorganized. It is supposed to be backwards compatible, but it is | |
301 | mentioned here just in case I've screwed up. | |
302 | ||
303 | ||
304 | ||
305 | Version 4.20 | |
306 | ------------ | |
307 | ||
308 | 1. I have tidied and re-organized the code that uses alarm() for imposing time | |
309 | limits on various things. It shouldn't affect anything, but if you notice | |
310 | processes getting stuck, it may be that I've broken something. | |
311 | ||
312 | 2. The "arguments" log selector now also logs the current working directory | |
313 | when Exim is called. | |
314 | ||
315 | 3. An incompatible change has been made to the appendfile transport. This | |
316 | affects the case when it is used for file deliveries that are set up by | |
317 | .forward and filter files. Previously, any settings of the "file" or | |
318 | "directory" options were ignored. It is hoped that, like the address_file | |
319 | transport in the default configuration, these options were never in fact set | |
320 | on such transports, because they were of no use. | |
321 | ||
322 | Now, if either of these options is set, it is used. The path that is passed | |
323 | by the router is in $address_file (this is not new), so it can be used as | |
324 | part of a longer path, or modified in any other way that expansion permits. | |
325 | ||
326 | If neither "file" nor "directory" is set, the behaviour is unchanged. | |
327 | ||
328 | 4. Related to the above: in a filter, if a "save" command specifies a non- | |
329 | absolute path, the value of $home/ is pre-pended. This no longer happens if | |
330 | $home is unset or is set to an empty string. | |
331 | ||
332 | 5. Multiple file deliveries from a filter or .forward file can never be | |
333 | batched; the value of batch_max on the transport is ignored for file | |
334 | deliveries. I'm assuming that nobody ever actually set batch_max on the | |
335 | address_file transport - it would have had odd effects previously. | |
336 | ||
337 | 6. DESTDIR is the more common variable that ROOT for use when installing | |
338 | software under a different root filing system. The Exim install script now | |
339 | recognizes DESTDIR first; if it is not set, ROOT is used. | |
340 | ||
341 | 7. If DESTDIR is set when installing Exim, it no longer prepends its value to | |
342 | the path of the system aliases file that appears in the default | |
343 | configuration (when a default configuration is installed). If an aliases | |
344 | file is actually created, its name *does* use the prefix. | |
345 | ||
346 | ||
347 | Version 4.14 | |
348 | ------------ | |
349 | ||
350 | 1. The default for the maximum number of unknown SMTP commands that Exim will | |
351 | accept before dropping a connection has been reduced from 5 to 3. However, you | |
352 | can now change the value by setting smtp_max_unknown_commands. | |
353 | ||
354 | 2. The ${quote: operator has been changed so that it turns newline and carriage | |
355 | return characters into \n and \r, respectively. | |
356 | ||
357 | 3. The file names used for maildir messages now include the microsecond time | |
358 | fraction as well as the time in seconds, to cope with systems where the process | |
359 | id can be re-used within the same second. The format is now | |
360 | ||
361 | <time>.H<microsec>P<pid>.<host> | |
362 | ||
363 | This should be a compatible change, but is noted here just in case. | |
364 | ||
365 | 4. The rules for creating message ids have changed, to cope with systems where | |
366 | the process id can be re-used within the same second. The format, however, is | |
367 | unchanged, so this should not cause any problems, except as noted in the next | |
368 | item. | |
369 | ||
370 | 5. The maximum value for localhost_number has been reduced from 255 to 16, in | |
371 | order to implement the new message id rules. For operating systems that have | |
372 | case-insensitive file systems (Cygwin and Darwin), the limit is 10. | |
373 | ||
374 | 6. verify = header_syntax was allowing unqualified addresses in all cases. Now | |
375 | it allows them only for locally generated messages and from hosts that match | |
376 | sender_unqualified_hosts or recipient_unqualified_hosts, respectively. | |
377 | ||
378 | 7. For reasons lost in the mists of time, when a pipe transport was run, the | |
379 | environment variable MESSAGE_ID was set to the message ID preceded by 'E' (the | |
380 | form used in Message-ID: header lines). The 'E' has been removed. | |
381 | ||
382 | ||
383 | Version 4.11 | |
384 | ------------ | |
385 | ||
386 | 1. The handling of lines in the configuration file has changed. Previously, | |
387 | macro expansion was applied to logical lines, after continuations had been | |
388 | joined on. This meant that it could not be used in .include lines, which are | |
389 | handled as physical rather than logical lines. Macro expansion is now done on | |
390 | physical lines rather than logical lines. This means there are two | |
391 | incompatibilities: | |
392 | ||
393 | (a) A macro that expands to # to turn a line into a comment now applies only | |
394 | to the physical line where it appears. Previously, it would have caused | |
395 | any following continuations also to be ignored. | |
396 | ||
397 | (b) A macro name can no longer be split over the boundary between a line and | |
398 | its continuation. Actually, this is more of a bug fix. :-) | |
399 | ||
400 | 2. The -D command line option must now all be within one command line item. | |
401 | This makes it possible to use -D to set a macro to the empty string by commands | |
402 | such as | |
403 | ||
404 | exim -DABC ... | |
405 | exim -DABC= ... | |
406 | ||
407 | Previously, these items would have moved on to the next item on the command | |
408 | line. To include spaces in a macro definition item, quotes must be used, in | |
409 | which case you can also have spaces after -D and surrounding the equals. For | |
410 | example: | |
411 | ||
412 | exim '-D ABC = something' ... | |
413 | ||
414 | 3. The way that addresses that redirect to themselves are handled has been | |
415 | changed, in order to fix an obscure bug. This should not cause any problems | |
416 | except in the case of wanting to go back from a 4.11 (or later) release to an | |
417 | earlier release. If there are undelivered messages on the spool that contain | |
418 | addresses which redirect to themselves, and the redirected addresses have | |
419 | already been delivered, you might get a duplicate delivery if you revert to an | |
420 | earlier Exim. | |
421 | ||
422 | 4. The default way of looking up IP addresses for hosts in the manualroute and | |
423 | queryprogram routers has been changed. If "byname" or "bydns" is explicitly | |
424 | specified, there is no change, but if no method is specified, Exim now behaves | |
425 | as follows: | |
426 | ||
427 | First, a DNS lookup is done. If this yields anything other than | |
428 | HOST_NOT_FOUND, that result is used. Otherwise, Exim goes on to try a call to | |
429 | getipnodebyname() (or gethostbyname() on older systems) and the result of the | |
430 | lookup is the result of that call. | |
431 | ||
432 | This change has been made because it has been discovered that on some systems, | |
433 | if a DNS lookup called via getipnodebyname() times out, HOST_NOT_FOUND is | |
434 | returned instead of TRY_AGAIN. Thus, it is safest to try a DNS lookup directly | |
435 | first, and only if that gives a definite "no such host" to try the local | |
436 | function. | |
437 | ||
438 | 5. In fixing the minor security problem with pid_file_path, I have removed some | |
439 | backwards-compatible (undocumented) code which was present to ease conversion | |
440 | from Exim 3. In Exim 4, pid_file_path is a literal; in Exim 3 it was allowed to | |
441 | contain "%s", which was replaced by the port number for daemons listening on | |
442 | non-standard ports. In Exim 4, such daemons do not write a pid file. The | |
443 | backwards compatibility feature was to replace "%s" by nothing if it occurred | |
444 | in an Exim 4 setting of pid_file_path. The bug was in this code. I have solved | |
445 | the problem by removing the backwards compatibility feature. Thus, if you still | |
446 | have "%s" somewhere in a setting of pid_file_path, you should remove it. | |
447 | ||
448 | 6. There has been an extension to lsearch files. The keys in these files may | |
449 | now be quoted in order to allow for whitespace and colons in them. This means | |
450 | that if you were previously using keys that began with a doublequote, you will | |
451 | now have to wrap them with extra quotes and escape the internal quotes. The | |
452 | possibility that anybody is actually doing this seems extremely remote, but it | |
453 | is documented just in case. | |
454 | ||
455 | ||
456 | Version 4.10 | |
457 | ------------ | |
458 | ||
459 | The build-time parameter EXIWHAT_KILL_ARG has been renamed EXIWHAT_KILL_SIGNAL | |
460 | to better reflect its function. The OS-specific files have been updated. Only | |
461 | if you have explicitly set this in your Makefile (highly unlikely) do you need | |
462 | to change anything. | |
463 | ||
464 | **** |