Commit | Line | Data |
---|---|---|
8f425947 | 1 | $Cambridge: exim/doc/doc-txt/NewStuff,v 1.164 2010/06/01 11:21:30 pdp Exp $ |
495ae4b0 PH |
2 | |
3 | New Features in Exim | |
4 | -------------------- | |
5 | ||
38a0a95f PH |
6 | This file contains descriptions of new features that have been added to Exim. |
7 | Before a formal release, there may be quite a lot of detail so that people can | |
8 | test from the snapshots or the CVS before the documentation is updated. Once | |
9 | the documentation is updated, this file is reduced to a short list. | |
10 | ||
7c6d71af | 11 | |
3fc596e4 NM |
12 | Version 4.72 |
13 | ------------ | |
14 | ||
b26eacf1 PP |
15 | 1. TWO SECURITY FIXES: one relating to mail-spools which are globally |
16 | writable, the other to locking of MBX folders (not mbox). | |
17 | ||
18 | 2. MySQL stored procedures are now supported. | |
19 | ||
20 | 3. The dkim_domain transport option is now a list, not a single string, and | |
21 | messages will be signed for each element in the list (discarding | |
22 | duplicates). | |
23 | ||
24 | 4. The 4.70 release unexpectedly changed the behaviour of dnsdb TXT lookups | |
25 | in the presence of multiple character strings within the RR. Prior to 4.70, | |
26 | only the first string would be returned. The dnsdb lookup now, by default, | |
27 | preserves the pre-4.70 semantics, but also now takes an extended output | |
8f425947 PP |
28 | separator specification. The separator can be followed by a semicolon, to |
29 | concatenate the individual text strings together with no join character, | |
30 | or by a comma and a second separator character, in which case the text | |
31 | strings within a TXT record are joined on that second character. | |
32 | Administrators are reminded that DNS provides no ordering guarantees | |
33 | between multiple records in an RRset. For example: | |
b26eacf1 PP |
34 | |
35 | foo.example. IN TXT "a" "b" "c" | |
36 | foo.example. IN TXT "d" "e" "f" | |
37 | ||
38 | ${lookup dnsdb{>/ txt=foo.example}} -> "a/d" | |
39 | ${lookup dnsdb{>/; txt=foo.example}} -> "def/abc" | |
8f425947 | 40 | ${lookup dnsdb{>/,+ txt=foo.example}} -> "a+b+c/d+e+f" |
b26eacf1 | 41 | |
3fc596e4 | 42 | |
f33253cc NM |
43 | Version 4.70 / 4.71 |
44 | ------------------- | |
65a7d8c3 | 45 | |
7c6d71af NM |
46 | 1. Native DKIM support without an external library. |
47 | ||
48 | 2. Experimental DCC support via dccifd (contributed by Wolfgang Breyha). | |
65a7d8c3 | 49 | |
f33253cc NM |
50 | 3. There is now a bool{} expansion condition which maps certain strings to |
51 | true/false condition values (most likely of use in conjuction with the | |
52 | and{} expansion operator). | |
53 | ||
54 | 4. The $spam_score, $spam_bar and $spam_report variables are now available | |
55 | at delivery time. | |
56 | ||
57 | 5. exim -bP now supports "macros", "macro_list" or "macro MACRO_NAME" as | |
58 | options, provided that Exim is invoked by an admin_user. | |
59 | ||
60 | 6. There is a new option gnutls_compat_mode, when linked against GnuTLS, | |
61 | which increases compatibility with older clients at the cost of decreased | |
62 | security. Don't set this unless you need to support such clients. | |
63 | ||
64 | 7. There is a new expansion operator, ${randint:...} which will produce a | |
65 | "random" number less than the supplied integer. This randomness is | |
66 | not guaranteed to be cryptographically strong, but depending upon how | |
67 | Exim was built may be better than the most naive schemes. | |
68 | ||
69 | 8. Exim now explicitly ensures that SHA256 is available when linked against | |
70 | OpenSSL. | |
71 | ||
72 | 9. The transport_filter_timeout option now applies to SMTP transports too. | |
73 | ||
65a7d8c3 | 74 | |
2b85bce7 PH |
75 | Version 4.68 |
76 | ------------ | |
77 | ||
78 | 1. The body_linecount and body_zerocount C variables are now exported in the | |
79 | local_scan API. | |
80 | ||
93655c46 PH |
81 | 2. When a dnslists lookup succeeds, the key that was looked up is now placed |
82 | in $dnslist_matched. When the key is an IP address, it is not reversed in | |
83 | this variable (though it is, of course, in the actual lookup). In simple | |
84 | cases, for example: | |
85 | ||
86 | deny dnslists = spamhaus.example | |
87 | ||
88 | the key is also available in another variable (in this case, | |
89 | $sender_host_address). In more complicated cases, however, this is not | |
90 | true. For example, using a data lookup might generate a dnslists lookup | |
91 | like this: | |
92 | ||
93 | deny dnslists = spamhaus.example/<|192.168.1.2|192.168.6.7|... | |
94 | ||
95 | If this condition succeeds, the value in $dnslist_matched might be | |
96 | 192.168.6.7 (for example). | |
97 | ||
6c512171 PH |
98 | 3. Authenticators now have a client_condition option. When Exim is running as |
99 | a client, it skips an authenticator whose client_condition expansion yields | |
100 | "0", "no", or "false". This can be used, for example, to skip plain text | |
101 | authenticators when the connection is not encrypted by a setting such as: | |
102 | ||
103 | client_condition = ${if !eq{$tls_cipher}{}} | |
104 | ||
105 | Note that the 4.67 documentation states that $tls_cipher contains the | |
106 | cipher used for incoming messages. In fact, during SMTP delivery, it | |
107 | contains the cipher used for the delivery. The same is true for | |
108 | $tls_peerdn. | |
109 | ||
a96603a0 PH |
110 | 4. There is now a -Mvc <message-id> option, which outputs a copy of the |
111 | message to the standard output, in RFC 2822 format. The option can be used | |
112 | only by an admin user. | |
113 | ||
8f240103 PH |
114 | 5. There is now a /noupdate option for the ratelimit ACL condition. It |
115 | computes the rate and checks the limit as normal, but it does not update | |
116 | the saved data. This means that, in relevant ACLs, it is possible to lookup | |
117 | the existence of a specified (or auto-generated) ratelimit key without | |
118 | incrementing the ratelimit counter for that key. | |
119 | ||
120 | In order for this to be useful, another ACL entry must set the rate | |
121 | for the same key somewhere (otherwise it will always be zero). | |
122 | ||
123 | Example: | |
124 | ||
125 | acl_check_connect: | |
126 | # Read the rate; if it doesn't exist or is below the maximum | |
127 | # we update it below | |
128 | deny ratelimit = 100 / 5m / strict / noupdate | |
129 | log_message = RATE: $sender_rate / $sender_rate_period \ | |
130 | (max $sender_rate_limit) | |
131 | ||
132 | [... some other logic and tests...] | |
133 | ||
134 | warn ratelimit = 100 / 5m / strict / per_cmd | |
135 | log_message = RATE UPDATE: $sender_rate / $sender_rate_period \ | |
136 | (max $sender_rate_limit) | |
137 | condition = ${if le{$sender_rate}{$sender_rate_limit}} | |
138 | ||
139 | accept | |
140 | ||
d677b2f2 PH |
141 | 6. The variable $max_received_linelength contains the number of bytes in the |
142 | longest line that was received as part of the message, not counting the | |
143 | line termination character(s). | |
144 | ||
d52120f2 PH |
145 | 7. Host lists can now include +ignore_defer and +include_defer, analagous to |
146 | +ignore_unknown and +include_unknown. These options should be used with | |
147 | care, probably only in non-critical host lists such as whitelists. | |
148 | ||
8669f003 PH |
149 | 8. There's a new option called queue_only_load_latch, which defaults true. |
150 | If set false when queue_only_load is greater than zero, Exim re-evaluates | |
151 | the load for each incoming message in an SMTP session. Otherwise, once one | |
152 | message is queued, the remainder are also. | |
153 | ||
4f054c63 | 154 | 9. There is a new ACL, specified by acl_smtp_notquit, which is run in most |
8f128379 PH |
155 | cases when an SMTP session ends without sending QUIT. However, when Exim |
156 | itself is is bad trouble, such as being unable to write to its log files, | |
157 | this ACL is not run, because it might try to do things (such as write to | |
158 | log files) that make the situation even worse. | |
159 | ||
160 | Like the QUIT ACL, this new ACL is provided to make it possible to gather | |
161 | statistics. Whatever it returns (accept or deny) is immaterial. The "delay" | |
162 | modifier is forbidden in this ACL. | |
163 | ||
164 | When the NOTQUIT ACL is running, the variable $smtp_notquit_reason is set | |
165 | to a string that indicates the reason for the termination of the SMTP | |
166 | connection. The possible values are: | |
167 | ||
168 | acl-drop Another ACL issued a "drop" command | |
169 | bad-commands Too many unknown or non-mail commands | |
170 | command-timeout Timeout while reading SMTP commands | |
171 | connection-lost The SMTP connection has been lost | |
172 | data-timeout Timeout while reading message data | |
173 | local-scan-error The local_scan() function crashed | |
174 | local-scan-timeout The local_scan() function timed out | |
175 | signal-exit SIGTERM or SIGINT | |
176 | synchronization-error SMTP synchronization error | |
177 | tls-failed TLS failed to start | |
178 | ||
179 | In most cases when an SMTP connection is closed without having received | |
180 | QUIT, Exim sends an SMTP response message before actually closing the | |
181 | connection. With the exception of acl-drop, the default message can be | |
182 | overridden by the "message" modifier in the NOTQUIT ACL. In the case of a | |
183 | "drop" verb in another ACL, it is the message from the other ACL that is | |
184 | used. | |
185 | ||
b7670459 PH |
186 | 10. For MySQL and PostgreSQL lookups, it is now possible to specify a list of |
187 | servers with individual queries. This is done by starting the query with | |
188 | "servers=x:y:z;", where each item in the list may take one of two forms: | |
189 | ||
190 | (1) If it is just a host name, the appropriate global option (mysql_servers | |
191 | or pgsql_servers) is searched for a host of the same name, and the | |
192 | remaining parameters (database, user, password) are taken from there. | |
193 | ||
194 | (2) If it contains any slashes, it is taken as a complete parameter set. | |
195 | ||
196 | The list of servers is used in exactly the same was as the global list. | |
197 | Once a connection to a server has happened and a query has been | |
198 | successfully executed, processing of the lookup ceases. | |
199 | ||
200 | This feature is intended for use in master/slave situations where updates | |
201 | are occurring, and one wants to update a master rather than a slave. If the | |
202 | masters are in the list for reading, you might have: | |
203 | ||
204 | mysql_servers = slave1/db/name/pw:slave2/db/name/pw:master/db/name/pw | |
205 | ||
206 | In an updating lookup, you could then write | |
207 | ||
208 | ${lookup mysql{servers=master; UPDATE ...} | |
209 | ||
210 | If, on the other hand, the master is not to be used for reading lookups: | |
211 | ||
212 | pgsql_servers = slave1/db/name/pw:slave2/db/name/pw | |
213 | ||
214 | you can still update the master by | |
215 | ||
216 | ${lookup pgsql{servers=master/db/name/pw; UPDATE ...} | |
217 | ||
ddea74fa PH |
218 | 11. The message_body_newlines option (default FALSE, for backwards |
219 | compatibility) can be used to control whether newlines are present in | |
220 | $message_body and $message_body_end. If it is FALSE, they are replaced by | |
221 | spaces. | |
222 | ||
2b85bce7 | 223 | |
b4ed4da0 PH |
224 | Version 4.67 |
225 | ------------ | |
226 | ||
227 | 1. There is a new log selector called smtp_no_mail, which is not included in | |
228 | the default setting. When it is set, a line is written to the main log | |
229 | whenever an accepted SMTP connection terminates without having issued a | |
4aa45c31 | 230 | MAIL command. |
b4ed4da0 | 231 | |
431b7361 | 232 | 2. When an item in a dnslists list is followed by = and & and a list of IP |
4aa45c31 PH |
233 | addresses, the behaviour was not clear when the lookup returned more than |
234 | one IP address. This has been solved by the addition of == and =& for "all" | |
93655c46 | 235 | rather than the default "any" matching. |
431b7361 | 236 | |
4aa45c31 PH |
237 | 3. Up till now, the only control over which cipher suites GnuTLS uses has been |
238 | for the cipher algorithms. New options have been added to allow some of the | |
239 | other parameters to be varied. | |
431b7361 | 240 | |
4aa45c31 PH |
241 | 4. There is a new compile-time option called ENABLE_DISABLE_FSYNC. When it is |
242 | set, Exim compiles a runtime option called disable_fsync. | |
431b7361 | 243 | |
4aa45c31 | 244 | 5. There is a new variable called $smtp_count_at_connection_start. |
431b7361 | 245 | |
4aa45c31 | 246 | 6. There's a new control called no_pipelining. |
cf8b11a5 | 247 | |
41c7c167 | 248 | 7. There are two new variables called $sending_ip_address and $sending_port. |
4aa45c31 | 249 | These are set whenever an SMTP connection to another host has been set up. |
41c7c167 PH |
250 | |
251 | 8. The expansion of the helo_data option in the smtp transport now happens | |
4aa45c31 | 252 | after the connection to the server has been made. |
41c7c167 | 253 | |
9c57cbc0 | 254 | 9. There is a new expansion operator ${rfc2047d: that decodes strings that |
4aa45c31 | 255 | are encoded as per RFC 2047. |
9c57cbc0 | 256 | |
f3f065bb PH |
257 | 10. There is a new log selector called "pid", which causes the current process |
258 | id to be added to every log line, in square brackets, immediately after the | |
259 | time and date. | |
260 | ||
047bdd8c | 261 | 11. Exim has been modified so that it flushes SMTP output before implementing |
4c590bd1 PH |
262 | a delay in an ACL. It also flushes the output before performing a callout, |
263 | as this can take a substantial time. These behaviours can be disabled by | |
264 | obeying control = no_delay_flush or control = no_callout_flush, | |
4aa45c31 | 265 | respectively, at some earlier stage of the connection. |
047bdd8c | 266 | |
0ce9abe6 | 267 | 12. There are two new expansion conditions that iterate over a list. They are |
4aa45c31 | 268 | called forany and forall. |
0ce9abe6 | 269 | |
0e22dfd1 PH |
270 | 13. There's a new global option called dsn_from that can be used to vary the |
271 | contents of From: lines in bounces and other automatically generated | |
272 | messages ("delivery status notifications" - hence the name of the option). | |
0e22dfd1 | 273 | |
4aa45c31 | 274 | 14. The smtp transport has a new option called hosts_avoid_pipelining. |
c51b8e75 | 275 | |
75b1493f | 276 | 15. By default, exigrep does case-insensitive matches. There is now a -I option |
4aa45c31 | 277 | that makes it case-sensitive. |
29f89cad | 278 | |
4aa45c31 PH |
279 | 16. A number of new features ("addresses", "map", "filter", and "reduce") have |
280 | been added to string expansions to make it easier to process lists of | |
281 | items, typically addresses. | |
29f89cad | 282 | |
c3611384 PH |
283 | 17. There's a new ACL modifier called "continue". It does nothing of itself, |
284 | and processing of the ACL always continues with the next condition or | |
285 | modifier. It is provided so that the side effects of expanding its argument | |
4aa45c31 | 286 | can be used. |
c3611384 | 287 | |
ec95d1a6 | 288 | 18. It is now possible to use newline and other control characters (those with |
4aa45c31 | 289 | values less than 32, plus DEL) as separators in lists. |
ec95d1a6 | 290 | |
b2d5182b PH |
291 | 19. The exigrep utility now has a -v option, which inverts the matching |
292 | condition. | |
293 | ||
c456d9bb | 294 | 20. The host_find_failed option in the manualroute router can now be set to |
4aa45c31 | 295 | "ignore". |
c456d9bb | 296 | |
b4ed4da0 PH |
297 | |
298 | Version 4.66 | |
299 | ------------ | |
300 | ||
301 | No new features were added to 4.66. | |
302 | ||
303 | ||
304 | Version 4.65 | |
305 | ------------ | |
306 | ||
307 | No new features were added to 4.65. | |
308 | ||
38a0a95f PH |
309 | |
310 | Version 4.64 | |
311 | ------------ | |
312 | ||
af561417 PH |
313 | 1. ACL variables can now be given arbitrary names, as long as they start with |
314 | "acl_c" or "acl_m" (for connection variables and message variables), are at | |
315 | least six characters long, with the sixth character being either a digit or | |
883335dc | 316 | an underscore. |
af561417 PH |
317 | |
318 | 2. There is a new ACL modifier called log_reject_target. It makes it possible | |
883335dc | 319 | to specify which logs are used for messages about ACL rejections. |
af561417 PH |
320 | |
321 | 3. There is a new authenticator called "dovecot". This is an interface to the | |
322 | authentication facility of the Dovecot POP/IMAP server, which can support a | |
883335dc | 323 | number of authentication methods. |
af561417 PH |
324 | |
325 | 4. The variable $message_headers_raw provides a concatenation of all the | |
326 | messages's headers without any decoding. This is in contrast to | |
327 | $message_headers, which does RFC2047 decoding on the header contents. | |
328 | ||
883335dc PH |
329 | 5. In a DNS black list, if two domain names, comma-separated, are given, the |
330 | second is used first to do an initial check, making use of any IP value | |
331 | restrictions that are set. If there is a match, the first domain is used, | |
332 | without any IP value restrictions, to get the TXT record. | |
af561417 | 333 | |
883335dc | 334 | 6. All authenticators now have a server_condition option. |
af561417 PH |
335 | |
336 | 7. There is a new command-line option called -Mset. It is useful only in | |
337 | conjunction with -be (that is, when testing string expansions). It must be | |
338 | followed by a message id; Exim loads the given message from its spool | |
883335dc | 339 | before doing the expansions. |
af561417 PH |
340 | |
341 | 8. Another similar new command-line option is called -bem. It operates like | |
883335dc PH |
342 | -be except that it must be followed by the name of a file that contains a |
343 | message. | |
af561417 PH |
344 | |
345 | 9. When an address is delayed because of a 4xx response to a RCPT command, it | |
346 | is now the combination of sender and recipient that is delayed in | |
883335dc | 347 | subsequent queue runs until its retry time is reached. |
af561417 PH |
348 | |
349 | 10. Unary negation and the bitwise logical operators and, or, xor, not, and | |
883335dc | 350 | shift, have been added to the eval: and eval10: expansion items. |
48c7f9e2 | 351 | |
194cc0e4 PH |
352 | 11. The variables $interface_address and $interface_port have been renamed |
353 | as $received_ip_address and $received_port, to make it clear that they | |
354 | relate to message reception rather than delivery. (The old names remain | |
355 | available for compatibility.) | |
356 | ||
883335dc PH |
357 | 12. The "message" modifier can now be used on "accept" and "discard" acl verbs |
358 | to vary the message that is sent when an SMTP command is accepted. | |
4e88a19f | 359 | |
495ae4b0 | 360 | |
4608d683 PH |
361 | Version 4.63 |
362 | ------------ | |
363 | ||
364 | 1. There is a new Boolean option called filter_prepend_home for the redirect | |
38a0a95f | 365 | router. |
4608d683 | 366 | |
45b91596 PH |
367 | 2. There is a new acl, set by acl_not_smtp_start, which is run right at the |
368 | start of receiving a non-SMTP message, before any of the message has been | |
38a0a95f | 369 | read. |
45b91596 | 370 | |
a5bd321b PH |
371 | 3. When an SMTP error message is specified in a "message" modifier in an ACL, |
372 | or in a :fail: or :defer: message in a redirect router, Exim now checks the | |
38a0a95f | 373 | start of the message for an SMTP error code. |
a5bd321b | 374 | |
6ec97b1b | 375 | 4. There is a new parameter for LDAP lookups called "referrals", which takes |
38a0a95f | 376 | one of the settings "follow" (the default) or "nofollow". |
6ec97b1b | 377 | |
e22ca4ac JJ |
378 | 5. Version 20070721.2 of exipick now included, offering these new options: |
379 | --reverse | |
380 | After all other sorting options have bee processed, reverse order | |
381 | before displaying messages (-R is synonym). | |
382 | --random | |
383 | Randomize order of matching messages before displaying. | |
384 | --size | |
385 | Instead of displaying the matching messages, display the sum | |
386 | of their sizes. | |
387 | --sort <variable>[,<variable>...] | |
388 | Before displaying matching messages, sort the messages according to | |
389 | each messages value for each variable. | |
390 | --not | |
391 | Negate the value for every test (returns inverse output from the | |
392 | same criteria without --not). | |
393 | ||
4608d683 | 394 | |
1cce3af8 PH |
395 | Version 4.62 |
396 | ------------ | |
397 | ||
398 | 1. The ${readsocket expansion item now supports Internet domain sockets as well | |
399 | as Unix domain sockets. If the first argument begins "inet:", it must be of | |
400 | the form "inet:host:port". The port is mandatory; it may be a number or the | |
401 | name of a TCP port in /etc/services. The host may be a name, or it may be an | |
402 | IP address. An ip address may optionally be enclosed in square brackets. | |
403 | This is best for IPv6 addresses. For example: | |
404 | ||
405 | ${readsocket{inet:[::1]:1234}{<request data>}... | |
406 | ||
407 | Only a single host name may be given, but if looking it up yield more than | |
408 | one IP address, they are each tried in turn until a connection is made. Once | |
409 | a connection has been made, the behaviour is as for ${readsocket with a Unix | |
410 | domain socket. | |
411 | ||
f7fd3850 PH |
412 | 2. If a redirect router sets up file or pipe deliveries for more than one |
413 | incoming address, and the relevant transport has batch_max set greater than | |
414 | one, a batch delivery now occurs. | |
415 | ||
d6629cdc PH |
416 | 3. The appendfile transport has a new option called maildirfolder_create_regex. |
417 | Its value is a regular expression. For a maildir delivery, this is matched | |
418 | against the maildir directory; if it matches, Exim ensures that a | |
419 | maildirfolder file is created alongside the new, cur, and tmp directories. | |
420 | ||
1cce3af8 | 421 | |
7e66e54d PH |
422 | Version 4.61 |
423 | ------------ | |
424 | ||
4f578862 PH |
425 | The documentation is up-to-date for the 4.61 release. Major new features since |
426 | the 4.60 release are: | |
427 | ||
428 | . An option called disable_ipv6, to disable the use of IPv6 completely. | |
429 | ||
430 | . An increase in the number of ACL variables to 20 of each type. | |
431 | ||
432 | . A change to use $auth1, $auth2, and $auth3 in authenticators instead of $1, | |
433 | $2, $3, (though those are still set) because the numeric variables get used | |
434 | for other things in complicated expansions. | |
435 | ||
843a41e8 | 436 | . The default for rfc1413_query_timeout has been changed from 30s to 5s. |
4f578862 PH |
437 | |
438 | . It is possible to use setclassresources() on some BSD OS to control the | |
439 | resources used in pipe deliveries. | |
440 | ||
441 | . A new ACL modifier called add_header, which can be used with any verb. | |
442 | ||
443 | . More errors are detectable in retry rules. | |
444 | ||
445 | There are a number of other additions too. | |
71fafd95 | 446 | |
7e66e54d | 447 | |
425ae40f | 448 | Version 4.60 |
b5aea5e1 PH |
449 | ------------ |
450 | ||
425ae40f PH |
451 | The documentation is up-to-date for the 4.60 release. Major new features since |
452 | the 4.50 release are: | |
1a46a8c5 | 453 | |
425ae40f | 454 | . Support for SQLite. |
1a46a8c5 | 455 | |
425ae40f | 456 | . Support for IGNOREQUOTA in LMTP. |
1a46a8c5 | 457 | |
425ae40f | 458 | . Extensions to the "submission mode" features. |
1a46a8c5 | 459 | |
425ae40f | 460 | . Support for Client SMTP Authorization (CSA). |
1a46a8c5 | 461 | |
425ae40f | 462 | . Support for ratelimiting hosts and users. |
b5aea5e1 | 463 | |
425ae40f | 464 | . New expansion items to help with the BATV "prvs" scheme. |
b5aea5e1 | 465 | |
425ae40f | 466 | . A "match_ip" condition, that matches an IP address against a list. |
35edf2ff | 467 | |
425ae40f | 468 | There are many more minor changes. |
495ae4b0 PH |
469 | |
470 | **** |