Commit | Line | Data |
---|---|---|
495ae4b0 PH |
1 | New Features in Exim |
2 | -------------------- | |
3 | ||
38a0a95f PH |
4 | This file contains descriptions of new features that have been added to Exim. |
5 | Before a formal release, there may be quite a lot of detail so that people can | |
33f316f2 | 6 | test from the snapshots or the Git before the documentation is updated. Once |
38a0a95f PH |
7 | the documentation is updated, this file is reduced to a short list. |
8 | ||
40ed89b3 JH |
9 | Version 4.93 |
10 | ------------ | |
11 | ||
b53c265b | 12 | 1. An "external" authenticator, per RFC 4422 Appendix A. |
40ed89b3 | 13 | |
7f69e814 | 14 | 2. A JSON lookup type, and JSON variants of the forall/any expansion conditions. |
40ed89b3 | 15 | |
f1be21cf JH |
16 | 3. Variables $tls_in_cipher_std, $tls_out_cipher_std giving the RFC names |
17 | for ciphersuites. | |
18 | ||
049782c0 JH |
19 | 4. Log_selectors "msg_id" (on by default) and "msg_id_created". |
20 | ||
21 | ||
d99f54e4 JH |
22 | Version 4.92 |
23 | -------------- | |
24 | ||
bce15b62 JH |
25 | 1. ${l_header:<name>} and ${l_h:<name>} expansion items, giving a colon-sep |
26 | list when there are multiple headers having a given name. This matters | |
27 | when individual headers are wrapped onto multiple lines; with previous | |
28 | facilities hard to parse. | |
29 | ||
afdb5e9c JH |
30 | 2. The ${readsocket } expansion item now takes a "tls" option, doing the |
31 | obvious thing. | |
32 | ||
ee8b8090 JH |
33 | 3. EXPERIMENTAL_REQUIRETLS and EXPERIMENTAL_PIPE_CONNECT optional build |
34 | features. See the experimental.spec file. | |
8ac90765 | 35 | |
71c15846 JH |
36 | 4. If built with SUPPORT_I18N a "utf8_downconvert" option on the smtp transport. |
37 | ||
7c576fca JH |
38 | 5. A "pipelining" log_selector. |
39 | ||
8442641e | 40 | 6. Builtin macros for supported log_selector and openssl_options values. |
12263aa8 | 41 | |
8fdf20fd JH |
42 | 7. JSON variants of the ${extract } expansion item. |
43 | ||
ae8f9024 JH |
44 | 8. A "noutf8" debug option, for disabling the UTF-8 characters in debug output. |
45 | ||
b536a578 JH |
46 | 9. TCP Fast Open support on MacOS. |
47 | ||
d4fd1b83 | 48 | Version 4.91 |
47195144 JH |
49 | -------------- |
50 | ||
51 | 1. Dual-certificate stacks on servers now support OCSP stapling, under GnuTLS | |
52 | version 3.5.6 or later. | |
53 | ||
c0635b6d JH |
54 | 2. DANE is now supported under GnuTLS version 3.0.0 or later. Both GnuTLS and |
55 | OpenSSL versions are moved to mainline support from Experimental. | |
405074ad | 56 | New SMTP transport option "dane_require_tls_ciphers". |
899b8bbc | 57 | |
c11d665d JH |
58 | 3. Feature macros for the compiled-in set of malware scanner interfaces. |
59 | ||
7952eef9 JH |
60 | 4. SPF support is promoted from Experimental to mainline status. The template |
61 | src/EDITME makefile does not enable its inclusion. | |
62 | ||
306c6c77 | 63 | 5. Logging control for DKIM verification. The existing DKIM log line is |
2c47372f JH |
64 | controlled by a "dkim_verbose" selector which is _not_ enabled by default. |
65 | A new tag "DKIM=<domain>" is added to <= lines by default, controlled by | |
66 | a "dkim" log_selector. | |
67 | ||
306c6c77 JH |
68 | 6. Receive duration on <= lines, under a new log_selector "receive_time". |
69 | ||
66387a73 JH |
70 | 7. Options "ipv4_only" and "ipv4_prefer" on the dnslookup router and on |
71 | routing rules in the manualroute router. | |
72 | ||
9c29c48f JH |
73 | 8. Expansion item ${sha3:<string>} / ${sha3_<N>:<string>} now also supported |
74 | under OpenSSL version 1.1.1 or later. | |
75 | ||
286b9d5f | 76 | 9. DKIM operations can now use the Ed25519 algorithm in addition to RSA, under |
cb78c1a8 | 77 | GnuTLS 3.6.0 or OpenSSL 1.1.1 or later. |
286b9d5f | 78 | |
260958d6 JH |
79 | 10. Builtin feature-macros _CRYPTO_HASH_SHA3 and _CRYPTO_SIGN_ED25519, library |
80 | version dependent. | |
81 | ||
2be324ee JH |
82 | 11. "exim -bP macro <name>" returns caller-usable status. |
83 | ||
dfbcb5ac JH |
84 | 12. Expansion item ${authresults {<machine>}} for creating an |
85 | Authentication-Results: header. | |
86 | ||
617d3932 | 87 | 13. EXPERIMENTAL_ARC. See the experimental.spec file. |
ddd16464 | 88 | See also new util/renew-opendmarc-tlds.sh script for use with DMARC/ARC. |
617d3932 | 89 | |
c4b57fdd JH |
90 | 14: A dane:fail event, intended to facilitate reporting. |
91 | ||
07e347ab GF |
92 | 15. "Lightweight" support for Redis Cluster. Requires redis_servers list to |
93 | contain all the servers in the cluster, all of which must be reachable from | |
94 | the running exim instance. If the cluster has master/slave replication, the | |
95 | list must contain all the master and slave servers. | |
96 | ||
eb445b04 HSHR |
97 | 16. Add an option to the Avast scanner interface: "pass_unscanned". This |
98 | allows to treat unscanned files as clean. Files may be unscanned for | |
99 | several reasons: decompression bombs, broken archives. | |
100 | ||
47195144 | 101 | |
856d1e16 PP |
102 | Version 4.90 |
103 | ------------ | |
104 | ||
105 | 1. PKG_CONFIG_PATH can now be set in Local/Makefile; | |
106 | wildcards will be expanded, values are collapsed. | |
107 | ||
8de9db65 JH |
108 | 2. The ${readsocket } expansion now takes an option to not shutdown the |
109 | connection after sending the query string. The default remains to do so. | |
110 | ||
875512a3 JH |
111 | 3. An smtp transport option "hosts_noproxy_tls" to control whether multiple |
112 | deliveries on a single TCP connection can maintain a TLS connection | |
113 | open. By default disabled for all hosts, doing so saves the cost of | |
114 | making new TLS sessions, at the cost of having to proxy the data via | |
115 | another process. Logging is also affected. | |
116 | ||
71b32d41 ACK |
117 | 4. A malware connection type for the FPSCAND protocol. |
118 | ||
57cc2785 JH |
119 | 5. An option for recipient verify callouts to hold the connection open for |
120 | further recipients and for delivery. | |
121 | ||
6e411084 PP |
122 | 6. The reproducible build $SOURCE_DATE_EPOCH environment variable is now |
123 | supported. | |
124 | ||
328c5688 JH |
125 | 7. Optionally, an alternate format for spool data-files which matches the |
126 | wire format - meaning more efficient reception and transmission (at the | |
127 | cost of difficulty with standard Unix tools). Only used for messages | |
128 | received using the ESMTP CHUNKING option, and when a new main-section | |
129 | option "spool_wireformat" (false by default) is set. | |
130 | ||
f33875c3 PP |
131 | 8. New main configuration option "commandline_checks_require_admin" to |
132 | restrict who can use various introspection options. | |
133 | ||
d291c767 HSHR |
134 | 9. New option modifier "no_check" for quota and quota_filecount |
135 | appendfile transport. | |
136 | ||
a09f2942 JH |
137 | 10. Variable $smtp_command_history returning a comma-sep list of recent |
138 | SMTP commands. | |
139 | ||
0f1a8658 JH |
140 | 11. Millisecond timetamps in logs, on log_selector "millisec". Also affects |
141 | log elements QT, DT and D, and timstamps in debug output. | |
571b2715 | 142 | |
a2673768 JH |
143 | 12. TCP Fast Open logging. As a server, logs when the SMTP banner was sent |
144 | while still in SYN_RECV state; as a client logs when the connection | |
4a5cbaff | 145 | is opened with a TFO cookie. |
a2673768 | 146 | |
9e70917d | 147 | 13. DKIM support for multiple signing, by domain and/or key-selector. |
7c6ec81b | 148 | DKIM support for multiple hashes, and for alternate-identity tags. |
970424a5 | 149 | Builtin macro with default list of signed headers. |
484cc1a9 | 150 | Better syntax for specifying oversigning. |
cc55f420 JH |
151 | The DKIM ACL can override verification status, and status is visible in |
152 | the data ACL. | |
d73e45df | 153 | |
c4d5e329 HSHR |
154 | 14. Exipick understands -C|--config for an alternative Exim |
155 | configuration file. | |
156 | ||
4a5cbaff JH |
157 | 15. TCP Fast Open used, with data-on-SYN, for client SMTP via SOCKS5 proxy, |
158 | for ${readsocket } expansions, and for ClamAV. | |
159 | ||
9650d98a JH |
160 | 16. The "-be" expansion test mode now supports macros. Macros are expanded |
161 | in test lines, and new macros can be defined. | |
162 | ||
ba86e143 JH |
163 | 17. Support for server-side dual-certificate-stacks (eg. RSA + ECDSA). |
164 | ||
856d1e16 | 165 | |
fd047340 JH |
166 | Version 4.89 |
167 | ------------ | |
168 | ||
33f316f2 HSHR |
169 | 1. Allow relative config file names for ".include" |
170 | ||
64073d9c JH |
171 | 2. A main-section config option "debug_store" to control the checks on |
172 | variable locations during store-reset. Normally false but can be enabled | |
173 | when a memory corrution issue is suspected on a production system. | |
174 | ||
fd047340 | 175 | |
8d042305 JH |
176 | Version 4.88 |
177 | ------------ | |
178 | ||
fc16abb4 | 179 | 1. The new perl_taintmode option allows to run the embedded perl |
2f680c0c HSHR |
180 | interpreter in taint mode. |
181 | ||
fc16abb4 JH |
182 | 2. New log_selector: dnssec, adds a "DS" tag to acceptance and delivery lines. |
183 | ||
b0d68adc JH |
184 | 3. Speculative debugging, via a "kill" option to the "control=debug" ACL |
185 | modifier. | |
186 | ||
6e773413 JH |
187 | 4. New expansion item ${sha3:<string>} / ${sha3_<N>:<string>}. |
188 | N can be 224, 256 (default), 384, 512. | |
189 | With GnuTLS 3.5.0 or later, only. | |
190 | ||
f59aaaaa | 191 | 5. Facility for named queues: A command-line argument can specify |
55e70e76 | 192 | the queue name for a queue operation, and an ACL modifier can set |
0cd5fd23 JH |
193 | the queue to be used for a message. A $queue_name variable gives |
194 | visibility. | |
28b3821f | 195 | |
03ca21f8 JH |
196 | 6. New expansion operators base32/base32d. |
197 | ||
44bc8f0c | 198 | 7. The CHUNKING ESMTP extension from RFC 3030. May give some slight |
7e3ce68e | 199 | performance increase and network load decrease. Main config option |
15021e11 JH |
200 | chunking_advertise_hosts, and smtp transport option hosts_try_chunking |
201 | for control. | |
7e3ce68e | 202 | |
5bde3efa ACK |
203 | 8. LMDB lookup support, as Experimental. Patch supplied by Andrew Colin Kissa. |
204 | ||
3367f8c2 JH |
205 | 9. Expansion operator escape8bit, like escape but not touching newline etc.. |
206 | ||
fbbd45ff | 207 | 10. Feature macros, generated from compile options. All start with "_HAVE_" |
4945f557 | 208 | and go on with some roughly recognisable name. Driver macros, for |
383832ef | 209 | router, transport and authentication drivers; names starting with "_DRIVER_". |
4945f557 JH |
210 | Option macros, for each configuration-file option; all start with "_OPT_". |
211 | Use the "-bP macros" command-line option to see what is present. | |
fbbd45ff | 212 | |
dcb72db9 JH |
213 | 11. Integer values for options can take a "G" multiplier. |
214 | ||
ff5929e3 JH |
215 | 12. defer=pass option for the ACL control cutthrough_delivery, to reflect 4xx |
216 | returns from the target back to the initiator, rather than spooling the | |
217 | message. | |
218 | ||
317e40ac PP |
219 | 13. New built-in constants available for tls_dhparam and default changed. |
220 | ||
3369a853 ACK |
221 | 14. If built with EXPERIMENTAL_QUEUEFILE, a queuefile transport, for writing |
222 | out copies of the message spool files for use by 3rd-party scanners. | |
223 | ||
fb05276a JH |
224 | 15. A new option on the smtp transport, hosts_try_fastopen. If the system |
225 | supports it (on Linux it must be enabled in the kernel by the sysadmin) | |
226 | try to use RFC 7413 "TCP Fast Open". No data is sent on the SYN segment | |
227 | but it permits a peer that also supports the facility to send its SMTP | |
228 | banner immediately after the SYN,ACK segment rather then waiting for | |
229 | another ACK - so saving up to one roundtrip time. Because it requires | |
230 | previous communication with the peer (we save a cookie from it) this | |
f59aaaaa | 231 | will only become active on frequently-contacted destinations. |
fb05276a | 232 | |
446415f5 HSHR |
233 | 16. A new syslog_pid option to suppress PID duplication in syslog lines. |
234 | ||
8d042305 | 235 | |
0d9b78be JH |
236 | Version 4.87 |
237 | ------------ | |
238 | ||
f38917cc JH |
239 | 1. The ACL conditions regex and mime_regex now capture substrings |
240 | into numeric variables $regex1 to 9, like the "match" expansion condition. | |
241 | ||
055e2cb4 JH |
242 | 2. New $callout_address variable records the address used for a spam=, |
243 | malware= or verify= callout. | |
244 | ||
fa41615d JH |
245 | 3. Transports now take a "max_parallel" option, to limit concurrency. |
246 | ||
fc4a7f70 JH |
247 | 4. Expansion operators ${ipv6norm:<string>} and ${ipv6denorm:<string>}. |
248 | The latter expands to a 8-element colon-sep set of hex digits including | |
249 | leading zeroes. A trailing ipv4-style dotted-decimal set is converted | |
250 | to hex. Pure ipv4 addresses are converted to IPv4-mapped IPv6. | |
251 | The former operator strips leading zeroes and collapses the longest | |
252 | set of 0-groups to a double-colon. | |
253 | ||
240c288f JH |
254 | 5. New "-bP config" support, to dump the effective configuration. |
255 | ||
abe1010c JH |
256 | 6. New $dkim_key_length variable. |
257 | ||
9aa35e9c | 258 | 7. New base64d and base64 expansion items (the existing str2b64 being a |
59b87190 | 259 | synonym of the latter). Add support in base64 for certificates. |
9aa35e9c | 260 | |
62b7cd08 | 261 | 8. New main configuration option "bounce_return_linesize_limit" to |
f59aaaaa | 262 | avoid oversize bodies in bounces. The default value matches RFC |
62b7cd08 JH |
263 | limits. |
264 | ||
3615fa9a HSHR |
265 | 9. New $initial_cwd expansion variable. |
266 | ||
0d9b78be | 267 | |
71224040 JH |
268 | Version 4.86 |
269 | ------------ | |
270 | ||
271 | 1. Support for using the system standard CA bundle. | |
272 | ||
273 | 2. New expansion items $config_file, $config_dir, containing the file | |
274 | and directory name of the main configuration file. Also $exim_version. | |
275 | ||
b6fbf22d JH |
276 | 3. New "malware=" support for Avast. |
277 | ||
cc00f4af JH |
278 | 4. New "spam=" variant option for Rspamd. |
279 | ||
280 | 5. Assorted options on malware= and spam= scanners. | |
281 | ||
f59aaaaa | 282 | 6. A command-line option to write a comment into the logfile. |
cc00f4af | 283 | |
7eb6c37c | 284 | 7. If built with EXPERIMENTAL_SOCKS feature enabled, the smtp transport can |
3c8b3577 JH |
285 | be configured to make connections via socks5 proxies. |
286 | ||
287 | 8. If built with EXPERIMENTAL_INTERNATIONAL, support is included for | |
288 | the transmission of UTF-8 envelope addresses. | |
7eb6c37c | 289 | |
ed0512a1 JH |
290 | 9. If built with EXPERIMENTAL_INTERNATIONAL, an expansion item for a commonly |
291 | used encoding of Maildir folder names. | |
292 | ||
b3ef41c9 | 293 | 10. A logging option for slow DNS lookups. |
846430d9 | 294 | |
089fc87a JH |
295 | 11. New ${env {<variable>}} expansion. |
296 | ||
b3ef41c9 JH |
297 | 12. A non-SMTP authenticator using information from TLS client certificates. |
298 | ||
10ca4f1c | 299 | 13. Main option "tls_eccurve" for selecting an Elliptic Curve for TLS. |
65463bc9 | 300 | Patch originally by Wolfgang Breyha. |
10ca4f1c | 301 | |
09b80b4e JH |
302 | 14. Main option "dns_trust_aa" for trusting your local nameserver at the |
303 | same level as DNSSEC. | |
304 | ||
7eb6c37c | 305 | |
533fe9b8 TL |
306 | Version 4.85 |
307 | ------------ | |
308 | ||
309 | 1. If built with EXPERIMENTAL_DANE feature enabled, Exim will follow the | |
f59aaaaa | 310 | DANE SMTP draft to assess a secure chain of trust of the certificate |
533fe9b8 TL |
311 | used to establish the TLS connection based on a TLSA record in the |
312 | domain of the sender. | |
313 | ||
314 | 2. The EXPERIMENTAL_TPDA feature has been renamed to EXPERIMENTAL_EVENT | |
315 | and several new events have been created. The reason is because it has | |
316 | been expanded beyond just firing events during the transport phase. Any | |
317 | existing TPDA transport options will have to be rewritten to use a new | |
318 | $event_name expansion variable in a condition. Refer to the | |
319 | experimental-spec.txt for details and examples. | |
320 | ||
321 | 3. The EXPERIMENTAL_CERTNAMES features is an enhancement to verify that | |
322 | server certs used for TLS match the result of the MX lookup. It does | |
323 | not use the same mechanism as DANE. | |
324 | ||
325 | ||
1f0ebb98 TL |
326 | Version 4.84 |
327 | ------------ | |
328 | ||
329 | ||
6ece2e77 TL |
330 | Version 4.83 |
331 | ------------ | |
332 | ||
a3c86431 TL |
333 | 1. If built with the EXPERIMENTAL_PROXY feature enabled, Exim can be |
334 | configured to expect an initial header from a proxy that will make the | |
335 | actual external source IP:host be used in exim instead of the IP of the | |
336 | proxy that is connecting to it. | |
337 | ||
770747fd MFM |
338 | 2. New verify option header_names_ascii, which will check to make sure |
339 | there are no non-ASCII characters in header names. Exim itself handles | |
340 | those non-ASCII characters, but downstream apps may not, so Exim can | |
341 | detect and reject if those characters are present. | |
342 | ||
b9c2e32f AR |
343 | 3. New expansion operator ${utf8clean:string} to replace malformed UTF8 |
344 | codepoints with valid ones. | |
345 | ||
b1f8e4f8 JH |
346 | 4. New malware type "sock". Talks over a Unix or TCP socket, sending one |
347 | command line and matching a regex against the return data for trigger | |
007a2dee | 348 | and a second regex to extract malware_name. The mail spoolfile name can |
b1f8e4f8 JH |
349 | be included in the command line. |
350 | ||
dc4dc04e JH |
351 | 5. The smtp transport now supports options "tls_verify_hosts" and |
352 | "tls_try_verify_hosts". If either is set the certificate verification | |
353 | is split from the encryption operation. The default remains that a failed | |
354 | verification cancels the encryption. | |
214042d2 | 355 | |
deae092e HS |
356 | 6. New SERVERS override of default ldap server list. In the ACLs, an ldap |
357 | lookup can now set a list of servers to use that is different from the | |
358 | default list. | |
359 | ||
8d91c6dc LT |
360 | 7. New command-line option -C for exiqgrep to specify alternate exim.conf |
361 | file when searching the queue. | |
362 | ||
f2de3a33 | 363 | 8. OCSP now supports GnuTLS also, if you have version 3.1.3 or later of that. |
2b4a568d | 364 | |
578897ea JH |
365 | 9. Support for DNSSEC on outbound connections. |
366 | ||
9d1c15ef | 367 | 10. New variables "tls_(in,out)_(our,peer)cert" and expansion item |
6a8a60e0 | 368 | "certextract" to extract fields from them. Hash operators md5 and sha1 |
9ef9101c JH |
369 | work over them for generating fingerprints, and a new sha256 operator |
370 | for them added. | |
9d1c15ef | 371 | |
8ccd00b1 JH |
372 | 11. PRDR is now supported dy default. |
373 | ||
f2de3a33 JH |
374 | 12. OCSP stapling is now supported by default. |
375 | ||
376 | 13. If built with the EXPERIMENTAL_DSN feature enabled, Exim will output | |
4c04137d | 377 | Delivery Status Notification messages in MIME format, and negotiate |
f2de3a33 JH |
378 | DSN features per RFC 3461. |
379 | ||
6ece2e77 | 380 | |
2c422e6f | 381 | Version 4.82 |
98a90c36 PP |
382 | ------------ |
383 | ||
384 | 1. New command-line option -bI:sieve will list all supported sieve extensions | |
385 | of this Exim build on standard output, one per line. | |
386 | ManageSieve (RFC 5804) providers managing scripts for use by Exim should | |
387 | query this to establish the correct list to include in the protocol's | |
388 | SIEVE capability line. | |
389 | ||
12f69989 PP |
390 | 2. If the -n option is combined with the -bP option, then the name of an |
391 | emitted option is not output, only the value (if visible to you). | |
392 | For instance, "exim -n -bP pid_file_path" should just emit a pathname | |
393 | followed by a newline, and no other text. | |
394 | ||
54c90be1 PP |
395 | 3. When built with SUPPORT_TLS and USE_GNUTLS, the SMTP transport driver now |
396 | has a "tls_dh_min_bits" option, to set the minimum acceptable number of | |
397 | bits in the Diffie-Hellman prime offered by a server (in DH ciphersuites) | |
398 | acceptable for security. (Option accepted but ignored if using OpenSSL). | |
399 | Defaults to 1024, the old value. May be lowered only to 512, or raised as | |
400 | far as you like. Raising this may hinder TLS interoperability with other | |
401 | sites and is not currently recommended. Lowering this will permit you to | |
402 | establish a TLS session which is not as secure as you might like. | |
403 | ||
404 | Unless you really know what you are doing, leave it alone. | |
405 | ||
1f4a55da | 406 | 4. If not built with DISABLE_DNSSEC, Exim now has the main option |
0fbd9bff | 407 | dns_dnssec_ok; if set to 1 then Exim will initialise the resolver library |
1f4a55da PP |
408 | to send the DO flag to your recursive resolver. If you have a recursive |
409 | resolver, which can set the Authenticated Data (AD) flag in results, Exim | |
0fbd9bff PP |
410 | can now detect this. Exim does not perform validation itself, instead |
411 | relying upon a trusted path to the resolver. | |
1f4a55da PP |
412 | |
413 | Current status: work-in-progress; $sender_host_dnssec variable added. | |
414 | ||
36a3ae5f PP |
415 | 5. DSCP support for outbound connections: on a transport using the smtp driver, |
416 | set "dscp = ef", for instance, to cause the connections to have the relevant | |
13363eba PP |
417 | DSCP (IPv4 TOS or IPv6 TCLASS) value in the header. |
418 | ||
419 | Similarly for inbound connections, there is a new control modifier, dscp, | |
420 | so "warn control = dscp/ef" in the connect ACL, or after authentication. | |
421 | ||
422 | Supported values depend upon system libraries. "exim -bI:dscp" to list the | |
423 | ones Exim knows of. You can also set a raw number 0..0x3F. | |
36a3ae5f | 424 | |
f4ee74ac PP |
425 | 6. The -G command-line flag is no longer ignored; it is now equivalent to an |
426 | ACL setting "control = suppress_local_fixups". The -L command-line flag | |
427 | is now accepted and forces use of syslog, with the provided tag as the | |
428 | process name. A few other flags used by Sendmail are now accepted and | |
429 | ignored. | |
430 | ||
976b7e9f | 431 | 7. New cutthrough routing feature. Requested by a "control = cutthrough_delivery" |
4c04137d | 432 | ACL modifier; works for single-recipient mails which are received on and |
976b7e9f JH |
433 | deliverable via SMTP. Using the connection made for a recipient verify, |
434 | if requested before the verify, or a new one made for the purpose while | |
435 | the inbound connection is still active. The bulk of the mail item is copied | |
436 | direct from the inbound socket to the outbound (as well as the spool file). | |
437 | When the source notifies the end of data, the data acceptance by the destination | |
4c04137d | 438 | is negotiated before the acceptance is sent to the source. If the destination |
976b7e9f JH |
439 | does not accept the mail item, for example due to content-scanning, the item |
440 | is not accepted from the source and therefore there is no need to generate | |
441 | a bounce mail. This is of benefit when providing a secondary-MX service. | |
442 | The downside is that delays are under the control of the ultimate destination | |
443 | system not your own. | |
444 | ||
4c04137d | 445 | The Received-by: header on items delivered by cutthrough is generated |
042eb971 | 446 | early in reception rather than at the end; this will affect any timestamp |
976b7e9f JH |
447 | included. The log line showing delivery is recorded before that showing |
448 | reception; it uses a new ">>" tag instead of "=>". | |
06a6f4ed | 449 | |
976b7e9f JH |
450 | To support the feature, verify-callout connections can now use ESMTP and TLS. |
451 | The usual smtp transport options are honoured, plus a (new, default everything) | |
452 | hosts_verify_avoid_tls. | |
453 | ||
454 | New variable families named tls_in_cipher, tls_out_cipher etc. are introduced | |
455 | for specific access to the information for each connection. The old names | |
456 | are present for now but deprecated. | |
457 | ||
fcc8e047 | 458 | Not yet supported: IGNOREQUOTA, SIZE, PIPELINING. |
976b7e9f | 459 | |
a64a3dfa JH |
460 | 8. New expansion operators ${listnamed:name} to get the content of a named list |
461 | and ${listcount:string} to count the items in a list. | |
98a90c36 | 462 | |
2519e60d | 463 | 9. New global option "gnutls_allow_auto_pkcs11", defaults false. The GnuTLS |
a5f239e4 PP |
464 | rewrite in 4.80 combines with GnuTLS 2.12.0 or later, to autoload PKCS11 |
465 | modules. For some situations this is desirable, but we expect admin in | |
466 | those situations to know they want the feature. More commonly, it means | |
467 | that GUI user modules get loaded and are broken by the setuid Exim being | |
468 | unable to access files specified in environment variables and passed | |
469 | through, thus breakage. So we explicitly inhibit the PKCS11 initialisation | |
470 | unless this new option is set. | |
471 | ||
2519e60d TL |
472 | Some older OS's with earlier versions of GnuTLS might not have pkcs11 ability, |
473 | so have also added a build option which can be used to build Exim with GnuTLS | |
474 | but without trying to use any kind of PKCS11 support. Uncomment this in the | |
475 | Local/Makefile: | |
476 | ||
477 | AVOID_GNUTLS_PKCS11=yes | |
478 | ||
3e8abda0 | 479 | 10. The "acl = name" condition on an ACL now supports optional arguments. |
bef3ea7f JH |
480 | New expansion item "${acl {name}{arg}...}" and expansion condition |
481 | "acl {{name}{arg}...}" are added. In all cases up to nine arguments | |
482 | can be used, appearing in $acl_arg1 to $acl_arg9 for the called ACL. | |
483 | Variable $acl_narg contains the number of arguments. If the ACL sets | |
484 | a "message =" value this becomes the result of the expansion item, | |
485 | or the value of $value for the expansion condition. If the ACL returns | |
486 | accept the expansion condition is true; if reject, false. A defer | |
487 | return results in a forced fail. | |
a5f239e4 | 488 | |
846726c5 JH |
489 | 11. Routers and transports can now have multiple headers_add and headers_remove |
490 | option lines. The concatenated list is used. | |
491 | ||
e7568d51 TL |
492 | 12. New ACL modifier "remove_header" can remove headers before message gets |
493 | handled by routers/transports. | |
494 | ||
3a796370 JH |
495 | 13. New dnsdb lookup pseudo-type "a+". A sequence of "a6" (if configured), |
496 | "aaaa" and "a" lookups is done and the full set of results returned. | |
497 | ||
362145b5 | 498 | 14. New expansion variable $headers_added with content from ACL add_header |
85ffcba6 | 499 | modifier (but not yet added to message). |
362145b5 | 500 | |
bd0fff00 | 501 | 15. New 8bitmime status logging option for received messages. Log field "M8S". |
3c0a92dc | 502 | |
c8e2fc1e JH |
503 | 16. New authenticated_sender logging option, adding to log field "A". |
504 | ||
181d9bf8 | 505 | 17. New expansion variables $router_name and $transport_name. Useful |
f59aaaaa | 506 | particularly for debug_print as -bt command-line option does not |
2a47f028 | 507 | require privilege whereas -d does. |
181d9bf8 | 508 | |
fd98a5c6 JH |
509 | 18. If built with EXPERIMENTAL_PRDR, per-recipient data responses per a |
510 | proposed extension to SMTP from Eric Hall. | |
511 | ||
700d22f3 PP |
512 | 19. The pipe transport has gained the force_command option, to allow |
513 | decorating commands from user .forward pipe aliases with prefix | |
514 | wrappers, for instance. | |
515 | ||
fcc8e047 JH |
516 | 20. Callout connections can now AUTH; the same controls as normal delivery |
517 | connections apply. | |
518 | ||
b1f37849 TL |
519 | 21. Support for DMARC, using opendmarc libs, can be enabled. It adds new |
520 | options: dmarc_forensic_sender, dmarc_history_file, and dmarc_tld_file. | |
521 | It adds new expansion variables $dmarc_ar_header, $dmarc_status, | |
522 | $dmarc_status_text, and $dmarc_used_domain. It adds a new acl modifier | |
523 | dmarc_status. It adds new control flags dmarc_disable_verify and | |
687cac44 HSHR |
524 | dmarc_enable_forensic. The default for the dmarc_tld_file option is |
525 | "/etc/exim/opendmarc.tlds" and can be changed via EDITME. | |
b1f37849 TL |
526 | |
527 | 22. Add expansion variable $authenticated_fail_id, which is the username | |
528 | provided to the authentication method which failed. It is available | |
529 | for use in subsequent ACL processing (typically quit or notquit ACLs). | |
530 | ||
4c04137d | 531 | 23. New ACL modifier "udpsend" can construct a UDP packet to send to a given |
7142daca PP |
532 | UDP host and port. |
533 | ||
534 | 24. New ${hexquote:..string..} expansion operator converts non-printable | |
535 | characters in the string to \xNN form. | |
536 | ||
1a7b746d TL |
537 | 25. Experimental TPDA (Transport Post Delivery Action) function added. |
538 | Patch provided by Axel Rau. | |
539 | ||
4dd78911 TL |
540 | 26. Experimental Redis lookup added. Patch provided by Warren Baker. |
541 | ||
181d9bf8 | 542 | |
b1770b6e | 543 | Version 4.80 |
c1e794ba PP |
544 | ------------ |
545 | ||
546 | 1. New authenticator driver, "gsasl". Server-only (at present). | |
547 | This is a SASL interface, licensed under GPL, which can be found at | |
548 | http://www.gnu.org/software/gsasl/. | |
549 | This system does not provide sources of data for authentication, so | |
3b4f55a3 | 550 | careful use needs to be made of the conditions in Exim. |
c1e794ba | 551 | |
97753960 PP |
552 | 2. New authenticator driver, "heimdal_gssapi". Server-only. |
553 | A replacement for using cyrus_sasl with Heimdal, now that $KRB5_KTNAME | |
554 | is no longer honoured for setuid programs by Heimdal. Use the | |
555 | "server_keytab" option to point to the keytab. | |
556 | ||
252e0c7b PP |
557 | 3. The "pkg-config" system can now be used when building Exim to reference |
558 | cflags and library information for lookups and authenticators, rather | |
559 | than having to update "CFLAGS", "AUTH_LIBS", "LOOKUP_INCLUDE" and | |
7e6a8985 PP |
560 | "LOOKUP_LIBS" directly. Similarly for handling the TLS library support |
561 | without adjusting "TLS_INCLUDE" and "TLS_LIBS". | |
252e0c7b | 562 | |
6a6084f8 PP |
563 | In addition, setting PCRE_CONFIG=yes will query the pcre-config tool to |
564 | find the headers and libraries for PCRE. | |
565 | ||
f1e05cc7 | 566 | 4. New expansion variable $tls_bits. |
20aa9dbd | 567 | |
4a6a987a PP |
568 | 5. New lookup type, "dbmjz". Key is an Exim list, the elements of which will |
569 | be joined together with ASCII NUL characters to construct the key to pass | |
3b4f55a3 PP |
570 | into the DBM library. Can be used with gsasl to access sasldb2 files as |
571 | used by Cyrus SASL. | |
4a6a987a | 572 | |
da3ad30d PP |
573 | 6. OpenSSL now supports TLS1.1 and TLS1.2 with OpenSSL 1.0.1. |
574 | ||
575 | Avoid release 1.0.1a if you can. Note that the default value of | |
576 | "openssl_options" is no longer "+dont_insert_empty_fragments", as that | |
577 | increased susceptibility to attack. This may still have interoperability | |
578 | implications for very old clients (see version 4.31 change 37) but | |
579 | administrators can choose to make the trade-off themselves and restore | |
580 | compatibility at the cost of session security. | |
581 | ||
7be682ca PP |
582 | 7. Use of the new expansion variable $tls_sni in the main configuration option |
583 | tls_certificate will cause Exim to re-expand the option, if the client | |
584 | sends the TLS Server Name Indication extension, to permit choosing a | |
585 | different certificate; tls_privatekey will also be re-expanded. You must | |
586 | still set these options to expand to valid files when $tls_sni is not set. | |
3f0945ff PP |
587 | |
588 | The SMTP Transport has gained the option tls_sni, which will set a hostname | |
589 | for outbound TLS sessions, and set $tls_sni too. | |
590 | ||
591 | A new log_selector, +tls_sni, has been added, to log received SNI values | |
592 | for Exim as a server. | |
593 | ||
9cbad13b PP |
594 | 8. The existing "accept_8bitmime" option now defaults to true. This means |
595 | that Exim is deliberately not strictly RFC compliant. We're following | |
596 | Dan Bernstein's advice in http://cr.yp.to/smtp/8bitmime.html by default. | |
597 | Those who disagree, or know that they are talking to mail servers that, | |
598 | even today, are not 8-bit clean, need to turn off this option. | |
599 | ||
9ee44efb PP |
600 | 9. Exim can now be started with -bw (with an optional timeout, given as |
601 | -bw<timespec>). With this, stdin at startup is a socket that is | |
602 | already listening for connections. This has a more modern name of | |
603 | "socket activation", but forcing the activated socket to fd 0. We're | |
604 | interested in adding more support for modern variants. | |
605 | ||
eae0036b | 606 | 10. ${eval } now uses 64-bit values on supporting platforms. A new "G" suffix |
97d17305 JH |
607 | for numbers indicates multiplication by 1024^3. |
608 | ||
17c76198 PP |
609 | 11. The GnuTLS support has been revamped; the three options gnutls_require_kx, |
610 | gnutls_require_mac & gnutls_require_protocols are no longer supported. | |
611 | tls_require_ciphers is now parsed by gnutls_priority_init(3) as a priority | |
612 | string, documentation for which is at: | |
42bfef1e | 613 | http://www.gnutls.org/manual/html_node/Priority-Strings.html |
17c76198 PP |
614 | |
615 | SNI support has been added to Exim's GnuTLS integration too. | |
616 | ||
af3498d6 PP |
617 | For sufficiently recent GnuTLS libraries, ${randint:..} will now use |
618 | gnutls_rnd(), asking for GNUTLS_RND_NONCE level randomness. | |
619 | ||
53947857 | 620 | 12. With OpenSSL, if built with EXPERIMENTAL_OCSP, a new option tls_ocsp_file |
3f7eeb86 PP |
621 | is now available. If the contents of the file are valid, then Exim will |
622 | send that back in response to a TLS status request; this is OCSP Stapling. | |
623 | Exim will not maintain the contents of the file in any way: administrators | |
624 | are responsible for ensuring that it is up-to-date. | |
625 | ||
626 | See "experimental-spec.txt" for more details. | |
627 | ||
eae0036b PP |
628 | 13. ${lookup dnsdb{ }} supports now SPF record types. They are handled |
629 | identically to TXT record lookups. | |
630 | ||
2605c55b | 631 | 14. New expansion variable $tod_epoch_l for higher-precision time. |
c1e794ba | 632 | |
3375e053 PP |
633 | 15. New global option tls_dh_max_bits, defaulting to current value of NSS |
634 | hard-coded limit of DH ephemeral bits, to fix interop problems caused by | |
635 | GnuTLS 2.12 library recommending a bit count higher than NSS supports. | |
636 | ||
a799883d PP |
637 | 16. tls_dhparam now used by both OpenSSL and GnuTLS, can be path or identifier. |
638 | Option can now be a path or an identifier for a standard prime. | |
639 | If unset, we use the DH prime from section 2.2 of RFC 5114, "ike23". | |
640 | Set to "historic" to get the old GnuTLS behaviour of auto-generated DH | |
641 | primes. | |
642 | ||
3ecab157 | 643 | 17. SSLv2 now disabled by default in OpenSSL. (Never supported by GnuTLS). |
f0f5a555 PP |
644 | Use "openssl_options -no_sslv2" to re-enable support, if your OpenSSL |
645 | install was not built with OPENSSL_NO_SSL2 ("no-ssl2"). | |
646 | ||
9e45c72b | 647 | |
3ce96ada TF |
648 | Version 4.77 |
649 | ------------ | |
650 | ||
651 | 1. New options for the ratelimit ACL condition: /count= and /unique=. | |
652 | The /noupdate option has been replaced by a /readonly option. | |
653 | ||
061b7ebd PP |
654 | 2. The SMTP transport's protocol option may now be set to "smtps", to |
655 | use SSL-on-connect outbound. | |
656 | ||
9e949f00 PP |
657 | 3. New variable $av_failed, set true if the AV scanner deferred; ie, when |
658 | there is a problem talking to the AV scanner, or the AV scanner running. | |
659 | ||
39257585 PP |
660 | 4. New expansion conditions, "inlist" and "inlisti", which take simple lists |
661 | and check if the search item is a member of the list. This does not | |
662 | support named lists, but does subject the list part to string expansion. | |
663 | ||
664 | 5. Unless the new EXPAND_LISTMATCH_RHS build option is set when Exim was | |
665 | built, Exim no longer performs string expansion on the second string of | |
666 | the match_* expansion conditions: "match_address", "match_domain", | |
667 | "match_ip" & "match_local_part". Named lists can still be used. | |
668 | ||
7c6d71af | 669 | |
e97d1f08 PP |
670 | Version 4.76 |
671 | ------------ | |
672 | ||
673 | 1. The global option "dns_use_edns0" may be set to coerce EDNS0 usage on | |
674 | or off in the resolver library. | |
675 | ||
676 | ||
bc19a55b PP |
677 | Version 4.75 |
678 | ------------ | |
679 | ||
680 | 1. In addition to the existing LDAP and LDAP/SSL ("ldaps") support, there | |
681 | is now LDAP/TLS support, given sufficiently modern OpenLDAP client | |
682 | libraries. The following global options have been added in support of | |
683 | this: ldap_ca_cert_dir, ldap_ca_cert_file, ldap_cert_file, ldap_cert_key, | |
684 | ldap_cipher_suite, ldap_require_cert, ldap_start_tls. | |
685 | ||
2fe76745 PP |
686 | 2. The pipe transport now takes a boolean option, "freeze_signal", default |
687 | false. When true, if the external delivery command exits on a signal then | |
688 | Exim will freeze the message in the queue, instead of generating a bounce. | |
689 | ||
f1e5fef5 PP |
690 | 3. Log filenames may now use %M as an escape, instead of %D (still available). |
691 | The %M pattern expands to yyyymm, providing month-level resolution. | |
692 | ||
332f5cf3 PP |
693 | 4. The $message_linecount variable is now updated for the maildir_tag option, |
694 | in the same way as $message_size, to reflect the real number of lines, | |
695 | including any header additions or removals from transport. | |
696 | ||
29cfeb94 PP |
697 | 5. When contacting a pool of SpamAssassin servers configured in spamd_address, |
698 | Exim now selects entries randomly, to better scale in a cluster setup. | |
699 | ||
bc19a55b | 700 | |
a01ba081 PP |
701 | Version 4.74 |
702 | ------------ | |
703 | ||
1670ef10 PP |
704 | 1. SECURITY FIX: privilege escalation flaw fixed. On Linux (and only Linux) |
705 | the flaw permitted the Exim run-time user to cause root to append to | |
706 | arbitrary files of the attacker's choosing, with the content based | |
707 | on content supplied by the attacker. | |
708 | ||
709 | 2. Exim now supports loading some lookup types at run-time, using your | |
a01ba081 PP |
710 | platform's dlopen() functionality. This has limited platform support |
711 | and the intention is not to support every variant, it's limited to | |
712 | dlopen(). This permits the main Exim binary to not be linked against | |
713 | all the libraries needed for all the lookup types. | |
714 | ||
715 | ||
77bb000f PP |
716 | Version 4.73 |
717 | ------------ | |
718 | ||
2cfd3221 PP |
719 | NOTE: this version is not guaranteed backwards-compatible, please read the |
720 | items below carefully | |
721 | ||
77bb000f PP |
722 | 1. A new main configuration option, "openssl_options", is available if Exim |
723 | is built with SSL support provided by OpenSSL. The option allows | |
724 | administrators to specify OpenSSL options to be used on connections; | |
725 | typically this is to set bug compatibility features which the OpenSSL | |
726 | developers have not enabled by default. There may be security | |
727 | consequences for certain options, so these should not be changed | |
728 | frivolously. | |
729 | ||
a29e5231 PP |
730 | 2. A new pipe transport option, "permit_coredumps", may help with problem |
731 | diagnosis in some scenarios. Note that Exim is typically installed as | |
732 | a setuid binary, which on most OSes will inhibit coredumps by default, | |
43236f35 | 733 | so that safety mechanism would have to be overridden for this option to |
a29e5231 PP |
734 | be able to take effect. |
735 | ||
8544e77a PP |
736 | 3. ClamAV 0.95 is now required for ClamAV support in Exim, unless |
737 | Local/Makefile sets: WITH_OLD_CLAMAV_STREAM=yes | |
738 | Note that this switches Exim to use a new API ("INSTREAM") and a future | |
739 | release of ClamAV will remove support for the old API ("STREAM"). | |
740 | ||
741 | The av_scanner option, when set to "clamd", now takes an optional third | |
742 | part, "local", which causes Exim to pass a filename to ClamAV instead of | |
743 | the file content. This is the same behaviour as when clamd is pointed at | |
744 | a Unix-domain socket. For example: | |
745 | ||
746 | av_scanner = clamd:192.0.2.3 1234:local | |
747 | ||
491fab4c PP |
748 | ClamAV's ExtendedDetectionInfo response format is now handled. |
749 | ||
8544e77a PP |
750 | 4. There is now a -bmalware option, restricted to admin users. This option |
751 | takes one parameter, a filename, and scans that file with Exim's | |
752 | malware-scanning framework. This is intended purely as a debugging aid | |
753 | to ensure that Exim's scanning is working, not to replace other tools. | |
a9622bc6 PP |
754 | Note that the ACL framework is not invoked, so if av_scanner references |
755 | ACL variables without a fallback then this will fail. | |
8544e77a | 756 | |
83e029d5 PP |
757 | 5. There is a new expansion operator, "reverse_ip", which will reverse IP |
758 | addresses; IPv4 into dotted quad, IPv6 into dotted nibble. Examples: | |
759 | ||
760 | ${reverse_ip:192.0.2.4} | |
761 | -> 4.2.0.192 | |
762 | ${reverse_ip:2001:0db8:c42:9:1:abcd:192.0.2.3} | |
763 | -> 3.0.2.0.0.0.0.c.d.c.b.a.1.0.0.0.9.0.0.0.2.4.c.0.8.b.d.0.1.0.0.2 | |
764 | ||
ed7f7860 PP |
765 | 6. There is a new ACL control called "debug", to enable debug logging. |
766 | This allows selective logging of certain incoming transactions within | |
767 | production environments, with some care. It takes two options, "tag" | |
768 | and "opts"; "tag" is included in the filename of the log and "opts" | |
769 | is used as per the -d<options> command-line option. Examples, which | |
770 | don't all make sense in all contexts: | |
771 | ||
772 | control = debug | |
773 | control = debug/tag=.$sender_host_address | |
774 | control = debug/opts=+expand+acl | |
775 | control = debug/tag=.$message_exim_id/opts=+expand | |
776 | ||
10385c15 PP |
777 | 7. It has always been implicit in the design and the documentation that |
778 | "the Exim user" is not root. src/EDITME said that using root was | |
779 | "very strongly discouraged". This is not enough to keep people from | |
780 | shooting themselves in the foot in days when many don't configure Exim | |
781 | themselves but via package build managers. The security consequences of | |
782 | running various bits of network code are severe if there should be bugs in | |
783 | them. As such, the Exim user may no longer be root. If configured | |
784 | statically, Exim will refuse to build. If configured as ref:user then Exim | |
785 | will exit shortly after start-up. If you must shoot yourself in the foot, | |
786 | then henceforth you will have to maintain your own local patches to strip | |
787 | the safeties off. | |
788 | ||
06a6f4ed | 789 | 8. There is a new expansion condition, bool_lax{}. Where bool{} uses the ACL |
6a8de854 PP |
790 | condition logic to determine truth/failure and will fail to expand many |
791 | strings, bool_lax{} uses the router condition logic, where most strings | |
792 | do evaluate true. | |
793 | Note: bool{00} is false, bool_lax{00} is true. | |
794 | ||
06a6f4ed | 795 | 9. Routers now support multiple "condition" tests. |
532be449 | 796 | |
5dc43717 JJ |
797 | 10. There is now a runtime configuration option "tcp_wrappers_daemon_name". |
798 | Setting this allows an admin to define which entry in the tcpwrappers | |
799 | config file will be used to control access to the daemon. This option | |
800 | is only available when Exim is built with USE_TCP_WRAPPERS. The | |
801 | default value is set at build time using the TCP_WRAPPERS_DAEMON_NAME | |
802 | build option. | |
803 | ||
79d4bc3d PP |
804 | 11. [POSSIBLE CONFIG BREAKAGE] The default value for system_filter_user is now |
805 | the Exim run-time user, instead of root. | |
806 | ||
2cfd3221 PP |
807 | 12. [POSSIBLE CONFIG BREAKAGE] ALT_CONFIG_ROOT_ONLY is no longer optional and |
808 | is forced on. This is mitigated by the new build option | |
90b6341f | 809 | TRUSTED_CONFIG_LIST which defines a list of configuration files which |
7f7f0545 DW |
810 | are trusted; one per line. If a config file is owned by root and matches |
811 | a pathname in the list, then it may be invoked by the Exim build-time | |
812 | user without Exim relinquishing root privileges. | |
2cfd3221 PP |
813 | |
814 | 13. [POSSIBLE CONFIG BREAKAGE] The Exim user is no longer automatically | |
815 | trusted to supply -D<Macro[=Value]> overrides on the command-line. Going | |
90b6341f DW |
816 | forward, we recommend using TRUSTED_CONFIG_LIST with shim configs that |
817 | include the main config. As a transition mechanism, we are temporarily | |
818 | providing a work-around: the new build option WHITELIST_D_MACROS provides | |
43236f35 | 819 | a colon-separated list of macro names which may be overridden by the Exim |
90b6341f DW |
820 | run-time user. The values of these macros are constrained to the regex |
821 | ^[A-Za-z0-9_/.-]*$ (which explicitly does allow for empty values). | |
2cfd3221 | 822 | |
77bb000f | 823 | |
3fc596e4 NM |
824 | Version 4.72 |
825 | ------------ | |
826 | ||
b26eacf1 PP |
827 | 1. TWO SECURITY FIXES: one relating to mail-spools which are globally |
828 | writable, the other to locking of MBX folders (not mbox). | |
829 | ||
830 | 2. MySQL stored procedures are now supported. | |
831 | ||
832 | 3. The dkim_domain transport option is now a list, not a single string, and | |
833 | messages will be signed for each element in the list (discarding | |
834 | duplicates). | |
835 | ||
836 | 4. The 4.70 release unexpectedly changed the behaviour of dnsdb TXT lookups | |
837 | in the presence of multiple character strings within the RR. Prior to 4.70, | |
838 | only the first string would be returned. The dnsdb lookup now, by default, | |
839 | preserves the pre-4.70 semantics, but also now takes an extended output | |
8f425947 PP |
840 | separator specification. The separator can be followed by a semicolon, to |
841 | concatenate the individual text strings together with no join character, | |
842 | or by a comma and a second separator character, in which case the text | |
843 | strings within a TXT record are joined on that second character. | |
844 | Administrators are reminded that DNS provides no ordering guarantees | |
845 | between multiple records in an RRset. For example: | |
b26eacf1 PP |
846 | |
847 | foo.example. IN TXT "a" "b" "c" | |
848 | foo.example. IN TXT "d" "e" "f" | |
849 | ||
850 | ${lookup dnsdb{>/ txt=foo.example}} -> "a/d" | |
851 | ${lookup dnsdb{>/; txt=foo.example}} -> "def/abc" | |
8f425947 | 852 | ${lookup dnsdb{>/,+ txt=foo.example}} -> "a+b+c/d+e+f" |
b26eacf1 | 853 | |
3fc596e4 | 854 | |
f33253cc NM |
855 | Version 4.70 / 4.71 |
856 | ------------------- | |
65a7d8c3 | 857 | |
7c6d71af | 858 | 1. Native DKIM support without an external library. |
a8c8d6b5 JJ |
859 | (Note that if no action to prevent it is taken, a straight upgrade will |
860 | result in DKIM verification of all signed incoming emails. See spec | |
861 | for details on conditionally disabling) | |
7c6d71af NM |
862 | |
863 | 2. Experimental DCC support via dccifd (contributed by Wolfgang Breyha). | |
65a7d8c3 | 864 | |
f33253cc | 865 | 3. There is now a bool{} expansion condition which maps certain strings to |
7d9f747b | 866 | true/false condition values (most likely of use in conjunction with the |
f33253cc NM |
867 | and{} expansion operator). |
868 | ||
869 | 4. The $spam_score, $spam_bar and $spam_report variables are now available | |
870 | at delivery time. | |
871 | ||
872 | 5. exim -bP now supports "macros", "macro_list" or "macro MACRO_NAME" as | |
873 | options, provided that Exim is invoked by an admin_user. | |
874 | ||
875 | 6. There is a new option gnutls_compat_mode, when linked against GnuTLS, | |
876 | which increases compatibility with older clients at the cost of decreased | |
877 | security. Don't set this unless you need to support such clients. | |
878 | ||
879 | 7. There is a new expansion operator, ${randint:...} which will produce a | |
880 | "random" number less than the supplied integer. This randomness is | |
881 | not guaranteed to be cryptographically strong, but depending upon how | |
882 | Exim was built may be better than the most naive schemes. | |
883 | ||
884 | 8. Exim now explicitly ensures that SHA256 is available when linked against | |
885 | OpenSSL. | |
886 | ||
887 | 9. The transport_filter_timeout option now applies to SMTP transports too. | |
888 | ||
65a7d8c3 | 889 | |
7d9f747b PP |
890 | Version 4.69 |
891 | ------------ | |
892 | ||
893 | 1. Preliminary DKIM support in Experimental. | |
894 | ||
895 | ||
2b85bce7 PH |
896 | Version 4.68 |
897 | ------------ | |
898 | ||
899 | 1. The body_linecount and body_zerocount C variables are now exported in the | |
900 | local_scan API. | |
901 | ||
93655c46 PH |
902 | 2. When a dnslists lookup succeeds, the key that was looked up is now placed |
903 | in $dnslist_matched. When the key is an IP address, it is not reversed in | |
904 | this variable (though it is, of course, in the actual lookup). In simple | |
905 | cases, for example: | |
906 | ||
907 | deny dnslists = spamhaus.example | |
908 | ||
909 | the key is also available in another variable (in this case, | |
910 | $sender_host_address). In more complicated cases, however, this is not | |
911 | true. For example, using a data lookup might generate a dnslists lookup | |
912 | like this: | |
913 | ||
914 | deny dnslists = spamhaus.example/<|192.168.1.2|192.168.6.7|... | |
915 | ||
916 | If this condition succeeds, the value in $dnslist_matched might be | |
917 | 192.168.6.7 (for example). | |
918 | ||
6c512171 PH |
919 | 3. Authenticators now have a client_condition option. When Exim is running as |
920 | a client, it skips an authenticator whose client_condition expansion yields | |
921 | "0", "no", or "false". This can be used, for example, to skip plain text | |
922 | authenticators when the connection is not encrypted by a setting such as: | |
923 | ||
924 | client_condition = ${if !eq{$tls_cipher}{}} | |
925 | ||
926 | Note that the 4.67 documentation states that $tls_cipher contains the | |
927 | cipher used for incoming messages. In fact, during SMTP delivery, it | |
928 | contains the cipher used for the delivery. The same is true for | |
929 | $tls_peerdn. | |
930 | ||
a96603a0 PH |
931 | 4. There is now a -Mvc <message-id> option, which outputs a copy of the |
932 | message to the standard output, in RFC 2822 format. The option can be used | |
933 | only by an admin user. | |
934 | ||
8f240103 PH |
935 | 5. There is now a /noupdate option for the ratelimit ACL condition. It |
936 | computes the rate and checks the limit as normal, but it does not update | |
937 | the saved data. This means that, in relevant ACLs, it is possible to lookup | |
938 | the existence of a specified (or auto-generated) ratelimit key without | |
939 | incrementing the ratelimit counter for that key. | |
940 | ||
941 | In order for this to be useful, another ACL entry must set the rate | |
942 | for the same key somewhere (otherwise it will always be zero). | |
943 | ||
944 | Example: | |
945 | ||
946 | acl_check_connect: | |
947 | # Read the rate; if it doesn't exist or is below the maximum | |
948 | # we update it below | |
949 | deny ratelimit = 100 / 5m / strict / noupdate | |
950 | log_message = RATE: $sender_rate / $sender_rate_period \ | |
951 | (max $sender_rate_limit) | |
952 | ||
953 | [... some other logic and tests...] | |
954 | ||
955 | warn ratelimit = 100 / 5m / strict / per_cmd | |
956 | log_message = RATE UPDATE: $sender_rate / $sender_rate_period \ | |
957 | (max $sender_rate_limit) | |
958 | condition = ${if le{$sender_rate}{$sender_rate_limit}} | |
959 | ||
960 | accept | |
961 | ||
d677b2f2 PH |
962 | 6. The variable $max_received_linelength contains the number of bytes in the |
963 | longest line that was received as part of the message, not counting the | |
964 | line termination character(s). | |
965 | ||
aded2255 | 966 | 7. Host lists can now include +ignore_defer and +include_defer, analogous to |
d52120f2 PH |
967 | +ignore_unknown and +include_unknown. These options should be used with |
968 | care, probably only in non-critical host lists such as whitelists. | |
969 | ||
8669f003 PH |
970 | 8. There's a new option called queue_only_load_latch, which defaults true. |
971 | If set false when queue_only_load is greater than zero, Exim re-evaluates | |
972 | the load for each incoming message in an SMTP session. Otherwise, once one | |
973 | message is queued, the remainder are also. | |
974 | ||
4f054c63 | 975 | 9. There is a new ACL, specified by acl_smtp_notquit, which is run in most |
8f128379 PH |
976 | cases when an SMTP session ends without sending QUIT. However, when Exim |
977 | itself is is bad trouble, such as being unable to write to its log files, | |
978 | this ACL is not run, because it might try to do things (such as write to | |
979 | log files) that make the situation even worse. | |
980 | ||
981 | Like the QUIT ACL, this new ACL is provided to make it possible to gather | |
982 | statistics. Whatever it returns (accept or deny) is immaterial. The "delay" | |
983 | modifier is forbidden in this ACL. | |
984 | ||
985 | When the NOTQUIT ACL is running, the variable $smtp_notquit_reason is set | |
986 | to a string that indicates the reason for the termination of the SMTP | |
987 | connection. The possible values are: | |
988 | ||
989 | acl-drop Another ACL issued a "drop" command | |
990 | bad-commands Too many unknown or non-mail commands | |
991 | command-timeout Timeout while reading SMTP commands | |
992 | connection-lost The SMTP connection has been lost | |
993 | data-timeout Timeout while reading message data | |
994 | local-scan-error The local_scan() function crashed | |
995 | local-scan-timeout The local_scan() function timed out | |
996 | signal-exit SIGTERM or SIGINT | |
997 | synchronization-error SMTP synchronization error | |
998 | tls-failed TLS failed to start | |
999 | ||
1000 | In most cases when an SMTP connection is closed without having received | |
1001 | QUIT, Exim sends an SMTP response message before actually closing the | |
1002 | connection. With the exception of acl-drop, the default message can be | |
1003 | overridden by the "message" modifier in the NOTQUIT ACL. In the case of a | |
1004 | "drop" verb in another ACL, it is the message from the other ACL that is | |
1005 | used. | |
1006 | ||
b7670459 PH |
1007 | 10. For MySQL and PostgreSQL lookups, it is now possible to specify a list of |
1008 | servers with individual queries. This is done by starting the query with | |
1009 | "servers=x:y:z;", where each item in the list may take one of two forms: | |
1010 | ||
1011 | (1) If it is just a host name, the appropriate global option (mysql_servers | |
1012 | or pgsql_servers) is searched for a host of the same name, and the | |
1013 | remaining parameters (database, user, password) are taken from there. | |
1014 | ||
1015 | (2) If it contains any slashes, it is taken as a complete parameter set. | |
1016 | ||
1017 | The list of servers is used in exactly the same was as the global list. | |
1018 | Once a connection to a server has happened and a query has been | |
1019 | successfully executed, processing of the lookup ceases. | |
1020 | ||
1021 | This feature is intended for use in master/slave situations where updates | |
1022 | are occurring, and one wants to update a master rather than a slave. If the | |
1023 | masters are in the list for reading, you might have: | |
1024 | ||
1025 | mysql_servers = slave1/db/name/pw:slave2/db/name/pw:master/db/name/pw | |
1026 | ||
1027 | In an updating lookup, you could then write | |
1028 | ||
1029 | ${lookup mysql{servers=master; UPDATE ...} | |
1030 | ||
1031 | If, on the other hand, the master is not to be used for reading lookups: | |
1032 | ||
1033 | pgsql_servers = slave1/db/name/pw:slave2/db/name/pw | |
1034 | ||
1035 | you can still update the master by | |
1036 | ||
1037 | ${lookup pgsql{servers=master/db/name/pw; UPDATE ...} | |
1038 | ||
ddea74fa PH |
1039 | 11. The message_body_newlines option (default FALSE, for backwards |
1040 | compatibility) can be used to control whether newlines are present in | |
1041 | $message_body and $message_body_end. If it is FALSE, they are replaced by | |
1042 | spaces. | |
1043 | ||
2b85bce7 | 1044 | |
b4ed4da0 PH |
1045 | Version 4.67 |
1046 | ------------ | |
1047 | ||
1048 | 1. There is a new log selector called smtp_no_mail, which is not included in | |
1049 | the default setting. When it is set, a line is written to the main log | |
1050 | whenever an accepted SMTP connection terminates without having issued a | |
4aa45c31 | 1051 | MAIL command. |
b4ed4da0 | 1052 | |
431b7361 | 1053 | 2. When an item in a dnslists list is followed by = and & and a list of IP |
4aa45c31 PH |
1054 | addresses, the behaviour was not clear when the lookup returned more than |
1055 | one IP address. This has been solved by the addition of == and =& for "all" | |
93655c46 | 1056 | rather than the default "any" matching. |
431b7361 | 1057 | |
4aa45c31 PH |
1058 | 3. Up till now, the only control over which cipher suites GnuTLS uses has been |
1059 | for the cipher algorithms. New options have been added to allow some of the | |
1060 | other parameters to be varied. | |
431b7361 | 1061 | |
4aa45c31 PH |
1062 | 4. There is a new compile-time option called ENABLE_DISABLE_FSYNC. When it is |
1063 | set, Exim compiles a runtime option called disable_fsync. | |
431b7361 | 1064 | |
4aa45c31 | 1065 | 5. There is a new variable called $smtp_count_at_connection_start. |
431b7361 | 1066 | |
4aa45c31 | 1067 | 6. There's a new control called no_pipelining. |
cf8b11a5 | 1068 | |
41c7c167 | 1069 | 7. There are two new variables called $sending_ip_address and $sending_port. |
4aa45c31 | 1070 | These are set whenever an SMTP connection to another host has been set up. |
41c7c167 PH |
1071 | |
1072 | 8. The expansion of the helo_data option in the smtp transport now happens | |
4aa45c31 | 1073 | after the connection to the server has been made. |
41c7c167 | 1074 | |
9c57cbc0 | 1075 | 9. There is a new expansion operator ${rfc2047d: that decodes strings that |
4aa45c31 | 1076 | are encoded as per RFC 2047. |
9c57cbc0 | 1077 | |
f3f065bb PH |
1078 | 10. There is a new log selector called "pid", which causes the current process |
1079 | id to be added to every log line, in square brackets, immediately after the | |
1080 | time and date. | |
1081 | ||
047bdd8c | 1082 | 11. Exim has been modified so that it flushes SMTP output before implementing |
4c590bd1 PH |
1083 | a delay in an ACL. It also flushes the output before performing a callout, |
1084 | as this can take a substantial time. These behaviours can be disabled by | |
1085 | obeying control = no_delay_flush or control = no_callout_flush, | |
4aa45c31 | 1086 | respectively, at some earlier stage of the connection. |
047bdd8c | 1087 | |
0ce9abe6 | 1088 | 12. There are two new expansion conditions that iterate over a list. They are |
4aa45c31 | 1089 | called forany and forall. |
0ce9abe6 | 1090 | |
0e22dfd1 PH |
1091 | 13. There's a new global option called dsn_from that can be used to vary the |
1092 | contents of From: lines in bounces and other automatically generated | |
1093 | messages ("delivery status notifications" - hence the name of the option). | |
0e22dfd1 | 1094 | |
4aa45c31 | 1095 | 14. The smtp transport has a new option called hosts_avoid_pipelining. |
c51b8e75 | 1096 | |
75b1493f | 1097 | 15. By default, exigrep does case-insensitive matches. There is now a -I option |
4aa45c31 | 1098 | that makes it case-sensitive. |
29f89cad | 1099 | |
4aa45c31 PH |
1100 | 16. A number of new features ("addresses", "map", "filter", and "reduce") have |
1101 | been added to string expansions to make it easier to process lists of | |
1102 | items, typically addresses. | |
29f89cad | 1103 | |
c3611384 PH |
1104 | 17. There's a new ACL modifier called "continue". It does nothing of itself, |
1105 | and processing of the ACL always continues with the next condition or | |
1106 | modifier. It is provided so that the side effects of expanding its argument | |
4aa45c31 | 1107 | can be used. |
c3611384 | 1108 | |
ec95d1a6 | 1109 | 18. It is now possible to use newline and other control characters (those with |
4aa45c31 | 1110 | values less than 32, plus DEL) as separators in lists. |
ec95d1a6 | 1111 | |
b2d5182b PH |
1112 | 19. The exigrep utility now has a -v option, which inverts the matching |
1113 | condition. | |
1114 | ||
c456d9bb | 1115 | 20. The host_find_failed option in the manualroute router can now be set to |
4aa45c31 | 1116 | "ignore". |
c456d9bb | 1117 | |
b4ed4da0 PH |
1118 | |
1119 | Version 4.66 | |
1120 | ------------ | |
1121 | ||
1122 | No new features were added to 4.66. | |
1123 | ||
1124 | ||
1125 | Version 4.65 | |
1126 | ------------ | |
1127 | ||
1128 | No new features were added to 4.65. | |
1129 | ||
38a0a95f PH |
1130 | |
1131 | Version 4.64 | |
1132 | ------------ | |
1133 | ||
af561417 PH |
1134 | 1. ACL variables can now be given arbitrary names, as long as they start with |
1135 | "acl_c" or "acl_m" (for connection variables and message variables), are at | |
1136 | least six characters long, with the sixth character being either a digit or | |
883335dc | 1137 | an underscore. |
af561417 PH |
1138 | |
1139 | 2. There is a new ACL modifier called log_reject_target. It makes it possible | |
883335dc | 1140 | to specify which logs are used for messages about ACL rejections. |
af561417 PH |
1141 | |
1142 | 3. There is a new authenticator called "dovecot". This is an interface to the | |
1143 | authentication facility of the Dovecot POP/IMAP server, which can support a | |
883335dc | 1144 | number of authentication methods. |
af561417 PH |
1145 | |
1146 | 4. The variable $message_headers_raw provides a concatenation of all the | |
1147 | messages's headers without any decoding. This is in contrast to | |
1148 | $message_headers, which does RFC2047 decoding on the header contents. | |
1149 | ||
883335dc PH |
1150 | 5. In a DNS black list, if two domain names, comma-separated, are given, the |
1151 | second is used first to do an initial check, making use of any IP value | |
1152 | restrictions that are set. If there is a match, the first domain is used, | |
1153 | without any IP value restrictions, to get the TXT record. | |
af561417 | 1154 | |
883335dc | 1155 | 6. All authenticators now have a server_condition option. |
af561417 PH |
1156 | |
1157 | 7. There is a new command-line option called -Mset. It is useful only in | |
1158 | conjunction with -be (that is, when testing string expansions). It must be | |
1159 | followed by a message id; Exim loads the given message from its spool | |
883335dc | 1160 | before doing the expansions. |
af561417 PH |
1161 | |
1162 | 8. Another similar new command-line option is called -bem. It operates like | |
883335dc PH |
1163 | -be except that it must be followed by the name of a file that contains a |
1164 | message. | |
af561417 PH |
1165 | |
1166 | 9. When an address is delayed because of a 4xx response to a RCPT command, it | |
1167 | is now the combination of sender and recipient that is delayed in | |
883335dc | 1168 | subsequent queue runs until its retry time is reached. |
af561417 PH |
1169 | |
1170 | 10. Unary negation and the bitwise logical operators and, or, xor, not, and | |
883335dc | 1171 | shift, have been added to the eval: and eval10: expansion items. |
48c7f9e2 | 1172 | |
194cc0e4 PH |
1173 | 11. The variables $interface_address and $interface_port have been renamed |
1174 | as $received_ip_address and $received_port, to make it clear that they | |
1175 | relate to message reception rather than delivery. (The old names remain | |
1176 | available for compatibility.) | |
1177 | ||
883335dc PH |
1178 | 12. The "message" modifier can now be used on "accept" and "discard" acl verbs |
1179 | to vary the message that is sent when an SMTP command is accepted. | |
4e88a19f | 1180 | |
495ae4b0 | 1181 | |
4608d683 PH |
1182 | Version 4.63 |
1183 | ------------ | |
1184 | ||
1185 | 1. There is a new Boolean option called filter_prepend_home for the redirect | |
38a0a95f | 1186 | router. |
4608d683 | 1187 | |
45b91596 PH |
1188 | 2. There is a new acl, set by acl_not_smtp_start, which is run right at the |
1189 | start of receiving a non-SMTP message, before any of the message has been | |
38a0a95f | 1190 | read. |
45b91596 | 1191 | |
a5bd321b PH |
1192 | 3. When an SMTP error message is specified in a "message" modifier in an ACL, |
1193 | or in a :fail: or :defer: message in a redirect router, Exim now checks the | |
38a0a95f | 1194 | start of the message for an SMTP error code. |
a5bd321b | 1195 | |
6ec97b1b | 1196 | 4. There is a new parameter for LDAP lookups called "referrals", which takes |
38a0a95f | 1197 | one of the settings "follow" (the default) or "nofollow". |
6ec97b1b | 1198 | |
e22ca4ac JJ |
1199 | 5. Version 20070721.2 of exipick now included, offering these new options: |
1200 | --reverse | |
1201 | After all other sorting options have bee processed, reverse order | |
1202 | before displaying messages (-R is synonym). | |
1203 | --random | |
1204 | Randomize order of matching messages before displaying. | |
1205 | --size | |
1206 | Instead of displaying the matching messages, display the sum | |
1207 | of their sizes. | |
1208 | --sort <variable>[,<variable>...] | |
1209 | Before displaying matching messages, sort the messages according to | |
1210 | each messages value for each variable. | |
1211 | --not | |
1212 | Negate the value for every test (returns inverse output from the | |
1213 | same criteria without --not). | |
1214 | ||
4608d683 | 1215 | |
1cce3af8 PH |
1216 | Version 4.62 |
1217 | ------------ | |
1218 | ||
1219 | 1. The ${readsocket expansion item now supports Internet domain sockets as well | |
1220 | as Unix domain sockets. If the first argument begins "inet:", it must be of | |
1221 | the form "inet:host:port". The port is mandatory; it may be a number or the | |
1222 | name of a TCP port in /etc/services. The host may be a name, or it may be an | |
1223 | IP address. An ip address may optionally be enclosed in square brackets. | |
1224 | This is best for IPv6 addresses. For example: | |
1225 | ||
1226 | ${readsocket{inet:[::1]:1234}{<request data>}... | |
1227 | ||
1228 | Only a single host name may be given, but if looking it up yield more than | |
1229 | one IP address, they are each tried in turn until a connection is made. Once | |
1230 | a connection has been made, the behaviour is as for ${readsocket with a Unix | |
1231 | domain socket. | |
1232 | ||
f7fd3850 PH |
1233 | 2. If a redirect router sets up file or pipe deliveries for more than one |
1234 | incoming address, and the relevant transport has batch_max set greater than | |
1235 | one, a batch delivery now occurs. | |
1236 | ||
d6629cdc PH |
1237 | 3. The appendfile transport has a new option called maildirfolder_create_regex. |
1238 | Its value is a regular expression. For a maildir delivery, this is matched | |
1239 | against the maildir directory; if it matches, Exim ensures that a | |
1240 | maildirfolder file is created alongside the new, cur, and tmp directories. | |
1241 | ||
1cce3af8 | 1242 | |
7e66e54d PH |
1243 | Version 4.61 |
1244 | ------------ | |
1245 | ||
4f578862 PH |
1246 | The documentation is up-to-date for the 4.61 release. Major new features since |
1247 | the 4.60 release are: | |
1248 | ||
1249 | . An option called disable_ipv6, to disable the use of IPv6 completely. | |
1250 | ||
1251 | . An increase in the number of ACL variables to 20 of each type. | |
1252 | ||
1253 | . A change to use $auth1, $auth2, and $auth3 in authenticators instead of $1, | |
1254 | $2, $3, (though those are still set) because the numeric variables get used | |
1255 | for other things in complicated expansions. | |
1256 | ||
843a41e8 | 1257 | . The default for rfc1413_query_timeout has been changed from 30s to 5s. |
4f578862 PH |
1258 | |
1259 | . It is possible to use setclassresources() on some BSD OS to control the | |
1260 | resources used in pipe deliveries. | |
1261 | ||
1262 | . A new ACL modifier called add_header, which can be used with any verb. | |
1263 | ||
1264 | . More errors are detectable in retry rules. | |
1265 | ||
1266 | There are a number of other additions too. | |
71fafd95 | 1267 | |
7e66e54d | 1268 | |
425ae40f | 1269 | Version 4.60 |
b5aea5e1 PH |
1270 | ------------ |
1271 | ||
425ae40f PH |
1272 | The documentation is up-to-date for the 4.60 release. Major new features since |
1273 | the 4.50 release are: | |
1a46a8c5 | 1274 | |
425ae40f | 1275 | . Support for SQLite. |
1a46a8c5 | 1276 | |
425ae40f | 1277 | . Support for IGNOREQUOTA in LMTP. |
1a46a8c5 | 1278 | |
425ae40f | 1279 | . Extensions to the "submission mode" features. |
1a46a8c5 | 1280 | |
425ae40f | 1281 | . Support for Client SMTP Authorization (CSA). |
1a46a8c5 | 1282 | |
425ae40f | 1283 | . Support for ratelimiting hosts and users. |
b5aea5e1 | 1284 | |
425ae40f | 1285 | . New expansion items to help with the BATV "prvs" scheme. |
b5aea5e1 | 1286 | |
425ae40f | 1287 | . A "match_ip" condition, that matches an IP address against a list. |
35edf2ff | 1288 | |
425ae40f | 1289 | There are many more minor changes. |
495ae4b0 PH |
1290 | |
1291 | **** |