Note about ratelimit resets.
[exim.git] / doc / doc-txt / NewStuff
CommitLineData
8f240103 1$Cambridge: exim/doc/doc-txt/NewStuff,v 1.151 2007/06/20 14:13:39 ph10 Exp $
495ae4b0
PH
2
3New Features in Exim
4--------------------
5
38a0a95f
PH
6This file contains descriptions of new features that have been added to Exim.
7Before a formal release, there may be quite a lot of detail so that people can
8test from the snapshots or the CVS before the documentation is updated. Once
9the documentation is updated, this file is reduced to a short list.
10
2b85bce7
PH
11Version 4.68
12------------
13
14 1. The body_linecount and body_zerocount C variables are now exported in the
15 local_scan API.
16
93655c46
PH
17 2. When a dnslists lookup succeeds, the key that was looked up is now placed
18 in $dnslist_matched. When the key is an IP address, it is not reversed in
19 this variable (though it is, of course, in the actual lookup). In simple
20 cases, for example:
21
22 deny dnslists = spamhaus.example
23
24 the key is also available in another variable (in this case,
25 $sender_host_address). In more complicated cases, however, this is not
26 true. For example, using a data lookup might generate a dnslists lookup
27 like this:
28
29 deny dnslists = spamhaus.example/<|192.168.1.2|192.168.6.7|...
30
31 If this condition succeeds, the value in $dnslist_matched might be
32 192.168.6.7 (for example).
33
6c512171
PH
34 3. Authenticators now have a client_condition option. When Exim is running as
35 a client, it skips an authenticator whose client_condition expansion yields
36 "0", "no", or "false". This can be used, for example, to skip plain text
37 authenticators when the connection is not encrypted by a setting such as:
38
39 client_condition = ${if !eq{$tls_cipher}{}}
40
41 Note that the 4.67 documentation states that $tls_cipher contains the
42 cipher used for incoming messages. In fact, during SMTP delivery, it
43 contains the cipher used for the delivery. The same is true for
44 $tls_peerdn.
45
a96603a0
PH
46 4. There is now a -Mvc <message-id> option, which outputs a copy of the
47 message to the standard output, in RFC 2822 format. The option can be used
48 only by an admin user.
49
8f240103
PH
50 5. There is now a /noupdate option for the ratelimit ACL condition. It
51 computes the rate and checks the limit as normal, but it does not update
52 the saved data. This means that, in relevant ACLs, it is possible to lookup
53 the existence of a specified (or auto-generated) ratelimit key without
54 incrementing the ratelimit counter for that key.
55
56 In order for this to be useful, another ACL entry must set the rate
57 for the same key somewhere (otherwise it will always be zero).
58
59 Example:
60
61 acl_check_connect:
62 # Read the rate; if it doesn't exist or is below the maximum
63 # we update it below
64 deny ratelimit = 100 / 5m / strict / noupdate
65 log_message = RATE: $sender_rate / $sender_rate_period \
66 (max $sender_rate_limit)
67
68 [... some other logic and tests...]
69
70 warn ratelimit = 100 / 5m / strict / per_cmd
71 log_message = RATE UPDATE: $sender_rate / $sender_rate_period \
72 (max $sender_rate_limit)
73 condition = ${if le{$sender_rate}{$sender_rate_limit}}
74
75 accept
76
2b85bce7 77
b4ed4da0
PH
78Version 4.67
79------------
80
81 1. There is a new log selector called smtp_no_mail, which is not included in
82 the default setting. When it is set, a line is written to the main log
83 whenever an accepted SMTP connection terminates without having issued a
4aa45c31 84 MAIL command.
b4ed4da0 85
431b7361 86 2. When an item in a dnslists list is followed by = and & and a list of IP
4aa45c31
PH
87 addresses, the behaviour was not clear when the lookup returned more than
88 one IP address. This has been solved by the addition of == and =& for "all"
93655c46 89 rather than the default "any" matching.
431b7361 90
4aa45c31
PH
91 3. Up till now, the only control over which cipher suites GnuTLS uses has been
92 for the cipher algorithms. New options have been added to allow some of the
93 other parameters to be varied.
431b7361 94
4aa45c31
PH
95 4. There is a new compile-time option called ENABLE_DISABLE_FSYNC. When it is
96 set, Exim compiles a runtime option called disable_fsync.
431b7361 97
4aa45c31 98 5. There is a new variable called $smtp_count_at_connection_start.
431b7361 99
4aa45c31 100 6. There's a new control called no_pipelining.
cf8b11a5 101
41c7c167 102 7. There are two new variables called $sending_ip_address and $sending_port.
4aa45c31 103 These are set whenever an SMTP connection to another host has been set up.
41c7c167
PH
104
105 8. The expansion of the helo_data option in the smtp transport now happens
4aa45c31 106 after the connection to the server has been made.
41c7c167 107
9c57cbc0 108 9. There is a new expansion operator ${rfc2047d: that decodes strings that
4aa45c31 109 are encoded as per RFC 2047.
9c57cbc0 110
f3f065bb
PH
11110. There is a new log selector called "pid", which causes the current process
112 id to be added to every log line, in square brackets, immediately after the
113 time and date.
114
047bdd8c 11511. Exim has been modified so that it flushes SMTP output before implementing
4c590bd1
PH
116 a delay in an ACL. It also flushes the output before performing a callout,
117 as this can take a substantial time. These behaviours can be disabled by
118 obeying control = no_delay_flush or control = no_callout_flush,
4aa45c31 119 respectively, at some earlier stage of the connection.
047bdd8c 120
0ce9abe6 12112. There are two new expansion conditions that iterate over a list. They are
4aa45c31 122 called forany and forall.
0ce9abe6 123
0e22dfd1
PH
12413. There's a new global option called dsn_from that can be used to vary the
125 contents of From: lines in bounces and other automatically generated
126 messages ("delivery status notifications" - hence the name of the option).
0e22dfd1 127
4aa45c31 12814. The smtp transport has a new option called hosts_avoid_pipelining.
c51b8e75 129
75b1493f 13015. By default, exigrep does case-insensitive matches. There is now a -I option
4aa45c31 131 that makes it case-sensitive.
29f89cad 132
4aa45c31
PH
13316. A number of new features ("addresses", "map", "filter", and "reduce") have
134 been added to string expansions to make it easier to process lists of
135 items, typically addresses.
29f89cad 136
c3611384
PH
13717. There's a new ACL modifier called "continue". It does nothing of itself,
138 and processing of the ACL always continues with the next condition or
139 modifier. It is provided so that the side effects of expanding its argument
4aa45c31 140 can be used.
c3611384 141
ec95d1a6 14218. It is now possible to use newline and other control characters (those with
4aa45c31 143 values less than 32, plus DEL) as separators in lists.
ec95d1a6 144
b2d5182b
PH
14519. The exigrep utility now has a -v option, which inverts the matching
146 condition.
147
c456d9bb 14820. The host_find_failed option in the manualroute router can now be set to
4aa45c31 149 "ignore".
c456d9bb 150
b4ed4da0
PH
151
152Version 4.66
153------------
154
155No new features were added to 4.66.
156
157
158Version 4.65
159------------
160
161No new features were added to 4.65.
162
38a0a95f
PH
163
164Version 4.64
165------------
166
af561417
PH
167 1. ACL variables can now be given arbitrary names, as long as they start with
168 "acl_c" or "acl_m" (for connection variables and message variables), are at
169 least six characters long, with the sixth character being either a digit or
883335dc 170 an underscore.
af561417
PH
171
172 2. There is a new ACL modifier called log_reject_target. It makes it possible
883335dc 173 to specify which logs are used for messages about ACL rejections.
af561417
PH
174
175 3. There is a new authenticator called "dovecot". This is an interface to the
176 authentication facility of the Dovecot POP/IMAP server, which can support a
883335dc 177 number of authentication methods.
af561417
PH
178
179 4. The variable $message_headers_raw provides a concatenation of all the
180 messages's headers without any decoding. This is in contrast to
181 $message_headers, which does RFC2047 decoding on the header contents.
182
883335dc
PH
183 5. In a DNS black list, if two domain names, comma-separated, are given, the
184 second is used first to do an initial check, making use of any IP value
185 restrictions that are set. If there is a match, the first domain is used,
186 without any IP value restrictions, to get the TXT record.
af561417 187
883335dc 188 6. All authenticators now have a server_condition option.
af561417
PH
189
190 7. There is a new command-line option called -Mset. It is useful only in
191 conjunction with -be (that is, when testing string expansions). It must be
192 followed by a message id; Exim loads the given message from its spool
883335dc 193 before doing the expansions.
af561417
PH
194
195 8. Another similar new command-line option is called -bem. It operates like
883335dc
PH
196 -be except that it must be followed by the name of a file that contains a
197 message.
af561417
PH
198
199 9. When an address is delayed because of a 4xx response to a RCPT command, it
200 is now the combination of sender and recipient that is delayed in
883335dc 201 subsequent queue runs until its retry time is reached.
af561417
PH
202
20310. Unary negation and the bitwise logical operators and, or, xor, not, and
883335dc 204 shift, have been added to the eval: and eval10: expansion items.
48c7f9e2 205
194cc0e4
PH
20611. The variables $interface_address and $interface_port have been renamed
207 as $received_ip_address and $received_port, to make it clear that they
208 relate to message reception rather than delivery. (The old names remain
209 available for compatibility.)
210
883335dc
PH
21112. The "message" modifier can now be used on "accept" and "discard" acl verbs
212 to vary the message that is sent when an SMTP command is accepted.
4e88a19f 213
495ae4b0 214
4608d683
PH
215Version 4.63
216------------
217
2181. There is a new Boolean option called filter_prepend_home for the redirect
38a0a95f 219 router.
4608d683 220
45b91596
PH
2212. There is a new acl, set by acl_not_smtp_start, which is run right at the
222 start of receiving a non-SMTP message, before any of the message has been
38a0a95f 223 read.
45b91596 224
a5bd321b
PH
2253. When an SMTP error message is specified in a "message" modifier in an ACL,
226 or in a :fail: or :defer: message in a redirect router, Exim now checks the
38a0a95f 227 start of the message for an SMTP error code.
a5bd321b 228
6ec97b1b 2294. There is a new parameter for LDAP lookups called "referrals", which takes
38a0a95f 230 one of the settings "follow" (the default) or "nofollow".
6ec97b1b 231
e22ca4ac
JJ
2325. Version 20070721.2 of exipick now included, offering these new options:
233 --reverse
234 After all other sorting options have bee processed, reverse order
235 before displaying messages (-R is synonym).
236 --random
237 Randomize order of matching messages before displaying.
238 --size
239 Instead of displaying the matching messages, display the sum
240 of their sizes.
241 --sort <variable>[,<variable>...]
242 Before displaying matching messages, sort the messages according to
243 each messages value for each variable.
244 --not
245 Negate the value for every test (returns inverse output from the
246 same criteria without --not).
247
4608d683 248
1cce3af8
PH
249Version 4.62
250------------
251
2521. The ${readsocket expansion item now supports Internet domain sockets as well
253 as Unix domain sockets. If the first argument begins "inet:", it must be of
254 the form "inet:host:port". The port is mandatory; it may be a number or the
255 name of a TCP port in /etc/services. The host may be a name, or it may be an
256 IP address. An ip address may optionally be enclosed in square brackets.
257 This is best for IPv6 addresses. For example:
258
259 ${readsocket{inet:[::1]:1234}{<request data>}...
260
261 Only a single host name may be given, but if looking it up yield more than
262 one IP address, they are each tried in turn until a connection is made. Once
263 a connection has been made, the behaviour is as for ${readsocket with a Unix
264 domain socket.
265
f7fd3850
PH
2662. If a redirect router sets up file or pipe deliveries for more than one
267 incoming address, and the relevant transport has batch_max set greater than
268 one, a batch delivery now occurs.
269
d6629cdc
PH
2703. The appendfile transport has a new option called maildirfolder_create_regex.
271 Its value is a regular expression. For a maildir delivery, this is matched
272 against the maildir directory; if it matches, Exim ensures that a
273 maildirfolder file is created alongside the new, cur, and tmp directories.
274
1cce3af8 275
7e66e54d
PH
276Version 4.61
277------------
278
4f578862
PH
279The documentation is up-to-date for the 4.61 release. Major new features since
280the 4.60 release are:
281
282. An option called disable_ipv6, to disable the use of IPv6 completely.
283
284. An increase in the number of ACL variables to 20 of each type.
285
286. A change to use $auth1, $auth2, and $auth3 in authenticators instead of $1,
287 $2, $3, (though those are still set) because the numeric variables get used
288 for other things in complicated expansions.
289
843a41e8 290. The default for rfc1413_query_timeout has been changed from 30s to 5s.
4f578862
PH
291
292. It is possible to use setclassresources() on some BSD OS to control the
293 resources used in pipe deliveries.
294
295. A new ACL modifier called add_header, which can be used with any verb.
296
297. More errors are detectable in retry rules.
298
299There are a number of other additions too.
71fafd95 300
7e66e54d 301
425ae40f 302Version 4.60
b5aea5e1
PH
303------------
304
425ae40f
PH
305The documentation is up-to-date for the 4.60 release. Major new features since
306the 4.50 release are:
1a46a8c5 307
425ae40f 308. Support for SQLite.
1a46a8c5 309
425ae40f 310. Support for IGNOREQUOTA in LMTP.
1a46a8c5 311
425ae40f 312. Extensions to the "submission mode" features.
1a46a8c5 313
425ae40f 314. Support for Client SMTP Authorization (CSA).
1a46a8c5 315
425ae40f 316. Support for ratelimiting hosts and users.
b5aea5e1 317
425ae40f 318. New expansion items to help with the BATV "prvs" scheme.
b5aea5e1 319
425ae40f 320. A "match_ip" condition, that matches an IP address against a list.
35edf2ff 321
425ae40f 322There are many more minor changes.
495ae4b0
PH
323
324****