
     W...W
     W.W.W
     .W.W.

     WaterGate
     Message processor for FidoNet & Internet/Usenet
     New features and changes

     Copyright (c) 1993-1997 Waterline Software Development
                             All Rights Reserved


This document contains a list of new features and changes made to
the WaterGate package between version 0.92.p5 and 0.93.

Instead of a totally uninteresting detailed list of over 500 changes
and bug fixes, it instead describes each of group of changes and
leaves out all the minor details. Each program is discussed
separately.


New features
============

* OS/2 version of the entire package. Effective 32-bit code and can be
  started from both a DOS or CMD prompt on OS/2 v2.1 or later.

* Minimum required machine is now an IBM PC/XT. WtrConf, WtrUtil and
  WtrTest can be run on an XT. From the WtrGate version, only the
  overlay one can be run on an XT.

* Now supporting 128 groups instead of 26. Groups are named A1,A2,A3,
  A4,A5, B1,B2,B3,B4,B5, etc. up to Y5, then Z1,Z2,Z3. The idea is to
  use one letter per network and use the five "under groups" for
  echomail, sysop areas, some read-only areas, etc.

* Gateway now produces MIME compliant messages. Single part only for
  the moment. Quoted-printable is used for 8 bit data. When including
  an attached file, quoted-printable is used unless UU-encoding is
  getting more efficient. No unnecessary headers are added when not
  required.

* Support for multiple character sets on both the FTN and RFC sides.
  Transparent character set translation in the gateway instead that
  one fixed FTN to RFC mapping for the upper 128 characters. The new
  CHARSETS.TDB file (ASCII) describes all known character sets and
  mappings from and to an internal set. WtrGate supports the CHRS:
  kludge (and derivatives) in netmail/echomail and the gateway
  translates it to the internal set and out again as a MIME character
  set. Same thing the other way around.
  Result: accented characters are supported in both directions now.

* Restructured the entire System Configuration menu structure in
  WtrConf. It is no longer UUCP oriented and properly groups the
  options together.

* News posting is now supported via a so called "mail to news"
  gateway in addition to the UUCP uplink.

* Now supporting POP3, both with mail for a single recipient as for
  multiple recipients in one mailbox file through a header line.

* BBS Interface for tight and easy integration with the BBS using the
  same node numbers for the BBS as for WaterGate. A fake AKA is used
  in between and PATH and SEEN-BY lines are replaced. Separate
  inbound and outbound.

* Direct support for WildCat message bases, including file decoding,
  WtrUtil Import, etc.

* Configuration of users on your BBS. WtrUtil compiles a database
  according to a text file with the names of all users. When WaterGate
  detects a netmail to one of these users, then you can have it
  sent via a special user (BBS Interface or secondary tosser) or have
  it stored in a netmail area. If the netmail was just before gated
  from e-mail, then it can be stored in yet another area so you can
  have an Internet mail and FidoNet mail area for your BBS users.

* List Server now sends re-confirmation messages to subscribers with
  a configurable interval. Subscriber is removed if no answer is sent
  within 8 days.


WtrGate
-------

- New "Hidden" option in Area Definition, effectively removing access
  to the area from within areafix and newsfix.

- *.MSG now uses in index file MSGINDEX.WG, containing enough
  information to quickly detect changes to a message. This avoids
  opening all messages to check whether they have to be scanned out
  or not and make the *.MSG scan a lot faster.

- Semaphore files SCAN.NOW, TOSS.NOW, UUCP.NOW, BAG.NOW, SMTP.NOW
  and POP3.NOW, triggering work in WtrGate the next time you start
  it. Instead of running WtrGate after each UUCP transfer, BAG
  transfer, etc. you can now set a semaphore file and run WtrGate
  SCAN (for example) every now and then - if will see the semaphore
  files and run the other options as well and remove the semaphores.

- Added MAIL2NEWS <e-mail address> option to route.tdb file to support
  a mail2news gateway. It always sends a copy to the gateway! That
  would generate a dupe loop, so WaterGate assume that news from the
  uplink is brought in in BAG format. BAG processing therefore
  temporarily disables the mail2news gateway.

- Option to create Opus Date Format compliant *.MSG messages in the
  primary netmail area.

- "Address Completion" option to prevent header scanning. You can
  force it to always add the first system domain instead.

- Max cross-post limitation for news articles. Article is discarded
  if posted in more newsgroups, as spam articles often are.


WtrConf
-------

- New section Link Definitions where the BAG, POP3 and SMTP links are
  kept instead of between the users under User Definitions.

- Color Editor to change the colors used by the user interface. Select
  one of the built-in sets or one created by a friend or even better:
  compose your own. The entire package uses these colors. Supports
  custom color sets on disk as well.

- Toggle fields can now be moved to the previous and next option using
  Tab, Shift+Tab, Alt+Left, Alt+Right, Alt+Enter in addition to the
  Enter key.

- Built in File Manager to pick paths and files.

- Can now select the header in which the <mailing list name>@ reply
  address is put (From:, Reply-To: or Sender:).

- You can now move group definitions. After upgrading, you can
  re-organize your groups by simply moving a group definition to
  another group letter, instead of typing them again. Areas and users
  having access to the old group can be moved automatically as well.

- New keyword SENDTEXTFILE to force file to be sent as text and avoid
  UU-encoding. 8bit characters on the RFC side will get the proper
  character set translation and encoded using quoted-printable.


WtrUtil
-------

- Area Maintenance can now be performed on one or a selected set of
  areas. Simply tag and select the action to perform.


WtrTest
-------

- Allows you to change the mailer type (important for processing) and
  the command line options -NONETMAIL, -NOEXPORT and -NOIMPORT directly.


Bug fixes and improvements
==========================

WtrGate
-------

- Address completion now detects the system UUCPname and domains of your
  downlinks and domains you route to. It scans the Cc:, Bcc: and
  Apparently-To: headers as well.

- Sendfile, areafix, newsfix, list server, mailing lists and map-area
  detection is now disabled during mailing list distribution.

- Paths to attached files are removed during Netmail -> Mail gating
  and when a netmail is written to a .PKT file.

- New token: DAYSLEFT with the number of days left before the user is
  removed from the list (6, 4 or 2).

- New txt file: LSTRECNF.TXT with list server re-confirmation request.

- Added support against FrontDoor adding an empty line in front of
  the To:, which is sometimes invalid.

- IMPORTED.WG is now created in the system directory when a netmail
  is imported into your primary netmail area (not file attaches).

- Origin line is now interpreted for From AKA for echomail.

- Command line arguments are now logged when debug logging is enabled.

- New command line options -DEBUG to force debug logging for one run
  and -NOTUNNEL to prevent creating MailTunnel e-mails, so you can
  have this done right before polling.

- AREA: kludge in the middle of a netmail no longer changes it to
  echomail.

- Netmail messages can now be routed through a tunnel, even when
  running in FrontDoor mode.

- Netmail for points of a system aka are now always imported when
  -NONETMAIL is given on the command line.

- UUCP jobs are now created with a .CM$ file. All .CM$ files are
  renamed at once to .CMD when WtrGate is finished. This avoid
  mailers in multi-tasking environments picking up jobs before they
  are complete.

- Inbound .PKT files are now renamed to .PPP before processing, to
  prevent re-tossing when WaterGate crashes.

- Netmails are now scanned out if it is address to an aka that is not
  a system aka and a MAP-FIDO statement is applicable. In the past it
  had to be addressed to a system aka before it was exported and
  MAP-FIDO was checked.

- Netmail and e-mail areas are now scanned when an ECHOMAIL.JAM or
  ECHOTOSS.LOG file has been processed during the scan.

- No exact match required anymore for lines in ECHOMAIL.JAM. Path
  without drive letter or just area name are enough now.

- Multiple recipient support for SMTP .WRK files.

- Now forcing the From AKA to the Origin AKA of the Area Definition
  for e-mail style areas.

- Avoiding mysteriously disappearing echomail by always logging, even
  when the Bad area is not defined and subscriber checking before
  logging the message as processed.

- Tear-lines now have to be followed by an Origin line.

- Completely rewritten PATH and SEEN-BY handling, using less memory,
  no longer adding our own net/node pairs again, inserting at the
  correct location (sorted).

Encoding / decoding:

- MIME Content-type "unknown" together with base64 will now be decoded.

- Base64 encoded files inside a single part MIME messages are now decoded.

- UU/XX-encoded files no longer need an empty line at the end of the
  encoded block.

- UU-encoded files with one space at the end of each line are now
  decoded. A start line with a four digit number after "begin" is
  supported as well now ("begin 0600").

ROUTE.TDB file:

- IGNOREFIDOUSER <name> in ROUTE.TDB file to tell WaterGate to ignore
  messages for that user name, for example Allfix. Up to five
  statements can be used.

- ROUTE-FIDO now allows addresses with a none-zero point part.

- SIGNATURE now accepts wildcard AKAs and e-mail addresses as well,
  which are checked for after translation.

- BOUNCE and BOUNCEFROM now allow for an asterisk at the start to
  prevent matching "mytest@my.domain" with "test@my.domain".

*.MSG:

- Back slash at end of path is no longer required.

- Split parts would drop one message at the end of each part, breaking
  UU-encoded files.

- Properly supporting locked messages (read-only attribute set).

Squish:

- No limit on the maximum size of a message anymore.

- Frames are no longer structurally corrupted during a toss, destroying
  the entire message base.

- Export problems where the entire body or the last line of the body
  was lost are fixed.

- WtrGate no longer tries to create an area if it failed to open it.

- Improved speed of the Scan operation.

- Squish Purge can now purge from areas that are "too big" to handle
  during normal operation.

- Squish Purge now supports the .SQL file with last-read information.
  Purge was rewritten, Re-index was removed.

List Server:

- user@domain is now considered equal to domain!user.

- a copy of a distributed message is now sent back to the poster, as
  a confirmation of the posting.

- Gateway is closed during mailing list distributions. FTN users must
  subscribe as netmail recipients, RFC users must subscribe as e-mail
  recipients. Gating from e-mail to netmail changed the body and was
  sent like that to the next e-mail recipient.


WtrConf
-------

- Can now import areas and users from FastEcho 1.45.

- AreaFix and newsfix forward configuration group handling now allow
  a pick-list instead of a group letter.

- Numerous improvements to the way things work for the user, sorted
  lists, cursor on last selected item, grayed items, etc.

- AREAS.BBS now has a $ Squish areas when exporting and both a % or
  $ are supported during import.

- MailGrade and NewsGrade were moved to the UUCP style User Definition
  so you can set them different for each UUCP user.

- Can now import from FIDONET.NA type of files to create new areas or
  just update the descriptions.


WtrUtil
-------

- Pack Databases can recover from an "exploded" (32Mb) areabase. It
  works out the real number of records and cuts off the rest.

- Import now leaves messages from ARCmail and IGNOREFIDOUSER in the
  primary netmail area. Local flag is also removed now to prevent
  scanning the messages again.

- Orphan areas (not in any area) are now moved to group Z1 during
  Pack Databases.


WtrTest
-------

- Routing tables include section with domains that are considered local.

- Now logs to WTRTEST.LOG

- Changed headers for simulating e-mail from UUCP oriented to general
  descriptions.

<end of listing>
