github.com/xhghs/rclone@v1.51.1-0.20200430155106-e186a28cced8/docs/content/changelog.md (about) 1 --- 2 title: "Documentation" 3 description: "Rclone Changelog" 4 date: "2020-02-01" 5 --- 6 7 # Changelog 8 9 ## v1.51.0 - 2020-02-01 10 11 * New backends 12 * [Memory](/memory) (Nick Craig-Wood) 13 * [Sugarsync](/sugarsync) (Nick Craig-Wood) 14 * New Features 15 * Adjust all backends to have `--backend-encoding` parameter (Nick Craig-Wood) 16 * this enables the encoding for special characters to be adjusted or disabled 17 * Add `--max-duration` flag to control the maximum duration of a transfer session (boosh) 18 * Add `--expect-continue-timeout` flag, default 1s (Nick Craig-Wood) 19 * Add `--no-check-dest` flag for copying without testing the destination (Nick Craig-Wood) 20 * Implement `--order-by` flag to order transfers (Nick Craig-Wood) 21 * accounting 22 * Don't show entries in both transferring and checking (Nick Craig-Wood) 23 * Add option to delete stats (Aleksandar Jankovic) 24 * build 25 * Compress the test builds with gzip (Nick Craig-Wood) 26 * Implement a framework for starting test servers during tests (Nick Craig-Wood) 27 * cmd: Always print elapsed time to tenth place seconds in progress (Gary Kim) 28 * config 29 * Add `--password-command` to allow dynamic config password (Damon Permezel) 30 * Give config questions default values (Nick Craig-Wood) 31 * Check a remote exists when creating a new one (Nick Craig-Wood) 32 * copyurl: Add `--stdout` flag to write to stdout (Nick Craig-Wood) 33 * dedupe: Implement keep smallest too (Nick Craig-Wood) 34 * hashsum: Add flag `--base64` flag (landall) 35 * lsf: Speed up on s3/swift/etc by not reading mimetype by default (Nick Craig-Wood) 36 * lsjson: Add `--no-mimetype` flag (Nick Craig-Wood) 37 * rc: Add methods to turn on blocking and mutex profiling (Nick Craig-Wood) 38 * rcd 39 * Adding group parameter to stats (Chaitanya) 40 * Move webgui apart; option to disable browser (Xiaoxing Ye) 41 * serve sftp: Add support for public key with auth proxy (Paul Tinsley) 42 * stats: Show deletes in stats and hide zero stats (anuar45) 43 * Bug Fixes 44 * accounting 45 * Fix error counter counting multiple times (Ankur Gupta) 46 * Fix error count shown as checks (Cnly) 47 * Clear finished transfer in stats-reset (Maciej Zimnoch) 48 * Added StatsInfo locking in statsGroups sum function (Michał Matczuk) 49 * asyncreader: Fix EOF error (buengese) 50 * check: Fix `--one-way` recursing more directories than it needs to (Nick Craig-Wood) 51 * chunkedreader: Disable hash calculation for first segment (Nick Craig-Wood) 52 * config 53 * Do not open browser on headless on drive/gcs/google photos (Xiaoxing Ye) 54 * SetValueAndSave ignore error if config section does not exist yet (buengese) 55 * cmd: Fix completion with an encrypted config (Danil Semelenov) 56 * dbhashsum: Stop it returning UNSUPPORTED on dropbox (Nick Craig-Wood) 57 * dedupe: Add missing modes to help string (Nick Craig-Wood) 58 * operations 59 * Fix dedupe continuing on errors like insufficientFilePermisson (SezalAgrawal) 60 * Clear accounting before low level retry (Maciej Zimnoch) 61 * Write debug message when hashes could not be checked (Ole Schütt) 62 * Move interface assertion to tests to remove pflag dependency (Nick Craig-Wood) 63 * Make NewOverrideObjectInfo public and factor uses (Nick Craig-Wood) 64 * proxy: Replace use of bcrypt with sha256 (Nick Craig-Wood) 65 * vendor 66 * Update bazil.org/fuse to fix FreeBSD 12.1 (Nick Craig-Wood) 67 * Update github.com/t3rm1n4l/go-mega to fix mega "illegal base64 data at input byte 22" (Nick Craig-Wood) 68 * Update termbox-go to fix ncdu command on FreeBSD (Kuang-che Wu) 69 * Update t3rm1n4l/go-mega - fixes mega: couldn't login: crypto/aes: invalid key size 0 (Nick Craig-Wood) 70 * Mount 71 * Enable async reads for a 20% speedup (Nick Craig-Wood) 72 * Replace use of WriteAt with Write for cache mode >= writes and O_APPEND (Brett Dutro) 73 * Make sure we call unmount when exiting (Nick Craig-Wood) 74 * Don't build on go1.10 as bazil/fuse no longer supports it (Nick Craig-Wood) 75 * When setting dates discard out of range dates (Nick Craig-Wood) 76 * VFS 77 * Add a newly created file straight into the directory (Nick Craig-Wood) 78 * Only calculate one hash for reads for a speedup (Nick Craig-Wood) 79 * Make ReadAt for non cached files work better with non-sequential reads (Nick Craig-Wood) 80 * Fix edge cases when reading ModTime from file (Nick Craig-Wood) 81 * Make sure existing files opened for write show correct size (Nick Craig-Wood) 82 * Don't cache the path in RW file objects to fix renaming (Nick Craig-Wood) 83 * Fix rename of open files when using the VFS cache (Nick Craig-Wood) 84 * When renaming files in the cache, rename the cache item in memory too (Nick Craig-Wood) 85 * Fix open file renaming on drive when using `--vfs-cache-mode writes` (Nick Craig-Wood) 86 * Fix incorrect modtime for mv into mount with `--vfs-cache-modes writes` (Nick Craig-Wood) 87 * On rename, rename in cache too if the file exists (Anagh Kumar Baranwal) 88 * Local 89 * Make source file being updated errors be NoLowLevelRetry errors (Nick Craig-Wood) 90 * Fix update of hidden files on Windows (Nick Craig-Wood) 91 * Cache 92 * Follow move of upstream library github.com/coreos/bbolt github.com/etcd-io/bbolt (Nick Craig-Wood) 93 * Fix `fatal error: concurrent map writes` (Nick Craig-Wood) 94 * Crypt 95 * Reorder the filename encryption options (Thomas Eales) 96 * Correctly handle trailing dot (buengese) 97 * Chunker 98 * Reduce length of temporary suffix (Ivan Andreev) 99 * Drive 100 * Add `--drive-stop-on-upload-limit` flag to stop syncs when upload limit reached (Nick Craig-Wood) 101 * Add `--drive-use-shared-date` to use date file was shared instead of modified date (Garry McNulty) 102 * Make sure invalid auth for teamdrives always reports an error (Nick Craig-Wood) 103 * Fix `--fast-list` when using appDataFolder (Nick Craig-Wood) 104 * Use multipart resumable uploads for streaming and uploads in mount (Nick Craig-Wood) 105 * Log an ERROR if an incomplete search is returned (Nick Craig-Wood) 106 * Hide dangerous config from the configurator (Nick Craig-Wood) 107 * Dropbox 108 * Treat `insufficient_space` errors as non retriable errors (Nick Craig-Wood) 109 * Jottacloud 110 * Use new auth method used by official client (buengese) 111 * Add URL to generate Login Token to config wizard (Nick Craig-Wood) 112 * Add support whitelabel versions (buengese) 113 * Koofr 114 * Use rclone HTTP client. (jaKa) 115 * Onedrive 116 * Add Sites.Read.All permission (Benjamin Richter) 117 * Add support "Retry-After" header (Motonori IWAMURO) 118 * Opendrive 119 * Implement `--opendrive-chunk-size` (Nick Craig-Wood) 120 * S3 121 * Re-implement multipart upload to fix memory issues (Nick Craig-Wood) 122 * Add `--s3-copy-cutoff` for size to switch to multipart copy (Nick Craig-Wood) 123 * Add new region Asia Patific (Hong Kong) (Outvi V) 124 * Reduce memory usage streaming files by reducing max stream upload size (Nick Craig-Wood) 125 * Add `--s3-list-chunk` option for bucket listing (Thomas Kriechbaumer) 126 * Force path style bucket access to off for AWS deprecation (Nick Craig-Wood) 127 * Use AWS web identity role provider if available (Tennix) 128 * Add StackPath Object Storage Support (Dave Koston) 129 * Fix ExpiryWindow value (Aleksandar Jankovic) 130 * Fix DisableChecksum condition (Aleksandar Janković) 131 * Fix URL decoding of NextMarker (Nick Craig-Wood) 132 * SFTP 133 * Add `--sftp-skip-links` to skip symlinks and non regular files (Nick Craig-Wood) 134 * Retry Creation of Connection (Sebastian Brandt) 135 * Fix "failed to parse private key file: ssh: not an encrypted key" error (Nick Craig-Wood) 136 * Open files for update write only to fix AWS SFTP interop (Nick Craig-Wood) 137 * Swift 138 * Reserve segments of dynamic large object when delete objects in container what was enabled versioning. (Nguyễn Hữu Luân) 139 * Fix parsing of X-Object-Manifest (Nick Craig-Wood) 140 * Update OVH API endpoint (unbelauscht) 141 * WebDAV 142 * Make nextcloud only upload SHA1 checksums (Nick Craig-Wood) 143 * Fix case of "Bearer" in Authorization: header to agree with RFC (Nick Craig-Wood) 144 * Add Referer header to fix problems with WAFs (Nick Craig-Wood) 145 146 ## v1.50.2 - 2019-11-19 147 148 * Bug Fixes 149 * accounting: Fix memory leak on retries operations (Nick Craig-Wood) 150 * Drive 151 * Fix listing of the root directory with drive.files scope (Nick Craig-Wood) 152 * Fix --drive-root-folder-id with team/shared drives (Nick Craig-Wood) 153 154 ## v1.50.1 - 2019-11-02 155 156 * Bug Fixes 157 * hash: Fix accidentally changed hash names for `DropboxHash` and `CRC-32` (Nick Craig-Wood) 158 * fshttp: Fix error reporting on tpslimit token bucket errors (Nick Craig-Wood) 159 * fshttp: Don't print token bucket errors on context cancelled (Nick Craig-Wood) 160 * Local 161 * Fix listings of . on Windows (Nick Craig-Wood) 162 * Onedrive 163 * Fix DirMove/Move after Onedrive change (Xiaoxing Ye) 164 165 ## v1.50.0 - 2019-10-26 166 167 * New backends 168 * [Citrix Sharefile](/sharefile) (Nick Craig-Wood) 169 * [Chunker](/chunker) - an overlay backend to split files into smaller parts (Ivan Andreev) 170 * [Mail.ru Cloud](/mailru) (Ivan Andreev) 171 * New Features 172 * encodings (Fabian Möller & Nick Craig-Wood) 173 * All backends now use file name encoding to ensure any file name can be written to any backend. 174 * See the [restricted file name docs](/overview/#restricted-filenames) for more info and the [local backend docs](/local/#filenames). 175 * Some file names may look different in rclone if you are using any control characters in names or [unicode FULLWIDTH symbols](https://en.wikipedia.org/wiki/Halfwidth_and_Fullwidth_Forms_(Unicode_block)). 176 * build 177 * Update to use go1.13 for the build (Nick Craig-Wood) 178 * Drop support for go1.9 (Nick Craig-Wood) 179 * Build rclone with GitHub actions (Nick Craig-Wood) 180 * Convert python scripts to python3 (Nick Craig-Wood) 181 * Swap Azure/go-ansiterm for mattn/go-colorable (Nick Craig-Wood) 182 * Dockerfile fixes (Matei David) 183 * Add [plugin support](https://github.com/rclone/rclone/blob/master/CONTRIBUTING.md#writing-a-plugin) for backends and commands (Richard Patel) 184 * config 185 * Use alternating Red/Green in config to make more obvious (Nick Craig-Wood) 186 * contrib 187 * Add sample DLNA server Docker Compose manifest. (pataquets) 188 * Add sample WebDAV server Docker Compose manifest. (pataquets) 189 * copyurl 190 * Add `--auto-filename` flag for using file name from URL in destination path (Denis) 191 * serve dlna: 192 * Many compatability improvements (Dan Walters) 193 * Support for external srt subtitles (Dan Walters) 194 * rc 195 * Added command core/quit (Saksham Khanna) 196 * Bug Fixes 197 * sync 198 * Make `--update`/`-u` not transfer files that haven't changed (Nick Craig-Wood) 199 * Free objects after they come out of the transfer pipe to save memory (Nick Craig-Wood) 200 * Fix `--files-from without --no-traverse` doing a recursive scan (Nick Craig-Wood) 201 * operations 202 * Fix accounting for server side copies (Nick Craig-Wood) 203 * Display 'All duplicates removed' only if dedupe successful (Sezal Agrawal) 204 * Display 'Deleted X extra copies' only if dedupe successful (Sezal Agrawal) 205 * accounting 206 * Only allow up to 100 completed transfers in the accounting list to save memory (Nick Craig-Wood) 207 * Cull the old time ranges when possible to save memory (Nick Craig-Wood) 208 * Fix panic due to server-side copy fallback (Ivan Andreev) 209 * Fix memory leak noticeable for transfers of large numbers of objects (Nick Craig-Wood) 210 * Fix total duration calculation (Nick Craig-Wood) 211 * cmd 212 * Fix environment variables not setting command line flags (Nick Craig-Wood) 213 * Make autocomplete compatible with bash's posix mode for macOS (Danil Semelenov) 214 * Make `--progress` work in git bash on Windows (Nick Craig-Wood) 215 * Fix 'compopt: command not found' on autocomplete on macOS (Danil Semelenov) 216 * config 217 * Fix setting of non top level flags from environment variables (Nick Craig-Wood) 218 * Check config names more carefully and report errors (Nick Craig-Wood) 219 * Remove error: can't use `--size-only` and `--ignore-size` together. (Nick Craig-Wood) 220 * filter: Prevent mixing options when `--files-from` is in use (Michele Caci) 221 * serve sftp: Fix crash on unsupported operations (eg Readlink) (Nick Craig-Wood) 222 * Mount 223 * Allow files of unkown size to be read properly (Nick Craig-Wood) 224 * Skip tests on <= 2 CPUs to avoid lockup (Nick Craig-Wood) 225 * Fix panic on File.Open (Nick Craig-Wood) 226 * Fix "mount_fusefs: -o timeout=: option not supported" on FreeBSD (Nick Craig-Wood) 227 * Don't pass huge filenames (>4k) to FUSE as it can't cope (Nick Craig-Wood) 228 * VFS 229 * Add flag `--vfs-case-insensitive` for windows/macOS mounts (Ivan Andreev) 230 * Make objects of unknown size readable through the VFS (Nick Craig-Wood) 231 * Move writeback of dirty data out of close() method into its own method (FlushWrites) and remove close() call from Flush() (Brett Dutro) 232 * Stop empty dirs disappearing when renamed on bucket based remotes (Nick Craig-Wood) 233 * Stop change notify polling clearing so much of the directory cache (Nick Craig-Wood) 234 * Azure Blob 235 * Disable logging to the Windows event log (Nick Craig-Wood) 236 * B2 237 * Remove `unverified:` prefix on sha1 to improve interop (eg with CyberDuck) (Nick Craig-Wood) 238 * Box 239 * Add options to get access token via JWT auth (David) 240 * Drive 241 * Disable HTTP/2 by default to work around INTERNAL_ERROR problems (Nick Craig-Wood) 242 * Make sure that drive root ID is always canonical (Nick Craig-Wood) 243 * Fix `--drive-shared-with-me` from the root with lsand `--fast-list` (Nick Craig-Wood) 244 * Fix ChangeNotify polling for shared drives (Nick Craig-Wood) 245 * Fix change notify polling when using appDataFolder (Nick Craig-Wood) 246 * Dropbox 247 * Make disallowed filenames errors not retry (Nick Craig-Wood) 248 * Fix nil pointer exception on restricted files (Nick Craig-Wood) 249 * Fichier 250 * Fix accessing files > 2GB on 32 bit systems (Nick Craig-Wood) 251 * FTP 252 * Allow disabling EPSV mode (Jon Fautley) 253 * HTTP 254 * HEAD directory entries in parallel to speedup (Nick Craig-Wood) 255 * Add `--http-no-head` to stop rclone doing HEAD in listings (Nick Craig-Wood) 256 * Putio 257 * Add ability to resume uploads (Cenk Alti) 258 * S3 259 * Fix signature v2_auth headers (Anthony Rusdi) 260 * Fix encoding for control characters (Nick Craig-Wood) 261 * Only ask for URL encoded directory listings if we need them on Ceph (Nick Craig-Wood) 262 * Add option for multipart failiure behaviour (Aleksandar Jankovic) 263 * Support for multipart copy (庄天翼) 264 * Fix nil pointer reference if no metadata returned for object (Nick Craig-Wood) 265 * SFTP 266 * Fix `--sftp-ask-password` trying to contact the ssh agent (Nick Craig-Wood) 267 * Fix hashes of files with backslashes (Nick Craig-Wood) 268 * Include more ciphers with `--sftp-use-insecure-cipher` (Carlos Ferreyra) 269 * WebDAV 270 * Parse and return Sharepoint error response (Henning Surmeier) 271 272 ## v1.49.5 - 2019-10-05 273 274 * Bug Fixes 275 * Revert back to go1.12.x for the v1.49.x builds as go1.13.x was causing issues (Nick Craig-Wood) 276 * Fix rpm packages by using master builds of nfpm (Nick Craig-Wood) 277 * Fix macOS build after brew changes (Nick Craig-Wood) 278 279 ## v1.49.4 - 2019-09-29 280 281 * Bug Fixes 282 * cmd/rcd: Address ZipSlip vulnerability (Richard Patel) 283 * accounting: Fix file handle leak on errors (Nick Craig-Wood) 284 * oauthutil: Fix security problem when running with two users on the same machine (Nick Craig-Wood) 285 * FTP 286 * Fix listing of an empty root returning: error dir not found (Nick Craig-Wood) 287 * S3 288 * Fix SetModTime on GLACIER/ARCHIVE objects and implement set/get tier (Nick Craig-Wood) 289 290 ## v1.49.3 - 2019-09-15 291 292 * Bug Fixes 293 * accounting 294 * Fix total duration calculation (Aleksandar Jankovic) 295 * Fix "file already closed" on transfer retries (Nick Craig-Wood) 296 297 ## v1.49.2 - 2019-09-08 298 299 * New Features 300 * build: Add Docker workflow support (Alfonso Montero) 301 * Bug Fixes 302 * accounting: Fix locking in Transfer to avoid deadlock with `--progress` (Nick Craig-Wood) 303 * docs: Fix template argument for mktemp in install.sh (Cnly) 304 * operations: Fix `-u`/`--update` with google photos / files of unknown size (Nick Craig-Wood) 305 * rc: Fix docs for config/create /update /password (Nick Craig-Wood) 306 * Google Cloud Storage 307 * Fix need for elevated permissions on SetModTime (Nick Craig-Wood) 308 309 ## v1.49.1 - 2019-08-28 310 311 * Bug Fixes 312 * config: Fix generated passwords being stored as empty password (Nick Craig-Wood) 313 * rcd: Added missing parameter for web-gui info logs. (Chaitanya) 314 * Googlephotos 315 * Fix crash on error response (Nick Craig-Wood) 316 * Onedrive 317 * Fix crash on error response (Nick Craig-Wood) 318 319 ## v1.49.0 - 2019-08-26 320 321 * New backends 322 * [1fichier](/fichier/) (Laura Hausmann) 323 * [Google Photos](/googlephotos) (Nick Craig-Wood) 324 * [Putio](/putio/) (Cenk Alti) 325 * [premiumize.me](/premiumizeme/) (Nick Craig-Wood) 326 * New Features 327 * Experimental [web GUI](/gui/) (Chaitanya Bankanhal) 328 * Implement `--compare-dest` & `--copy-dest` (yparitcher) 329 * Implement `--suffix` without `--backup-dir` for backup to current dir (yparitcher) 330 * `config reconnect` to re-login (re-run the oauth login) for the backend. (Nick Craig-Wood) 331 * `config userinfo` to discover which user you are logged in as. (Nick Craig-Wood) 332 * `config disconnect` to disconnect you (log out) from the backend. (Nick Craig-Wood) 333 * Add `--use-json-log` for JSON logging (justinalin) 334 * Add context propagation to rclone (Aleksandar Jankovic) 335 * Reworking internal statistics interfaces so they work with rc jobs (Aleksandar Jankovic) 336 * Add Higher units for ETA (AbelThar) 337 * Update rclone logos to new design (Andreas Chlupka) 338 * hash: Add CRC-32 support (Cenk Alti) 339 * help showbackend: Fixed advanced option category when there are no standard options (buengese) 340 * ncdu: Display/Copy to Clipboard Current Path (Gary Kim) 341 * operations: 342 * Run hashing operations in parallel (Nick Craig-Wood) 343 * Don't calculate checksums when using `--ignore-checksum` (Nick Craig-Wood) 344 * Check transfer hashes when using `--size-only` mode (Nick Craig-Wood) 345 * Disable multi thread copy for local to local copies (Nick Craig-Wood) 346 * Debug successful hashes as well as failures (Nick Craig-Wood) 347 * rc 348 * Add ability to stop async jobs (Aleksandar Jankovic) 349 * Return current settings if core/bwlimit called without parameters (Nick Craig-Wood) 350 * Rclone-WebUI integration with rclone (Chaitanya Bankanhal) 351 * Added command line parameter to control the cross origin resource sharing (CORS) in the rcd. (Security Improvement) (Chaitanya Bankanhal) 352 * Add anchor tags to the docs so links are consistent (Nick Craig-Wood) 353 * Remove _async key from input parameters after parsing so later operations won't get confused (buengese) 354 * Add call to clear stats (Aleksandar Jankovic) 355 * rcd 356 * Auto-login for web-gui (Chaitanya Bankanhal) 357 * Implement `--baseurl` for rcd and web-gui (Chaitanya Bankanhal) 358 * serve dlna 359 * Only select interfaces which can multicast for SSDP (Nick Craig-Wood) 360 * Add more builtin mime types to cover standard audio/video (Nick Craig-Wood) 361 * Fix missing mime types on Android causing missing videos (Nick Craig-Wood) 362 * serve ftp 363 * Refactor to bring into line with other serve commands (Nick Craig-Wood) 364 * Implement `--auth-proxy` (Nick Craig-Wood) 365 * serve http: Implement `--baseurl` (Nick Craig-Wood) 366 * serve restic: Implement `--baseurl` (Nick Craig-Wood) 367 * serve sftp 368 * Implement auth proxy (Nick Craig-Wood) 369 * Fix detection of whether server is authorized (Nick Craig-Wood) 370 * serve webdav 371 * Implement `--baseurl` (Nick Craig-Wood) 372 * Support `--auth-proxy` (Nick Craig-Wood) 373 * Bug Fixes 374 * Make "bad record MAC" a retriable error (Nick Craig-Wood) 375 * copyurl: Fix copying files that return HTTP errors (Nick Craig-Wood) 376 * march: Fix checking sub-directories when using `--no-traverse` (buengese) 377 * rc 378 * Fix unmarshalable http.AuthFn in options and put in test for marshalability (Nick Craig-Wood) 379 * Move job expire flags to rc to fix initalization problem (Nick Craig-Wood) 380 * Fix `--loopback` with rc/list and others (Nick Craig-Wood) 381 * rcat: Fix slowdown on systems with multiple hashes (Nick Craig-Wood) 382 * rcd: Fix permissions problems on cache directory with web gui download (Nick Craig-Wood) 383 * Mount 384 * Default `--deamon-timout` to 15 minutes on macOS and FreeBSD (Nick Craig-Wood) 385 * Update docs to show mounting from root OK for bucket based (Nick Craig-Wood) 386 * Remove nonseekable flag from write files (Nick Craig-Wood) 387 * VFS 388 * Make write without cache more efficient (Nick Craig-Wood) 389 * Fix `--vfs-cache-mode minimal` and `writes` ignoring cached files (Nick Craig-Wood) 390 * Local 391 * Add `--local-case-sensitive` and `--local-case-insensitive` (Nick Craig-Wood) 392 * Avoid polluting page cache when uploading local files to remote backends (Michał Matczuk) 393 * Don't calculate any hashes by default (Nick Craig-Wood) 394 * Fadvise run syscall on a dedicated go routine (Michał Matczuk) 395 * Azure Blob 396 * Azure Storage Emulator support (Sandeep) 397 * Updated config help details to remove connection string references (Sandeep) 398 * Make all operations work from the root (Nick Craig-Wood) 399 * B2 400 * Implement link sharing (yparitcher) 401 * Enable server side copy to copy between buckets (Nick Craig-Wood) 402 * Make all operations work from the root (Nick Craig-Wood) 403 * Drive 404 * Fix server side copy of big files (Nick Craig-Wood) 405 * Update API for teamdrive use (Nick Craig-Wood) 406 * Add error for purge with `--drive-trashed-only` (ginvine) 407 * Fichier 408 * Make FolderID int and adjust related code (buengese) 409 * Google Cloud Storage 410 * Reduce oauth scope requested as suggested by Google (Nick Craig-Wood) 411 * Make all operations work from the root (Nick Craig-Wood) 412 * HTTP 413 * Add `--http-headers` flag for setting arbitrary headers (Nick Craig-Wood) 414 * Jottacloud 415 * Use new api for retrieving internal username (buengese) 416 * Refactor configuration and minor cleanup (buengese) 417 * Koofr 418 * Support setting modification times on Koofr backend. (jaKa) 419 * Opendrive 420 * Refactor to use existing lib/rest facilities for uploads (Nick Craig-Wood) 421 * Qingstor 422 * Upgrade to v3 SDK and fix listing loop (Nick Craig-Wood) 423 * Make all operations work from the root (Nick Craig-Wood) 424 * S3 425 * Add INTELLIGENT_TIERING storage class (Matti Niemenmaa) 426 * Make all operations work from the root (Nick Craig-Wood) 427 * SFTP 428 * Add missing interface check and fix About (Nick Craig-Wood) 429 * Completely ignore all modtime checks if SetModTime=false (Jon Fautley) 430 * Support md5/sha1 with rsync.net (Nick Craig-Wood) 431 * Save the md5/sha1 command in use to the config file for efficiency (Nick Craig-Wood) 432 * Opt-in support for diffie-hellman-group-exchange-sha256 diffie-hellman-group-exchange-sha1 (Yi FU) 433 * Swift 434 * Use FixRangeOption to fix 0 length files via the VFS (Nick Craig-Wood) 435 * Fix upload when using no_chunk to return the correct size (Nick Craig-Wood) 436 * Make all operations work from the root (Nick Craig-Wood) 437 * Fix segments leak during failed large file uploads. (nguyenhuuluan434) 438 * WebDAV 439 * Add `--webdav-bearer-token-command` (Nick Craig-Wood) 440 * Refresh token when it expires with `--webdav-bearer-token-command` (Nick Craig-Wood) 441 * Add docs for using bearer_token_command with oidc-agent (Paul Millar) 442 443 ## v1.48.0 - 2019-06-15 444 445 * New commands 446 * serve sftp: Serve an rclone remote over SFTP (Nick Craig-Wood) 447 * New Features 448 * Multi threaded downloads to local storage (Nick Craig-Wood) 449 * controlled with `--multi-thread-cutoff` and `--multi-thread-streams` 450 * Use rclone.conf from rclone executable directory to enable portable use (albertony) 451 * Allow sync of a file and a directory with the same name (forgems) 452 * this is common on bucket based remotes, eg s3, gcs 453 * Add `--ignore-case-sync` for forced case insensitivity (garry415) 454 * Implement `--stats-one-line-date` and `--stats-one-line-date-format` (Peter Berbec) 455 * Log an ERROR for all commands which exit with non-zero status (Nick Craig-Wood) 456 * Use go-homedir to read the home directory more reliably (Nick Craig-Wood) 457 * Enable creating encrypted config through external script invocation (Wojciech Smigielski) 458 * build: Drop support for go1.8 (Nick Craig-Wood) 459 * config: Make config create/update encrypt passwords where necessary (Nick Craig-Wood) 460 * copyurl: Honor `--no-check-certificate` (Stefan Breunig) 461 * install: Linux skip man pages if no mandb (didil) 462 * lsf: Support showing the Tier of the object (Nick Craig-Wood) 463 * lsjson 464 * Added EncryptedPath to output (calisro) 465 * Support showing the Tier of the object (Nick Craig-Wood) 466 * Add IsBucket field for bucket based remote listing of the root (Nick Craig-Wood) 467 * rc 468 * Add `--loopback` flag to run commands directly without a server (Nick Craig-Wood) 469 * Add operations/fsinfo: Return information about the remote (Nick Craig-Wood) 470 * Skip auth for OPTIONS request (Nick Craig-Wood) 471 * cmd/providers: Add DefaultStr, ValueStr and Type fields (Nick Craig-Wood) 472 * jobs: Make job expiry timeouts configurable (Aleksandar Jankovic) 473 * serve dlna reworked and improved (Dan Walters) 474 * serve ftp: add `--ftp-public-ip` flag to specify public IP (calistri) 475 * serve restic: Add support for `--private-repos` in `serve restic` (Florian Apolloner) 476 * serve webdav: Combine serve webdav and serve http (Gary Kim) 477 * size: Ignore negative sizes when calculating total (Garry McNulty) 478 * Bug Fixes 479 * Make move and copy individual files obey `--backup-dir` (Nick Craig-Wood) 480 * If `--ignore-checksum` is in effect, don't calculate checksum (Nick Craig-Wood) 481 * moveto: Fix case-insensitive same remote move (Gary Kim) 482 * rc: Fix serving bucket based objects with `--rc-serve` (Nick Craig-Wood) 483 * serve webdav: Fix serveDir not being updated with changes from webdav (Gary Kim) 484 * Mount 485 * Fix poll interval documentation (Animosity022) 486 * VFS 487 * Make WriteAt for non cached files work with non-sequential writes (Nick Craig-Wood) 488 * Local 489 * Only calculate the required hashes for big speedup (Nick Craig-Wood) 490 * Log errors when listing instead of returning an error (Nick Craig-Wood) 491 * Fix preallocate warning on Linux with ZFS (Nick Craig-Wood) 492 * Crypt 493 * Make rclone dedupe work through crypt (Nick Craig-Wood) 494 * Fix wrapping of ChangeNotify to decrypt directories properly (Nick Craig-Wood) 495 * Support PublicLink (rclone link) of underlying backend (Nick Craig-Wood) 496 * Implement Optional methods SetTier, GetTier (Nick Craig-Wood) 497 * B2 498 * Implement server side copy (Nick Craig-Wood) 499 * Implement SetModTime (Nick Craig-Wood) 500 * Drive 501 * Fix move and copy from TeamDrive to GDrive (Fionera) 502 * Add notes that cleanup works in the background on drive (Nick Craig-Wood) 503 * Add `--drive-server-side-across-configs` to default back to old server side copy semantics by default (Nick Craig-Wood) 504 * Add `--drive-size-as-quota` to show storage quota usage for file size (Garry McNulty) 505 * FTP 506 * Add FTP List timeout (Jeff Quinn) 507 * Add FTP over TLS support (Gary Kim) 508 * Add `--ftp-no-check-certificate` option for FTPS (Gary Kim) 509 * Google Cloud Storage 510 * Fix upload errors when uploading pre 1970 files (Nick Craig-Wood) 511 * Jottacloud 512 * Add support for selecting device and mountpoint. (buengese) 513 * Mega 514 * Add cleanup support (Gary Kim) 515 * Onedrive 516 * More accurately check if root is found (Cnly) 517 * S3 518 * Suppport S3 Accelerated endpoints with `--s3-use-accelerate-endpoint` (Nick Craig-Wood) 519 * Add config info for Wasabi's EU Central endpoint (Robert Marko) 520 * Make SetModTime work for GLACIER while syncing (Philip Harvey) 521 * SFTP 522 * Add About support (Gary Kim) 523 * Fix about parsing of `df` results so it can cope with -ve results (Nick Craig-Wood) 524 * Send custom client version and debug server version (Nick Craig-Wood) 525 * WebDAV 526 * Retry on 423 Locked errors (Nick Craig-Wood) 527 528 ## v1.47.0 - 2019-04-13 529 530 * New backends 531 * Backend for Koofr cloud storage service. (jaKa) 532 * New Features 533 * Resume downloads if the reader fails in copy (Nick Craig-Wood) 534 * this means rclone will restart transfers if the source has an error 535 * this is most useful for downloads or cloud to cloud copies 536 * Use `--fast-list` for listing operations where it won't use more memory (Nick Craig-Wood) 537 * this should speed up the following operations on remotes which support `ListR` 538 * `dedupe`, `serve restic` `lsf`, `ls`, `lsl`, `lsjson`, `lsd`, `md5sum`, `sha1sum`, `hashsum`, `size`, `delete`, `cat`, `settier` 539 * use `--disable ListR` to get old behaviour if required 540 * Make `--files-from` traverse the destination unless `--no-traverse` is set (Nick Craig-Wood) 541 * this fixes `--files-from` with Google drive and excessive API use in general. 542 * Make server side copy account bytes and obey `--max-transfer` (Nick Craig-Wood) 543 * Add `--create-empty-src-dirs` flag and default to not creating empty dirs (ishuah) 544 * Add client side TLS/SSL flags `--ca-cert`/`--client-cert`/`--client-key` (Nick Craig-Wood) 545 * Implement `--suffix-keep-extension` for use with `--suffix` (Nick Craig-Wood) 546 * build: 547 * Switch to semvar compliant version tags to be go modules compliant (Nick Craig-Wood) 548 * Update to use go1.12.x for the build (Nick Craig-Wood) 549 * serve dlna: Add connection manager service description to improve compatibility (Dan Walters) 550 * lsf: Add 'e' format to show encrypted names and 'o' for original IDs (Nick Craig-Wood) 551 * lsjson: Added `--files-only` and `--dirs-only` flags (calistri) 552 * rc: Implement operations/publiclink the equivalent of `rclone link` (Nick Craig-Wood) 553 * Bug Fixes 554 * accounting: Fix total ETA when `--stats-unit bits` is in effect (Nick Craig-Wood) 555 * Bash TAB completion 556 * Use private custom func to fix clash between rclone and kubectl (Nick Craig-Wood) 557 * Fix for remotes with underscores in their names (Six) 558 * Fix completion of remotes (Florian Gamböck) 559 * Fix autocompletion of remote paths with spaces (Danil Semelenov) 560 * serve dlna: Fix root XML service descriptor (Dan Walters) 561 * ncdu: Fix display corruption with Chinese characters (Nick Craig-Wood) 562 * Add SIGTERM to signals which run the exit handlers on unix (Nick Craig-Wood) 563 * rc: Reload filter when the options are set via the rc (Nick Craig-Wood) 564 * VFS / Mount 565 * Fix FreeBSD: Ignore Truncate if called with no readers and already the correct size (Nick Craig-Wood) 566 * Read directory and check for a file before mkdir (Nick Craig-Wood) 567 * Shorten the locking window for vfs/refresh (Nick Craig-Wood) 568 * Azure Blob 569 * Enable MD5 checksums when uploading files bigger than the "Cutoff" (Dr.Rx) 570 * Fix SAS URL support (Nick Craig-Wood) 571 * B2 572 * Allow manual configuration of backblaze downloadUrl (Vince) 573 * Ignore already_hidden error on remove (Nick Craig-Wood) 574 * Ignore malformed `src_last_modified_millis` (Nick Craig-Wood) 575 * Drive 576 * Add `--skip-checksum-gphotos` to ignore incorrect checksums on Google Photos (Nick Craig-Wood) 577 * Allow server side move/copy between different remotes. (Fionera) 578 * Add docs on team drives and `--fast-list` eventual consistency (Nestar47) 579 * Fix imports of text files (Nick Craig-Wood) 580 * Fix range requests on 0 length files (Nick Craig-Wood) 581 * Fix creation of duplicates with server side copy (Nick Craig-Wood) 582 * Dropbox 583 * Retry blank errors to fix long listings (Nick Craig-Wood) 584 * FTP 585 * Add `--ftp-concurrency` to limit maximum number of connections (Nick Craig-Wood) 586 * Google Cloud Storage 587 * Fall back to default application credentials (marcintustin) 588 * Allow bucket policy only buckets (Nick Craig-Wood) 589 * HTTP 590 * Add `--http-no-slash` for websites with directories with no slashes (Nick Craig-Wood) 591 * Remove duplicates from listings (Nick Craig-Wood) 592 * Fix socket leak on 404 errors (Nick Craig-Wood) 593 * Jottacloud 594 * Fix token refresh (Sebastian Bünger) 595 * Add device registration (Oliver Heyme) 596 * Onedrive 597 * Implement graceful cancel of multipart uploads if rclone is interrupted (Cnly) 598 * Always add trailing colon to path when addressing items, (Cnly) 599 * Return errors instead of panic for invalid uploads (Fabian Möller) 600 * S3 601 * Add support for "Glacier Deep Archive" storage class (Manu) 602 * Update Dreamhost endpoint (Nick Craig-Wood) 603 * Note incompatibility with CEPH Jewel (Nick Craig-Wood) 604 * SFTP 605 * Allow custom ssh client config (Alexandru Bumbacea) 606 * Swift 607 * Obey Retry-After to enable OVH restore from cold storage (Nick Craig-Wood) 608 * Work around token expiry on CEPH (Nick Craig-Wood) 609 * WebDAV 610 * Allow IsCollection property to be integer or boolean (Nick Craig-Wood) 611 * Fix race when creating directories (Nick Craig-Wood) 612 * Fix About/df when reading the available/total returns 0 (Nick Craig-Wood) 613 614 ## v1.46 - 2019-02-09 615 616 * New backends 617 * Support Alibaba Cloud (Aliyun) OSS via the s3 backend (Nick Craig-Wood) 618 * New commands 619 * serve dlna: serves a remove via DLNA for the local network (nicolov) 620 * New Features 621 * copy, move: Restore deprecated `--no-traverse` flag (Nick Craig-Wood) 622 * This is useful for when transferring a small number of files into a large destination 623 * genautocomplete: Add remote path completion for bash completion (Christopher Peterson & Danil Semelenov) 624 * Buffer memory handling reworked to return memory to the OS better (Nick Craig-Wood) 625 * Buffer recycling library to replace sync.Pool 626 * Optionally use memory mapped memory for better memory shrinking 627 * Enable with `--use-mmap` if having memory problems - not default yet 628 * Parallelise reading of files specified by `--files-from` (Nick Craig-Wood) 629 * check: Add stats showing total files matched. (Dario Guzik) 630 * Allow rename/delete open files under Windows (Nick Craig-Wood) 631 * lsjson: Use exactly the correct number of decimal places in the seconds (Nick Craig-Wood) 632 * Add cookie support with cmdline switch `--use-cookies` for all HTTP based remotes (qip) 633 * Warn if `--checksum` is set but there are no hashes available (Nick Craig-Wood) 634 * Rework rate limiting (pacer) to be more accurate and allow bursting (Nick Craig-Wood) 635 * Improve error reporting for too many/few arguments in commands (Nick Craig-Wood) 636 * listremotes: Remove `-l` short flag as it conflicts with the new global flag (weetmuts) 637 * Make http serving with auth generate INFO messages on auth fail (Nick Craig-Wood) 638 * Bug Fixes 639 * Fix layout of stats (Nick Craig-Wood) 640 * Fix `--progress` crash under Windows Jenkins (Nick Craig-Wood) 641 * Fix transfer of google/onedrive docs by calling Rcat in Copy when size is -1 (Cnly) 642 * copyurl: Fix checking of `--dry-run` (Denis Skovpen) 643 * Mount 644 * Check that mountpoint and local directory to mount don't overlap (Nick Craig-Wood) 645 * Fix mount size under 32 bit Windows (Nick Craig-Wood) 646 * VFS 647 * Implement renaming of directories for backends without DirMove (Nick Craig-Wood) 648 * now all backends except b2 support renaming directories 649 * Implement `--vfs-cache-max-size` to limit the total size of the cache (Nick Craig-Wood) 650 * Add `--dir-perms` and `--file-perms` flags to set default permissions (Nick Craig-Wood) 651 * Fix deadlock on concurrent operations on a directory (Nick Craig-Wood) 652 * Fix deadlock between RWFileHandle.close and File.Remove (Nick Craig-Wood) 653 * Fix renaming/deleting open files with cache mode "writes" under Windows (Nick Craig-Wood) 654 * Fix panic on rename with `--dry-run` set (Nick Craig-Wood) 655 * Fix vfs/refresh with recurse=true needing the `--fast-list` flag 656 * Local 657 * Add support for `-l`/`--links` (symbolic link translation) (yair@unicorn) 658 * this works by showing links as `link.rclonelink` - see local backend docs for more info 659 * this errors if used with `-L`/`--copy-links` 660 * Fix renaming/deleting open files on Windows (Nick Craig-Wood) 661 * Crypt 662 * Check for maximum length before decrypting filename to fix panic (Garry McNulty) 663 * Azure Blob 664 * Allow building azureblob backend on *BSD (themylogin) 665 * Use the rclone HTTP client to support `--dump headers`, `--tpslimit` etc (Nick Craig-Wood) 666 * Use the s3 pacer for 0 delay in non error conditions (Nick Craig-Wood) 667 * Ignore directory markers (Nick Craig-Wood) 668 * Stop Mkdir attempting to create existing containers (Nick Craig-Wood) 669 * B2 670 * cleanup: will remove unfinished large files >24hrs old (Garry McNulty) 671 * For a bucket limited application key check the bucket name (Nick Craig-Wood) 672 * before this, rclone would use the authorised bucket regardless of what you put on the command line 673 * Added `--b2-disable-checksum` flag (Wojciech Smigielski) 674 * this enables large files to be uploaded without a SHA-1 hash for speed reasons 675 * Drive 676 * Set default pacer to 100ms for 10 tps (Nick Craig-Wood) 677 * This fits the Google defaults much better and reduces the 403 errors massively 678 * Add `--drive-pacer-min-sleep` and `--drive-pacer-burst` to control the pacer 679 * Improve ChangeNotify support for items with multiple parents (Fabian Möller) 680 * Fix ListR for items with multiple parents - this fixes oddities with `vfs/refresh` (Fabian Möller) 681 * Fix using `--drive-impersonate` and appfolders (Nick Craig-Wood) 682 * Fix google docs in rclone mount for some (not all) applications (Nick Craig-Wood) 683 * Dropbox 684 * Retry-After support for Dropbox backend (Mathieu Carbou) 685 * FTP 686 * Wait for 60 seconds for a connection to Close then declare it dead (Nick Craig-Wood) 687 * helps with indefinite hangs on some FTP servers 688 * Google Cloud Storage 689 * Update google cloud storage endpoints (weetmuts) 690 * HTTP 691 * Add an example with username and password which is supported but wasn't documented (Nick Craig-Wood) 692 * Fix backend with `--files-from` and non-existent files (Nick Craig-Wood) 693 * Hubic 694 * Make error message more informative if authentication fails (Nick Craig-Wood) 695 * Jottacloud 696 * Resume and deduplication support (Oliver Heyme) 697 * Use token auth for all API requests Don't store password anymore (Sebastian Bünger) 698 * Add support for 2-factor authentification (Sebastian Bünger) 699 * Mega 700 * Implement v2 account login which fixes logins for newer Mega accounts (Nick Craig-Wood) 701 * Return error if an unknown length file is attempted to be uploaded (Nick Craig-Wood) 702 * Add new error codes for better error reporting (Nick Craig-Wood) 703 * Onedrive 704 * Fix broken support for "shared with me" folders (Alex Chen) 705 * Fix root ID not normalised (Cnly) 706 * Return err instead of panic on unknown-sized uploads (Cnly) 707 * Qingstor 708 * Fix go routine leak on multipart upload errors (Nick Craig-Wood) 709 * Add upload chunk size/concurrency/cutoff control (Nick Craig-Wood) 710 * Default `--qingstor-upload-concurrency` to 1 to work around bug (Nick Craig-Wood) 711 * S3 712 * Implement `--s3-upload-cutoff` for single part uploads below this (Nick Craig-Wood) 713 * Change `--s3-upload-concurrency` default to 4 to increase perfomance (Nick Craig-Wood) 714 * Add `--s3-bucket-acl` to control bucket ACL (Nick Craig-Wood) 715 * Auto detect region for buckets on operation failure (Nick Craig-Wood) 716 * Add GLACIER storage class (William Cocker) 717 * Add Scaleway to s3 documentation (Rémy Léone) 718 * Add AWS endpoint eu-north-1 (weetmuts) 719 * SFTP 720 * Add support for PEM encrypted private keys (Fabian Möller) 721 * Add option to force the usage of an ssh-agent (Fabian Möller) 722 * Perform environment variable expansion on key-file (Fabian Möller) 723 * Fix rmdir on Windows based servers (eg CrushFTP) (Nick Craig-Wood) 724 * Fix rmdir deleting directory contents on some SFTP servers (Nick Craig-Wood) 725 * Fix error on dangling symlinks (Nick Craig-Wood) 726 * Swift 727 * Add `--swift-no-chunk` to disable segmented uploads in rcat/mount (Nick Craig-Wood) 728 * Introduce application credential auth support (kayrus) 729 * Fix memory usage by slimming Object (Nick Craig-Wood) 730 * Fix extra requests on upload (Nick Craig-Wood) 731 * Fix reauth on big files (Nick Craig-Wood) 732 * Union 733 * Fix poll-interval not working (Nick Craig-Wood) 734 * WebDAV 735 * Support About which means rclone mount will show the correct disk size (Nick Craig-Wood) 736 * Support MD5 and SHA1 hashes with Owncloud and Nextcloud (Nick Craig-Wood) 737 * Fail soft on time parsing errors (Nick Craig-Wood) 738 * Fix infinite loop on failed directory creation (Nick Craig-Wood) 739 * Fix identification of directories for Bitrix Site Manager (Nick Craig-Wood) 740 * Fix upload of 0 length files on some servers (Nick Craig-Wood) 741 * Fix if MKCOL fails with 423 Locked assume the directory exists (Nick Craig-Wood) 742 743 ## v1.45 - 2018-11-24 744 745 * New backends 746 * The Yandex backend was re-written - see below for details (Sebastian Bünger) 747 * New commands 748 * rcd: New command just to serve the remote control API (Nick Craig-Wood) 749 * New Features 750 * The remote control API (rc) was greatly expanded to allow full control over rclone (Nick Craig-Wood) 751 * sensitive operations require authorization or the `--rc-no-auth` flag 752 * config/* operations to configure rclone 753 * options/* for reading/setting command line flags 754 * operations/* for all low level operations, eg copy file, list directory 755 * sync/* for sync, copy and move 756 * `--rc-files` flag to serve files on the rc http server 757 * this is for building web native GUIs for rclone 758 * Optionally serving objects on the rc http server 759 * Ensure rclone fails to start up if the `--rc` port is in use already 760 * See [the rc docs](https://rclone.org/rc/) for more info 761 * sync/copy/move 762 * Make `--files-from` only read the objects specified and don't scan directories (Nick Craig-Wood) 763 * This is a huge speed improvement for destinations with lots of files 764 * filter: Add `--ignore-case` flag (Nick Craig-Wood) 765 * ncdu: Add remove function ('d' key) (Henning Surmeier) 766 * rc command 767 * Add `--json` flag for structured JSON input (Nick Craig-Wood) 768 * Add `--user` and `--pass` flags and interpret `--rc-user`, `--rc-pass`, `--rc-addr` (Nick Craig-Wood) 769 * build 770 * Require go1.8 or later for compilation (Nick Craig-Wood) 771 * Enable softfloat on MIPS arch (Scott Edlund) 772 * Integration test framework revamped with a better report and better retries (Nick Craig-Wood) 773 * Bug Fixes 774 * cmd: Make `--progress` update the stats correctly at the end (Nick Craig-Wood) 775 * config: Create config directory on save if it is missing (Nick Craig-Wood) 776 * dedupe: Check for existing filename before renaming a dupe file (ssaqua) 777 * move: Don't create directories with `--dry-run` (Nick Craig-Wood) 778 * operations: Fix Purge and Rmdirs when dir is not the root (Nick Craig-Wood) 779 * serve http/webdav/restic: Ensure rclone exits if the port is in use (Nick Craig-Wood) 780 * Mount 781 * Make `--volname` work for Windows and macOS (Nick Craig-Wood) 782 * Azure Blob 783 * Avoid context deadline exceeded error by setting a large TryTimeout value (brused27) 784 * Fix erroneous Rmdir error "directory not empty" (Nick Craig-Wood) 785 * Wait for up to 60s to create a just deleted container (Nick Craig-Wood) 786 * Dropbox 787 * Add dropbox impersonate support (Jake Coggiano) 788 * Jottacloud 789 * Fix bug in `--fast-list` handing of empty folders (albertony) 790 * Opendrive 791 * Fix transfer of files with `+` and `&` in (Nick Craig-Wood) 792 * Fix retries of upload chunks (Nick Craig-Wood) 793 * S3 794 * Set ACL for server side copies to that provided by the user (Nick Craig-Wood) 795 * Fix role_arn, credential_source, ... (Erik Swanson) 796 * Add config info for Wasabi's US-West endpoint (Henry Ptasinski) 797 * SFTP 798 * Ensure file hash checking is really disabled (Jon Fautley) 799 * Swift 800 * Add pacer for retries to make swift more reliable (Nick Craig-Wood) 801 * WebDAV 802 * Add Content-Type to PUT requests (Nick Craig-Wood) 803 * Fix config parsing so `--webdav-user` and `--webdav-pass` flags work (Nick Craig-Wood) 804 * Add RFC3339 date format (Ralf Hemberger) 805 * Yandex 806 * The yandex backend was re-written (Sebastian Bünger) 807 * This implements low level retries (Sebastian Bünger) 808 * Copy, Move, DirMove, PublicLink and About optional interfaces (Sebastian Bünger) 809 * Improved general error handling (Sebastian Bünger) 810 * Removed ListR for now due to inconsistent behaviour (Sebastian Bünger) 811 812 ## v1.44 - 2018-10-15 813 814 * New commands 815 * serve ftp: Add ftp server (Antoine GIRARD) 816 * settier: perform storage tier changes on supported remotes (sandeepkru) 817 * New Features 818 * Reworked command line help 819 * Make default help less verbose (Nick Craig-Wood) 820 * Split flags up into global and backend flags (Nick Craig-Wood) 821 * Implement specialised help for flags and backends (Nick Craig-Wood) 822 * Show URL of backend help page when starting config (Nick Craig-Wood) 823 * stats: Long names now split in center (Joanna Marek) 824 * Add `--log-format` flag for more control over log output (dcpu) 825 * rc: Add support for OPTIONS and basic CORS (frenos) 826 * stats: show FatalErrors and NoRetryErrors in stats (Cédric Connes) 827 * Bug Fixes 828 * Fix -P not ending with a new line (Nick Craig-Wood) 829 * config: don't create default config dir when user supplies `--config` (albertony) 830 * Don't print non-ASCII characters with `--progress` on windows (Nick Craig-Wood) 831 * Correct logs for excluded items (ssaqua) 832 * Mount 833 * Remove EXPERIMENTAL tags (Nick Craig-Wood) 834 * VFS 835 * Fix race condition detected by serve ftp tests (Nick Craig-Wood) 836 * Add vfs/poll-interval rc command (Fabian Möller) 837 * Enable rename for nearly all remotes using server side Move or Copy (Nick Craig-Wood) 838 * Reduce directory cache cleared by poll-interval (Fabian Möller) 839 * Remove EXPERIMENTAL tags (Nick Craig-Wood) 840 * Local 841 * Skip bad symlinks in dir listing with -L enabled (Cédric Connes) 842 * Preallocate files on Windows to reduce fragmentation (Nick Craig-Wood) 843 * Preallocate files on linux with fallocate(2) (Nick Craig-Wood) 844 * Cache 845 * Add cache/fetch rc function (Fabian Möller) 846 * Fix worker scale down (Fabian Möller) 847 * Improve performance by not sending info requests for cached chunks (dcpu) 848 * Fix error return value of cache/fetch rc method (Fabian Möller) 849 * Documentation fix for cache-chunk-total-size (Anagh Kumar Baranwal) 850 * Preserve leading / in wrapped remote path (Fabian Möller) 851 * Add plex_insecure option to skip certificate validation (Fabian Möller) 852 * Remove entries that no longer exist in the source (dcpu) 853 * Crypt 854 * Preserve leading / in wrapped remote path (Fabian Möller) 855 * Alias 856 * Fix handling of Windows network paths (Nick Craig-Wood) 857 * Azure Blob 858 * Add `--azureblob-list-chunk` parameter (Santiago Rodríguez) 859 * Implemented settier command support on azureblob remote. (sandeepkru) 860 * Work around SDK bug which causes errors for chunk-sized files (Nick Craig-Wood) 861 * Box 862 * Implement link sharing. (Sebastian Bünger) 863 * Drive 864 * Add `--drive-import-formats` - google docs can now be imported (Fabian Möller) 865 * Rewrite mime type and extension handling (Fabian Möller) 866 * Add document links (Fabian Möller) 867 * Add support for multipart document extensions (Fabian Möller) 868 * Add support for apps-script to json export (Fabian Möller) 869 * Fix escaped chars in documents during list (Fabian Möller) 870 * Add `--drive-v2-download-min-size` a workaround for slow downloads (Fabian Möller) 871 * Improve directory notifications in ChangeNotify (Fabian Möller) 872 * When listing team drives in config, continue on failure (Nick Craig-Wood) 873 * FTP 874 * Add a small pause after failed upload before deleting file (Nick Craig-Wood) 875 * Google Cloud Storage 876 * Fix service_account_file being ignored (Fabian Möller) 877 * Jottacloud 878 * Minor improvement in quota info (omit if unlimited) (albertony) 879 * Add `--fast-list` support (albertony) 880 * Add permanent delete support: `--jottacloud-hard-delete` (albertony) 881 * Add link sharing support (albertony) 882 * Fix handling of reserved characters. (Sebastian Bünger) 883 * Fix socket leak on Object.Remove (Nick Craig-Wood) 884 * Onedrive 885 * Rework to support Microsoft Graph (Cnly) 886 * **NB** this will require re-authenticating the remote 887 * Removed upload cutoff and always do session uploads (Oliver Heyme) 888 * Use single-part upload for empty files (Cnly) 889 * Fix new fields not saved when editing old config (Alex Chen) 890 * Fix sometimes special chars in filenames not replaced (Alex Chen) 891 * Ignore OneNote files by default (Alex Chen) 892 * Add link sharing support (jackyzy823) 893 * S3 894 * Use custom pacer, to retry operations when reasonable (Craig Miskell) 895 * Use configured server-side-encryption and storace class options when calling CopyObject() (Paul Kohout) 896 * Make `--s3-v2-auth` flag (Nick Craig-Wood) 897 * Fix v2 auth on files with spaces (Nick Craig-Wood) 898 * Union 899 * Implement union backend which reads from multiple backends (Felix Brucker) 900 * Implement optional interfaces (Move, DirMove, Copy etc) (Nick Craig-Wood) 901 * Fix ChangeNotify to support multiple remotes (Fabian Möller) 902 * Fix `--backup-dir` on union backend (Nick Craig-Wood) 903 * WebDAV 904 * Add another time format (Nick Craig-Wood) 905 * Add a small pause after failed upload before deleting file (Nick Craig-Wood) 906 * Add workaround for missing mtime (buergi) 907 * Sharepoint: Renew cookies after 12hrs (Henning Surmeier) 908 * Yandex 909 * Remove redundant nil checks (teresy) 910 911 ## v1.43.1 - 2018-09-07 912 913 Point release to fix hubic and azureblob backends. 914 915 * Bug Fixes 916 * ncdu: Return error instead of log.Fatal in Show (Fabian Möller) 917 * cmd: Fix crash with `--progress` and `--stats 0` (Nick Craig-Wood) 918 * docs: Tidy website display (Anagh Kumar Baranwal) 919 * Azure Blob: 920 * Fix multi-part uploads. (sandeepkru) 921 * Hubic 922 * Fix uploads (Nick Craig-Wood) 923 * Retry auth fetching if it fails to make hubic more reliable (Nick Craig-Wood) 924 925 ## v1.43 - 2018-09-01 926 927 * New backends 928 * Jottacloud (Sebastian Bünger) 929 * New commands 930 * copyurl: copies a URL to a remote (Denis) 931 * New Features 932 * Reworked config for backends (Nick Craig-Wood) 933 * All backend config can now be supplied by command line, env var or config file 934 * Advanced section in the config wizard for the optional items 935 * A large step towards rclone backends being usable in other go software 936 * Allow on the fly remotes with :backend: syntax 937 * Stats revamp 938 * Add `--progress`/`-P` flag to show interactive progress (Nick Craig-Wood) 939 * Show the total progress of the sync in the stats (Nick Craig-Wood) 940 * Add `--stats-one-line` flag for single line stats (Nick Craig-Wood) 941 * Added weekday schedule into `--bwlimit` (Mateusz) 942 * lsjson: Add option to show the original object IDs (Fabian Möller) 943 * serve webdav: Make Content-Type without reading the file and add `--etag-hash` (Nick Craig-Wood) 944 * build 945 * Build macOS with native compiler (Nick Craig-Wood) 946 * Update to use go1.11 for the build (Nick Craig-Wood) 947 * rc 948 * Added core/stats to return the stats (reddi1) 949 * `version --check`: Prints the current release and beta versions (Nick Craig-Wood) 950 * Bug Fixes 951 * accounting 952 * Fix time to completion estimates (Nick Craig-Wood) 953 * Fix moving average speed for file stats (Nick Craig-Wood) 954 * config: Fix error reading password from piped input (Nick Craig-Wood) 955 * move: Fix `--delete-empty-src-dirs` flag to delete all empty dirs on move (ishuah) 956 * Mount 957 * Implement `--daemon-timeout` flag for OSXFUSE (Nick Craig-Wood) 958 * Fix mount `--daemon` not working with encrypted config (Alex Chen) 959 * Clip the number of blocks to 2^32-1 on macOS - fixes borg backup (Nick Craig-Wood) 960 * VFS 961 * Enable vfs-read-chunk-size by default (Fabian Möller) 962 * Add the vfs/refresh rc command (Fabian Möller) 963 * Add non recursive mode to vfs/refresh rc command (Fabian Möller) 964 * Try to seek buffer on read only files (Fabian Möller) 965 * Local 966 * Fix crash when deprecated `--local-no-unicode-normalization` is supplied (Nick Craig-Wood) 967 * Fix mkdir error when trying to copy files to the root of a drive on windows (Nick Craig-Wood) 968 * Cache 969 * Fix nil pointer deref when using lsjson on cached directory (Nick Craig-Wood) 970 * Fix nil pointer deref for occasional crash on playback (Nick Craig-Wood) 971 * Crypt 972 * Fix accounting when checking hashes on upload (Nick Craig-Wood) 973 * Amazon Cloud Drive 974 * Make very clear in the docs that rclone has no ACD keys (Nick Craig-Wood) 975 * Azure Blob 976 * Add connection string and SAS URL auth (Nick Craig-Wood) 977 * List the container to see if it exists (Nick Craig-Wood) 978 * Port new Azure Blob Storage SDK (sandeepkru) 979 * Added blob tier, tier between Hot, Cool and Archive. (sandeepkru) 980 * Remove leading / from paths (Nick Craig-Wood) 981 * B2 982 * Support Application Keys (Nick Craig-Wood) 983 * Remove leading / from paths (Nick Craig-Wood) 984 * Box 985 * Fix upload of > 2GB files on 32 bit platforms (Nick Craig-Wood) 986 * Make `--box-commit-retries` flag defaulting to 100 to fix large uploads (Nick Craig-Wood) 987 * Drive 988 * Add `--drive-keep-revision-forever` flag (lewapm) 989 * Handle gdocs when filtering file names in list (Fabian Möller) 990 * Support using `--fast-list` for large speedups (Fabian Möller) 991 * FTP 992 * Fix Put mkParentDir failed: 521 for BunnyCDN (Nick Craig-Wood) 993 * Google Cloud Storage 994 * Fix index out of range error with `--fast-list` (Nick Craig-Wood) 995 * Jottacloud 996 * Fix MD5 error check (Oliver Heyme) 997 * Handle empty time values (Martin Polden) 998 * Calculate missing MD5s (Oliver Heyme) 999 * Docs, fixes and tests for MD5 calculation (Nick Craig-Wood) 1000 * Add optional MimeTyper interface. (Sebastian Bünger) 1001 * Implement optional About interface (for `df` support). (Sebastian Bünger) 1002 * Mega 1003 * Wait for events instead of arbitrary sleeping (Nick Craig-Wood) 1004 * Add `--mega-hard-delete` flag (Nick Craig-Wood) 1005 * Fix failed logins with upper case chars in email (Nick Craig-Wood) 1006 * Onedrive 1007 * Shared folder support (Yoni Jah) 1008 * Implement DirMove (Cnly) 1009 * Fix rmdir sometimes deleting directories with contents (Nick Craig-Wood) 1010 * Pcloud 1011 * Delete half uploaded files on upload error (Nick Craig-Wood) 1012 * Qingstor 1013 * Remove leading / from paths (Nick Craig-Wood) 1014 * S3 1015 * Fix index out of range error with `--fast-list` (Nick Craig-Wood) 1016 * Add `--s3-force-path-style` (Nick Craig-Wood) 1017 * Add support for KMS Key ID (bsteiss) 1018 * Remove leading / from paths (Nick Craig-Wood) 1019 * Swift 1020 * Add `storage_policy` (Ruben Vandamme) 1021 * Make it so just `storage_url` or `auth_token` can be overidden (Nick Craig-Wood) 1022 * Fix server side copy bug for unusal file names (Nick Craig-Wood) 1023 * Remove leading / from paths (Nick Craig-Wood) 1024 * WebDAV 1025 * Ensure we call MKCOL with a URL with a trailing / for QNAP interop (Nick Craig-Wood) 1026 * If root ends with / then don't check if it is a file (Nick Craig-Wood) 1027 * Don't accept redirects when reading metadata (Nick Craig-Wood) 1028 * Add bearer token (Macaroon) support for dCache (Nick Craig-Wood) 1029 * Document dCache and Macaroons (Onno Zweers) 1030 * Sharepoint recursion with different depth (Henning) 1031 * Attempt to remove failed uploads (Nick Craig-Wood) 1032 * Yandex 1033 * Fix listing/deleting files in the root (Nick Craig-Wood) 1034 1035 ## v1.42 - 2018-06-16 1036 1037 * New backends 1038 * OpenDrive (Oliver Heyme, Jakub Karlicek, ncw) 1039 * New commands 1040 * deletefile command (Filip Bartodziej) 1041 * New Features 1042 * copy, move: Copy single files directly, don't use `--files-from` work-around 1043 * this makes them much more efficient 1044 * Implement `--max-transfer` flag to quit transferring at a limit 1045 * make exit code 8 for `--max-transfer` exceeded 1046 * copy: copy empty source directories to destination (Ishuah Kariuki) 1047 * check: Add `--one-way` flag (Kasper Byrdal Nielsen) 1048 * Add siginfo handler for macOS for ctrl-T stats (kubatasiemski) 1049 * rc 1050 * add core/gc to run a garbage collection on demand 1051 * enable go profiling by default on the `--rc` port 1052 * return error from remote on failure 1053 * lsf 1054 * Add `--absolute` flag to add a leading / onto path names 1055 * Add `--csv` flag for compliant CSV output 1056 * Add 'm' format specifier to show the MimeType 1057 * Implement 'i' format for showing object ID 1058 * lsjson 1059 * Add MimeType to the output 1060 * Add ID field to output to show Object ID 1061 * Add `--retries-sleep` flag (Benjamin Joseph Dag) 1062 * Oauth tidy up web page and error handling (Henning Surmeier) 1063 * Bug Fixes 1064 * Password prompt output with `--log-file` fixed for unix (Filip Bartodziej) 1065 * Calculate ModifyWindow each time on the fly to fix various problems (Stefan Breunig) 1066 * Mount 1067 * Only print "File.rename error" if there actually is an error (Stefan Breunig) 1068 * Delay rename if file has open writers instead of failing outright (Stefan Breunig) 1069 * Ensure atexit gets run on interrupt 1070 * macOS enhancements 1071 * Make `--noappledouble` `--noapplexattr` 1072 * Add `--volname` flag and remove special chars from it 1073 * Make Get/List/Set/Remove xattr return ENOSYS for efficiency 1074 * Make `--daemon` work for macOS without CGO 1075 * VFS 1076 * Add `--vfs-read-chunk-size` and `--vfs-read-chunk-size-limit` (Fabian Möller) 1077 * Fix ChangeNotify for new or changed folders (Fabian Möller) 1078 * Local 1079 * Fix symlink/junction point directory handling under Windows 1080 * **NB** you will need to add `-L` to your command line to copy files with reparse points 1081 * Cache 1082 * Add non cached dirs on notifications (Remus Bunduc) 1083 * Allow root to be expired from rc (Remus Bunduc) 1084 * Clean remaining empty folders from temp upload path (Remus Bunduc) 1085 * Cache lists using batch writes (Remus Bunduc) 1086 * Use secure websockets for HTTPS Plex addresses (John Clayton) 1087 * Reconnect plex websocket on failures (Remus Bunduc) 1088 * Fix panic when running without plex configs (Remus Bunduc) 1089 * Fix root folder caching (Remus Bunduc) 1090 * Crypt 1091 * Check the crypted hash of files when uploading for extra data security 1092 * Dropbox 1093 * Make Dropbox for business folders accessible using an initial `/` in the path 1094 * Google Cloud Storage 1095 * Low level retry all operations if necessary 1096 * Google Drive 1097 * Add `--drive-acknowledge-abuse` to download flagged files 1098 * Add `--drive-alternate-export` to fix large doc export 1099 * Don't attempt to choose Team Drives when using rclone config create 1100 * Fix change list polling with team drives 1101 * Fix ChangeNotify for folders (Fabian Möller) 1102 * Fix about (and df on a mount) for team drives 1103 * Onedrive 1104 * Errorhandler for onedrive for business requests (Henning Surmeier) 1105 * S3 1106 * Adjust upload concurrency with `--s3-upload-concurrency` (themylogin) 1107 * Fix `--s3-chunk-size` which was always using the minimum 1108 * SFTP 1109 * Add `--ssh-path-override` flag (Piotr Oleszczyk) 1110 * Fix slow downloads for long latency connections 1111 * Webdav 1112 * Add workarounds for biz.mail.ru 1113 * Ignore Reason-Phrase in status line to fix 4shared (Rodrigo) 1114 * Better error message generation 1115 1116 ## v1.41 - 2018-04-28 1117 1118 * New backends 1119 * Mega support added 1120 * Webdav now supports SharePoint cookie authentication (hensur) 1121 * New commands 1122 * link: create public link to files and folders (Stefan Breunig) 1123 * about: gets quota info from a remote (a-roussos, ncw) 1124 * hashsum: a generic tool for any hash to produce md5sum like output 1125 * New Features 1126 * lsd: Add -R flag and fix and update docs for all ls commands 1127 * ncdu: added a "refresh" key - CTRL-L (Keith Goldfarb) 1128 * serve restic: Add append-only mode (Steve Kriss) 1129 * serve restic: Disallow overwriting files in append-only mode (Alexander Neumann) 1130 * serve restic: Print actual listener address (Matt Holt) 1131 * size: Add --json flag (Matthew Holt) 1132 * sync: implement --ignore-errors (Mateusz Pabian) 1133 * dedupe: Add dedupe largest functionality (Richard Yang) 1134 * fs: Extend SizeSuffix to include TB and PB for rclone about 1135 * fs: add --dump goroutines and --dump openfiles for debugging 1136 * rc: implement core/memstats to print internal memory usage info 1137 * rc: new call rc/pid (Michael P. Dubner) 1138 * Compile 1139 * Drop support for go1.6 1140 * Release 1141 * Fix `make tarball` (Chih-Hsuan Yen) 1142 * Bug Fixes 1143 * filter: fix --min-age and --max-age together check 1144 * fs: limit MaxIdleConns and MaxIdleConnsPerHost in transport 1145 * lsd,lsf: make sure all times we output are in local time 1146 * rc: fix setting bwlimit to unlimited 1147 * rc: take note of the --rc-addr flag too as per the docs 1148 * Mount 1149 * Use About to return the correct disk total/used/free (eg in `df`) 1150 * Set `--attr-timeout default` to `1s` - fixes: 1151 * rclone using too much memory 1152 * rclone not serving files to samba 1153 * excessive time listing directories 1154 * Fix `df -i` (upstream fix) 1155 * VFS 1156 * Filter files `.` and `..` from directory listing 1157 * Only make the VFS cache if --vfs-cache-mode > Off 1158 * Local 1159 * Add --local-no-check-updated to disable updated file checks 1160 * Retry remove on Windows sharing violation error 1161 * Cache 1162 * Flush the memory cache after close 1163 * Purge file data on notification 1164 * Always forget parent dir for notifications 1165 * Integrate with Plex websocket 1166 * Add rc cache/stats (seuffert) 1167 * Add info log on notification 1168 * Box 1169 * Fix failure reading large directories - parse file/directory size as float 1170 * Dropbox 1171 * Fix crypt+obfuscate on dropbox 1172 * Fix repeatedly uploading the same files 1173 * FTP 1174 * Work around strange response from box FTP server 1175 * More workarounds for FTP servers to fix mkParentDir error 1176 * Fix no error on listing non-existent directory 1177 * Google Cloud Storage 1178 * Add service_account_credentials (Matt Holt) 1179 * Detect bucket presence by listing it - minimises permissions needed 1180 * Ignore zero length directory markers 1181 * Google Drive 1182 * Add service_account_credentials (Matt Holt) 1183 * Fix directory move leaving a hardlinked directory behind 1184 * Return proper google errors when Opening files 1185 * When initialized with a filepath, optional features used incorrect root path (Stefan Breunig) 1186 * HTTP 1187 * Fix sync for servers which don't return Content-Length in HEAD 1188 * Onedrive 1189 * Add QuickXorHash support for OneDrive for business 1190 * Fix socket leak in multipart session upload 1191 * S3 1192 * Look in S3 named profile files for credentials 1193 * Add `--s3-disable-checksum` to disable checksum uploading (Chris Redekop) 1194 * Hierarchical configuration support (Giri Badanahatti) 1195 * Add in config for all the supported S3 providers 1196 * Add One Zone Infrequent Access storage class (Craig Rachel) 1197 * Add --use-server-modtime support (Peter Baumgartner) 1198 * Add --s3-chunk-size option to control multipart uploads 1199 * Ignore zero length directory markers 1200 * SFTP 1201 * Update docs to match code, fix typos and clarify disable_hashcheck prompt (Michael G. Noll) 1202 * Update docs with Synology quirks 1203 * Fail soft with a debug on hash failure 1204 * Swift 1205 * Add --use-server-modtime support (Peter Baumgartner) 1206 * Webdav 1207 * Support SharePoint cookie authentication (hensur) 1208 * Strip leading and trailing / off root 1209 1210 ## v1.40 - 2018-03-19 1211 1212 * New backends 1213 * Alias backend to create aliases for existing remote names (Fabian Möller) 1214 * New commands 1215 * `lsf`: list for parsing purposes (Jakub Tasiemski) 1216 * by default this is a simple non recursive list of files and directories 1217 * it can be configured to add more info in an easy to parse way 1218 * `serve restic`: for serving a remote as a Restic REST endpoint 1219 * This enables restic to use any backends that rclone can access 1220 * Thanks Alexander Neumann for help, patches and review 1221 * `rc`: enable the remote control of a running rclone 1222 * The running rclone must be started with --rc and related flags. 1223 * Currently there is support for bwlimit, and flushing for mount and cache. 1224 * New Features 1225 * `--max-delete` flag to add a delete threshold (Bjørn Erik Pedersen) 1226 * All backends now support RangeOption for ranged Open 1227 * `cat`: Use RangeOption for limited fetches to make more efficient 1228 * `cryptcheck`: make reading of nonce more efficient with RangeOption 1229 * serve http/webdav/restic 1230 * support SSL/TLS 1231 * add `--user` `--pass` and `--htpasswd` for authentication 1232 * `copy`/`move`: detect file size change during copy/move and abort transfer (ishuah) 1233 * `cryptdecode`: added option to return encrypted file names. (ishuah) 1234 * `lsjson`: add `--encrypted` to show encrypted name (Jakub Tasiemski) 1235 * Add `--stats-file-name-length` to specify the printed file name length for stats (Will Gunn) 1236 * Compile 1237 * Code base was shuffled and factored 1238 * backends moved into a backend directory 1239 * large packages split up 1240 * See the CONTRIBUTING.md doc for info as to what lives where now 1241 * Update to using go1.10 as the default go version 1242 * Implement daily [full integration tests](https://pub.rclone.org/integration-tests/) 1243 * Release 1244 * Include a source tarball and sign it and the binaries 1245 * Sign the git tags as part of the release process 1246 * Add .deb and .rpm packages as part of the build 1247 * Make a beta release for all branches on the main repo (but not pull requests) 1248 * Bug Fixes 1249 * config: fixes errors on non existing config by loading config file only on first access 1250 * config: retry saving the config after failure (Mateusz) 1251 * sync: when using `--backup-dir` don't delete files if we can't set their modtime 1252 * this fixes odd behaviour with Dropbox and `--backup-dir` 1253 * fshttp: fix idle timeouts for HTTP connections 1254 * `serve http`: fix serving files with : in - fixes 1255 * Fix `--exclude-if-present` to ignore directories which it doesn't have permission for (Iakov Davydov) 1256 * Make accounting work properly with crypt and b2 1257 * remove `--no-traverse` flag because it is obsolete 1258 * Mount 1259 * Add `--attr-timeout` flag to control attribute caching in kernel 1260 * this now defaults to 0 which is correct but less efficient 1261 * see [the mount docs](/commands/rclone_mount/#attribute-caching) for more info 1262 * Add `--daemon` flag to allow mount to run in the background (ishuah) 1263 * Fix: Return ENOSYS rather than EIO on attempted link 1264 * This fixes FileZilla accessing an rclone mount served over sftp. 1265 * Fix setting modtime twice 1266 * Mount tests now run on CI for Linux (mount & cmount)/Mac/Windows 1267 * Many bugs fixed in the VFS layer - see below 1268 * VFS 1269 * Many fixes for `--vfs-cache-mode` writes and above 1270 * Update cached copy if we know it has changed (fixes stale data) 1271 * Clean path names before using them in the cache 1272 * Disable cache cleaner if `--vfs-cache-poll-interval=0` 1273 * Fill and clean the cache immediately on startup 1274 * Fix Windows opening every file when it stats the file 1275 * Fix applying modtime for an open Write Handle 1276 * Fix creation of files when truncating 1277 * Write 0 bytes when flushing unwritten handles to avoid race conditions in FUSE 1278 * Downgrade "poll-interval is not supported" message to Info 1279 * Make OpenFile and friends return EINVAL if O_RDONLY and O_TRUNC 1280 * Local 1281 * Downgrade "invalid cross-device link: trying copy" to debug 1282 * Make DirMove return fs.ErrorCantDirMove to allow fallback to Copy for cross device 1283 * Fix race conditions updating the hashes 1284 * Cache 1285 * Add support for polling - cache will update when remote changes on supported backends 1286 * Reduce log level for Plex api 1287 * Fix dir cache issue 1288 * Implement `--cache-db-wait-time` flag 1289 * Improve efficiency with RangeOption and RangeSeek 1290 * Fix dirmove with temp fs enabled 1291 * Notify vfs when using temp fs 1292 * Offline uploading 1293 * Remote control support for path flushing 1294 * Amazon cloud drive 1295 * Rclone no longer has any working keys - disable integration tests 1296 * Implement DirChangeNotify to notify cache/vfs/mount of changes 1297 * Azureblob 1298 * Don't check for bucket/container presense if listing was OK 1299 * this makes rclone do one less request per invocation 1300 * Improve accounting for chunked uploads 1301 * Backblaze B2 1302 * Don't check for bucket/container presense if listing was OK 1303 * this makes rclone do one less request per invocation 1304 * Box 1305 * Improve accounting for chunked uploads 1306 * Dropbox 1307 * Fix custom oauth client parameters 1308 * Google Cloud Storage 1309 * Don't check for bucket/container presense if listing was OK 1310 * this makes rclone do one less request per invocation 1311 * Google Drive 1312 * Migrate to api v3 (Fabian Möller) 1313 * Add scope configuration and root folder selection 1314 * Add `--drive-impersonate` for service accounts 1315 * thanks to everyone who tested, explored and contributed docs 1316 * Add `--drive-use-created-date` to use created date as modified date (nbuchanan) 1317 * Request the export formats only when required 1318 * This makes rclone quicker when there are no google docs 1319 * Fix finding paths with latin1 chars (a workaround for a drive bug) 1320 * Fix copying of a single Google doc file 1321 * Fix `--drive-auth-owner-only` to look in all directories 1322 * HTTP 1323 * Fix handling of directories with & in 1324 * Onedrive 1325 * Removed upload cutoff and always do session uploads 1326 * this stops the creation of multiple versions on business onedrive 1327 * Overwrite object size value with real size when reading file. (Victor) 1328 * this fixes oddities when onedrive misreports the size of images 1329 * Pcloud 1330 * Remove unused chunked upload flag and code 1331 * Qingstor 1332 * Don't check for bucket/container presense if listing was OK 1333 * this makes rclone do one less request per invocation 1334 * S3 1335 * Support hashes for multipart files (Chris Redekop) 1336 * Initial support for IBM COS (S3) (Giri Badanahatti) 1337 * Update docs to discourage use of v2 auth with CEPH and others 1338 * Don't check for bucket/container presense if listing was OK 1339 * this makes rclone do one less request per invocation 1340 * Fix server side copy and set modtime on files with + in 1341 * SFTP 1342 * Add option to disable remote hash check command execution (Jon Fautley) 1343 * Add `--sftp-ask-password` flag to prompt for password when needed (Leo R. Lundgren) 1344 * Add `set_modtime` configuration option 1345 * Fix following of symlinks 1346 * Fix reading config file outside of Fs setup 1347 * Fix reading $USER in username fallback not $HOME 1348 * Fix running under crontab - Use correct OS way of reading username 1349 * Swift 1350 * Fix refresh of authentication token 1351 * in v1.39 a bug was introduced which ignored new tokens - this fixes it 1352 * Fix extra HEAD transaction when uploading a new file 1353 * Don't check for bucket/container presense if listing was OK 1354 * this makes rclone do one less request per invocation 1355 * Webdav 1356 * Add new time formats to support mydrive.ch and others 1357 1358 ## v1.39 - 2017-12-23 1359 1360 * New backends 1361 * WebDAV 1362 * tested with nextcloud, owncloud, put.io and others! 1363 * Pcloud 1364 * cache - wraps a cache around other backends (Remus Bunduc) 1365 * useful in combination with mount 1366 * NB this feature is in beta so use with care 1367 * New commands 1368 * serve command with subcommands: 1369 * serve webdav: this implements a webdav server for any rclone remote. 1370 * serve http: command to serve a remote over HTTP 1371 * config: add sub commands for full config file management 1372 * create/delete/dump/edit/file/password/providers/show/update 1373 * touch: to create or update the timestamp of a file (Jakub Tasiemski) 1374 * New Features 1375 * curl install for rclone (Filip Bartodziej) 1376 * --stats now shows percentage, size, rate and ETA in condensed form (Ishuah Kariuki) 1377 * --exclude-if-present to exclude a directory if a file is present (Iakov Davydov) 1378 * rmdirs: add --leave-root flag (lewpam) 1379 * move: add --delete-empty-src-dirs flag to remove dirs after move (Ishuah Kariuki) 1380 * Add --dump flag, introduce --dump requests, responses and remove --dump-auth, --dump-filters 1381 * Obscure X-Auth-Token: from headers when dumping too 1382 * Document and implement exit codes for different failure modes (Ishuah Kariuki) 1383 * Compile 1384 * Bug Fixes 1385 * Retry lots more different types of errors to make multipart transfers more reliable 1386 * Save the config before asking for a token, fixes disappearing oauth config 1387 * Warn the user if --include and --exclude are used together (Ernest Borowski) 1388 * Fix duplicate files (eg on Google drive) causing spurious copies 1389 * Allow trailing and leading whitespace for passwords (Jason Rose) 1390 * ncdu: fix crashes on empty directories 1391 * rcat: fix goroutine leak 1392 * moveto/copyto: Fix to allow copying to the same name 1393 * Mount 1394 * --vfs-cache mode to make writes into mounts more reliable. 1395 * this requires caching files on the disk (see --cache-dir) 1396 * As this is a new feature, use with care 1397 * Use sdnotify to signal systemd the mount is ready (Fabian Möller) 1398 * Check if directory is not empty before mounting (Ernest Borowski) 1399 * Local 1400 * Add error message for cross file system moves 1401 * Fix equality check for times 1402 * Dropbox 1403 * Rework multipart upload 1404 * buffer the chunks when uploading large files so they can be retried 1405 * change default chunk size to 48MB now we are buffering them in memory 1406 * retry every error after the first chunk is done successfully 1407 * Fix error when renaming directories 1408 * Swift 1409 * Fix crash on bad authentication 1410 * Google Drive 1411 * Add service account support (Tim Cooijmans) 1412 * S3 1413 * Make it work properly with Digital Ocean Spaces (Andrew Starr-Bochicchio) 1414 * Fix crash if a bad listing is received 1415 * Add support for ECS task IAM roles (David Minor) 1416 * Backblaze B2 1417 * Fix multipart upload retries 1418 * Fix --hard-delete to make it work 100% of the time 1419 * Swift 1420 * Allow authentication with storage URL and auth key (Giovanni Pizzi) 1421 * Add new fields for swift configuration to support IBM Bluemix Swift (Pierre Carlson) 1422 * Add OS_TENANT_ID and OS_USER_ID to config 1423 * Allow configs with user id instead of user name 1424 * Check if swift segments container exists before creating (John Leach) 1425 * Fix memory leak in swift transfers (upstream fix) 1426 * SFTP 1427 * Add option to enable the use of aes128-cbc cipher (Jon Fautley) 1428 * Amazon cloud drive 1429 * Fix download of large files failing with "Only one auth mechanism allowed" 1430 * crypt 1431 * Option to encrypt directory names or leave them intact 1432 * Implement DirChangeNotify (Fabian Möller) 1433 * onedrive 1434 * Add option to choose resourceURL during setup of OneDrive Business account if more than one is available for user 1435 1436 ## v1.38 - 2017-09-30 1437 1438 * New backends 1439 * Azure Blob Storage (thanks Andrei Dragomir) 1440 * Box 1441 * Onedrive for Business (thanks Oliver Heyme) 1442 * QingStor from QingCloud (thanks wuyu) 1443 * New commands 1444 * `rcat` - read from standard input and stream upload 1445 * `tree` - shows a nicely formatted recursive listing 1446 * `cryptdecode` - decode crypted file names (thanks ishuah) 1447 * `config show` - print the config file 1448 * `config file` - print the config file location 1449 * New Features 1450 * Empty directories are deleted on `sync` 1451 * `dedupe` - implement merging of duplicate directories 1452 * `check` and `cryptcheck` made more consistent and use less memory 1453 * `cleanup` for remaining remotes (thanks ishuah) 1454 * `--immutable` for ensuring that files don't change (thanks Jacob McNamee) 1455 * `--user-agent` option (thanks Alex McGrath Kraak) 1456 * `--disable` flag to disable optional features 1457 * `--bind` flag for choosing the local addr on outgoing connections 1458 * Support for zsh auto-completion (thanks bpicode) 1459 * Stop normalizing file names but do a normalized compare in `sync` 1460 * Compile 1461 * Update to using go1.9 as the default go version 1462 * Remove snapd build due to maintenance problems 1463 * Bug Fixes 1464 * Improve retriable error detection which makes multipart uploads better 1465 * Make `check` obey `--ignore-size` 1466 * Fix bwlimit toggle in conjunction with schedules (thanks cbruegg) 1467 * `config` ensures newly written config is on the same mount 1468 * Local 1469 * Revert to copy when moving file across file system boundaries 1470 * `--skip-links` to suppress symlink warnings (thanks Zhiming Wang) 1471 * Mount 1472 * Re-use `rcat` internals to support uploads from all remotes 1473 * Dropbox 1474 * Fix "entry doesn't belong in directory" error 1475 * Stop using deprecated API methods 1476 * Swift 1477 * Fix server side copy to empty container with `--fast-list` 1478 * Google Drive 1479 * Change the default for `--drive-use-trash` to `true` 1480 * S3 1481 * Set session token when using STS (thanks Girish Ramakrishnan) 1482 * Glacier docs and error messages (thanks Jan Varho) 1483 * Read 1000 (not 1024) items in dir listings to fix Wasabi 1484 * Backblaze B2 1485 * Fix SHA1 mismatch when downloading files with no SHA1 1486 * Calculate missing hashes on the fly instead of spooling 1487 * `--b2-hard-delete` to permanently delete (not hide) files (thanks John Papandriopoulos) 1488 * Hubic 1489 * Fix creating containers - no longer have to use the `default` container 1490 * Swift 1491 * Optionally configure from a standard set of OpenStack environment vars 1492 * Add `endpoint_type` config 1493 * Google Cloud Storage 1494 * Fix bucket creation to work with limited permission users 1495 * SFTP 1496 * Implement connection pooling for multiple ssh connections 1497 * Limit new connections per second 1498 * Add support for MD5 and SHA1 hashes where available (thanks Christian Brüggemann) 1499 * HTTP 1500 * Fix URL encoding issues 1501 * Fix directories with `:` in 1502 * Fix panic with URL encoded content 1503 1504 ## v1.37 - 2017-07-22 1505 1506 * New backends 1507 * FTP - thanks to Antonio Messina 1508 * HTTP - thanks to Vasiliy Tolstov 1509 * New commands 1510 * rclone ncdu - for exploring a remote with a text based user interface. 1511 * rclone lsjson - for listing with a machine readable output 1512 * rclone dbhashsum - to show Dropbox style hashes of files (local or Dropbox) 1513 * New Features 1514 * Implement --fast-list flag 1515 * This allows remotes to list recursively if they can 1516 * This uses less transactions (important if you pay for them) 1517 * This may or may not be quicker 1518 * This will use more memory as it has to hold the listing in memory 1519 * --old-sync-method deprecated - the remaining uses are covered by --fast-list 1520 * This involved a major re-write of all the listing code 1521 * Add --tpslimit and --tpslimit-burst to limit transactions per second 1522 * this is useful in conjuction with `rclone mount` to limit external apps 1523 * Add --stats-log-level so can see --stats without -v 1524 * Print password prompts to stderr - Hraban Luyat 1525 * Warn about duplicate files when syncing 1526 * Oauth improvements 1527 * allow auth_url and token_url to be set in the config file 1528 * Print redirection URI if using own credentials. 1529 * Don't Mkdir at the start of sync to save transactions 1530 * Compile 1531 * Update build to go1.8.3 1532 * Require go1.6 for building rclone 1533 * Compile 386 builds with "GO386=387" for maximum compatibility 1534 * Bug Fixes 1535 * Fix menu selection when no remotes 1536 * Config saving reworked to not kill the file if disk gets full 1537 * Don't delete remote if name does not change while renaming 1538 * moveto, copyto: report transfers and checks as per move and copy 1539 * Local 1540 * Add --local-no-unicode-normalization flag - Bob Potter 1541 * Mount 1542 * Now supported on Windows using cgofuse and WinFsp - thanks to Bill Zissimopoulos for much help 1543 * Compare checksums on upload/download via FUSE 1544 * Unmount when program ends with SIGINT (Ctrl+C) or SIGTERM - Jérôme Vizcaino 1545 * On read only open of file, make open pending until first read 1546 * Make --read-only reject modify operations 1547 * Implement ModTime via FUSE for remotes that support it 1548 * Allow modTime to be changed even before all writers are closed 1549 * Fix panic on renames 1550 * Fix hang on errored upload 1551 * Crypt 1552 * Report the name:root as specified by the user 1553 * Add an "obfuscate" option for filename encryption - Stephen Harris 1554 * Amazon Drive 1555 * Fix initialization order for token renewer 1556 * Remove revoked credentials, allow oauth proxy config and update docs 1557 * B2 1558 * Reduce minimum chunk size to 5MB 1559 * Drive 1560 * Add team drive support 1561 * Reduce bandwidth by adding fields for partial responses - Martin Kristensen 1562 * Implement --drive-shared-with-me flag to view shared with me files - Danny Tsai 1563 * Add --drive-trashed-only to read only the files in the trash 1564 * Remove obsolete --drive-full-list 1565 * Add missing seek to start on retries of chunked uploads 1566 * Fix stats accounting for upload 1567 * Convert / in names to a unicode equivalent (／) 1568 * Poll for Google Drive changes when mounted 1569 * OneDrive 1570 * Fix the uploading of files with spaces 1571 * Fix initialization order for token renewer 1572 * Display speeds accurately when uploading - Yoni Jah 1573 * Swap to using http://localhost:53682/ as redirect URL - Michael Ledin 1574 * Retry on token expired error, reset upload body on retry - Yoni Jah 1575 * Google Cloud Storage 1576 * Add ability to specify location and storage class via config and command line - thanks gdm85 1577 * Create container if necessary on server side copy 1578 * Increase directory listing chunk to 1000 to increase performance 1579 * Obtain a refresh token for GCS - Steven Lu 1580 * Yandex 1581 * Fix the name reported in log messages (was empty) 1582 * Correct error return for listing empty directory 1583 * Dropbox 1584 * Rewritten to use the v2 API 1585 * Now supports ModTime 1586 * Can only set by uploading the file again 1587 * If you uploaded with an old rclone, rclone may upload everything again 1588 * Use `--size-only` or `--checksum` to avoid this 1589 * Now supports the Dropbox content hashing scheme 1590 * Now supports low level retries 1591 * S3 1592 * Work around eventual consistency in bucket creation 1593 * Create container if necessary on server side copy 1594 * Add us-east-2 (Ohio) and eu-west-2 (London) S3 regions - Zahiar Ahmed 1595 * Swift, Hubic 1596 * Fix zero length directory markers showing in the subdirectory listing 1597 * this caused lots of duplicate transfers 1598 * Fix paged directory listings 1599 * this caused duplicate directory errors 1600 * Create container if necessary on server side copy 1601 * Increase directory listing chunk to 1000 to increase performance 1602 * Make sensible error if the user forgets the container 1603 * SFTP 1604 * Add support for using ssh key files 1605 * Fix under Windows 1606 * Fix ssh agent on Windows 1607 * Adapt to latest version of library - Igor Kharin 1608 1609 ## v1.36 - 2017-03-18 1610 1611 * New Features 1612 * SFTP remote (Jack Schmidt) 1613 * Re-implement sync routine to work a directory at a time reducing memory usage 1614 * Logging revamped to be more inline with rsync - now much quieter 1615 * -v only shows transfers 1616 * -vv is for full debug 1617 * --syslog to log to syslog on capable platforms 1618 * Implement --backup-dir and --suffix 1619 * Implement --track-renames (initial implementation by Bjørn Erik Pedersen) 1620 * Add time-based bandwidth limits (Lukas Loesche) 1621 * rclone cryptcheck: checks integrity of crypt remotes 1622 * Allow all config file variables and options to be set from environment variables 1623 * Add --buffer-size parameter to control buffer size for copy 1624 * Make --delete-after the default 1625 * Add --ignore-checksum flag (fixed by Hisham Zarka) 1626 * rclone check: Add --download flag to check all the data, not just hashes 1627 * rclone cat: add --head, --tail, --offset, --count and --discard 1628 * rclone config: when choosing from a list, allow the value to be entered too 1629 * rclone config: allow rename and copy of remotes 1630 * rclone obscure: for generating encrypted passwords for rclone's config (T.C. Ferguson) 1631 * Comply with XDG Base Directory specification (Dario Giovannetti) 1632 * this moves the default location of the config file in a backwards compatible way 1633 * Release changes 1634 * Ubuntu snap support (Dedsec1) 1635 * Compile with go 1.8 1636 * MIPS/Linux big and little endian support 1637 * Bug Fixes 1638 * Fix copyto copying things to the wrong place if the destination dir didn't exist 1639 * Fix parsing of remotes in moveto and copyto 1640 * Fix --delete-before deleting files on copy 1641 * Fix --files-from with an empty file copying everything 1642 * Fix sync: don't update mod times if --dry-run set 1643 * Fix MimeType propagation 1644 * Fix filters to add ** rules to directory rules 1645 * Local 1646 * Implement -L, --copy-links flag to allow rclone to follow symlinks 1647 * Open files in write only mode so rclone can write to an rclone mount 1648 * Fix unnormalised unicode causing problems reading directories 1649 * Fix interaction between -x flag and --max-depth 1650 * Mount 1651 * Implement proper directory handling (mkdir, rmdir, renaming) 1652 * Make include and exclude filters apply to mount 1653 * Implement read and write async buffers - control with --buffer-size 1654 * Fix fsync on for directories 1655 * Fix retry on network failure when reading off crypt 1656 * Crypt 1657 * Add --crypt-show-mapping to show encrypted file mapping 1658 * Fix crypt writer getting stuck in a loop 1659 * **IMPORTANT** this bug had the potential to cause data corruption when 1660 * reading data from a network based remote and 1661 * writing to a crypt on Google Drive 1662 * Use the cryptcheck command to validate your data if you are concerned 1663 * If syncing two crypt remotes, sync the unencrypted remote 1664 * Amazon Drive 1665 * Fix panics on Move (rename) 1666 * Fix panic on token expiry 1667 * B2 1668 * Fix inconsistent listings and rclone check 1669 * Fix uploading empty files with go1.8 1670 * Constrain memory usage when doing multipart uploads 1671 * Fix upload url not being refreshed properly 1672 * Drive 1673 * Fix Rmdir on directories with trashed files 1674 * Fix "Ignoring unknown object" when downloading 1675 * Add --drive-list-chunk 1676 * Add --drive-skip-gdocs (Károly Oláh) 1677 * OneDrive 1678 * Implement Move 1679 * Fix Copy 1680 * Fix overwrite detection in Copy 1681 * Fix waitForJob to parse errors correctly 1682 * Use token renewer to stop auth errors on long uploads 1683 * Fix uploading empty files with go1.8 1684 * Google Cloud Storage 1685 * Fix depth 1 directory listings 1686 * Yandex 1687 * Fix single level directory listing 1688 * Dropbox 1689 * Normalise the case for single level directory listings 1690 * Fix depth 1 listing 1691 * S3 1692 * Added ca-central-1 region (Jon Yergatian) 1693 1694 ## v1.35 - 2017-01-02 1695 1696 * New Features 1697 * moveto and copyto commands for choosing a destination name on copy/move 1698 * rmdirs command to recursively delete empty directories 1699 * Allow repeated --include/--exclude/--filter options 1700 * Only show transfer stats on commands which transfer stuff 1701 * show stats on any command using the `--stats` flag 1702 * Allow overlapping directories in move when server side dir move is supported 1703 * Add --stats-unit option - thanks Scott McGillivray 1704 * Bug Fixes 1705 * Fix the config file being overwritten when two rclones are running 1706 * Make rclone lsd obey the filters properly 1707 * Fix compilation on mips 1708 * Fix not transferring files that don't differ in size 1709 * Fix panic on nil retry/fatal error 1710 * Mount 1711 * Retry reads on error - should help with reliability a lot 1712 * Report the modification times for directories from the remote 1713 * Add bandwidth accounting and limiting (fixes --bwlimit) 1714 * If --stats provided will show stats and which files are transferring 1715 * Support R/W files if truncate is set. 1716 * Implement statfs interface so df works 1717 * Note that write is now supported on Amazon Drive 1718 * Report number of blocks in a file - thanks Stefan Breunig 1719 * Crypt 1720 * Prevent the user pointing crypt at itself 1721 * Fix failed to authenticate decrypted block errors 1722 * these will now return the underlying unexpected EOF instead 1723 * Amazon Drive 1724 * Add support for server side move and directory move - thanks Stefan Breunig 1725 * Fix nil pointer deref on size attribute 1726 * B2 1727 * Use new prefix and delimiter parameters in directory listings 1728 * This makes --max-depth 1 dir listings as used in mount much faster 1729 * Reauth the account while doing uploads too - should help with token expiry 1730 * Drive 1731 * Make DirMove more efficient and complain about moving the root 1732 * Create destination directory on Move() 1733 1734 ## v1.34 - 2016-11-06 1735 1736 * New Features 1737 * Stop single file and `--files-from` operations iterating through the source bucket. 1738 * Stop removing failed upload to cloud storage remotes 1739 * Make ContentType be preserved for cloud to cloud copies 1740 * Add support to toggle bandwidth limits via SIGUSR2 - thanks Marco Paganini 1741 * `rclone check` shows count of hashes that couldn't be checked 1742 * `rclone listremotes` command 1743 * Support linux/arm64 build - thanks Fredrik Fornwall 1744 * Remove `Authorization:` lines from `--dump-headers` output 1745 * Bug Fixes 1746 * Ignore files with control characters in the names 1747 * Fix `rclone move` command 1748 * Delete src files which already existed in dst 1749 * Fix deletion of src file when dst file older 1750 * Fix `rclone check` on crypted file systems 1751 * Make failed uploads not count as "Transferred" 1752 * Make sure high level retries show with `-q` 1753 * Use a vendor directory with godep for repeatable builds 1754 * `rclone mount` - FUSE 1755 * Implement FUSE mount options 1756 * `--no-modtime`, `--debug-fuse`, `--read-only`, `--allow-non-empty`, `--allow-root`, `--allow-other` 1757 * `--default-permissions`, `--write-back-cache`, `--max-read-ahead`, `--umask`, `--uid`, `--gid` 1758 * Add `--dir-cache-time` to control caching of directory entries 1759 * Implement seek for files opened for read (useful for video players) 1760 * with `-no-seek` flag to disable 1761 * Fix crash on 32 bit ARM (alignment of 64 bit counter) 1762 * ...and many more internal fixes and improvements! 1763 * Crypt 1764 * Don't show encrypted password in configurator to stop confusion 1765 * Amazon Drive 1766 * New wait for upload option `--acd-upload-wait-per-gb` 1767 * upload timeouts scale by file size and can be disabled 1768 * Add 502 Bad Gateway to list of errors we retry 1769 * Fix overwriting a file with a zero length file 1770 * Fix ACD file size warning limit - thanks Felix Bünemann 1771 * Local 1772 * Unix: implement `-x`/`--one-file-system` to stay on a single file system 1773 * thanks Durval Menezes and Luiz Carlos Rumbelsperger Viana 1774 * Windows: ignore the symlink bit on files 1775 * Windows: Ignore directory based junction points 1776 * B2 1777 * Make sure each upload has at least one upload slot - fixes strange upload stats 1778 * Fix uploads when using crypt 1779 * Fix download of large files (sha1 mismatch) 1780 * Return error when we try to create a bucket which someone else owns 1781 * Update B2 docs with Data usage, and Crypt section - thanks Tomasz Mazur 1782 * S3 1783 * Command line and config file support for 1784 * Setting/overriding ACL - thanks Radek Senfeld 1785 * Setting storage class - thanks Asko Tamm 1786 * Drive 1787 * Make exponential backoff work exactly as per Google specification 1788 * add `.epub`, `.odp` and `.tsv` as export formats. 1789 * Swift 1790 * Don't read metadata for directory marker objects 1791 1792 ## v1.33 - 2016-08-24 1793 1794 * New Features 1795 * Implement encryption 1796 * data encrypted in NACL secretbox format 1797 * with optional file name encryption 1798 * New commands 1799 * rclone mount - implements FUSE mounting of remotes (EXPERIMENTAL) 1800 * works on Linux, FreeBSD and OS X (need testers for the last 2!) 1801 * rclone cat - outputs remote file or files to the terminal 1802 * rclone genautocomplete - command to make a bash completion script for rclone 1803 * Editing a remote using `rclone config` now goes through the wizard 1804 * Compile with go 1.7 - this fixes rclone on macOS Sierra and on 386 processors 1805 * Use cobra for sub commands and docs generation 1806 * drive 1807 * Document how to make your own client_id 1808 * s3 1809 * User-configurable Amazon S3 ACL (thanks Radek Šenfeld) 1810 * b2 1811 * Fix stats accounting for upload - no more jumping to 100% done 1812 * On cleanup delete hide marker if it is the current file 1813 * New B2 API endpoint (thanks Per Cederberg) 1814 * Set maximum backoff to 5 Minutes 1815 * onedrive 1816 * Fix URL escaping in file names - eg uploading files with `+` in them. 1817 * amazon cloud drive 1818 * Fix token expiry during large uploads 1819 * Work around 408 REQUEST_TIMEOUT and 504 GATEWAY_TIMEOUT errors 1820 * local 1821 * Fix filenames with invalid UTF-8 not being uploaded 1822 * Fix problem with some UTF-8 characters on OS X 1823 1824 ## v1.32 - 2016-07-13 1825 1826 * Backblaze B2 1827 * Fix upload of files large files not in root 1828 1829 ## v1.31 - 2016-07-13 1830 1831 * New Features 1832 * Reduce memory on sync by about 50% 1833 * Implement --no-traverse flag to stop copy traversing the destination remote. 1834 * This can be used to reduce memory usage down to the smallest possible. 1835 * Useful to copy a small number of files into a large destination folder. 1836 * Implement cleanup command for emptying trash / removing old versions of files 1837 * Currently B2 only 1838 * Single file handling improved 1839 * Now copied with --files-from 1840 * Automatically sets --no-traverse when copying a single file 1841 * Info on using installing with ansible - thanks Stefan Weichinger 1842 * Implement --no-update-modtime flag to stop rclone fixing the remote modified times. 1843 * Bug Fixes 1844 * Fix move command - stop it running for overlapping Fses - this was causing data loss. 1845 * Local 1846 * Fix incomplete hashes - this was causing problems for B2. 1847 * Amazon Drive 1848 * Rename Amazon Cloud Drive to Amazon Drive - no changes to config file needed. 1849 * Swift 1850 * Add support for non-default project domain - thanks Antonio Messina. 1851 * S3 1852 * Add instructions on how to use rclone with minio. 1853 * Add ap-northeast-2 (Seoul) and ap-south-1 (Mumbai) regions. 1854 * Skip setting the modified time for objects > 5GB as it isn't possible. 1855 * Backblaze B2 1856 * Add --b2-versions flag so old versions can be listed and retreived. 1857 * Treat 403 errors (eg cap exceeded) as fatal. 1858 * Implement cleanup command for deleting old file versions. 1859 * Make error handling compliant with B2 integrations notes. 1860 * Fix handling of token expiry. 1861 * Implement --b2-test-mode to set `X-Bz-Test-Mode` header. 1862 * Set cutoff for chunked upload to 200MB as per B2 guidelines. 1863 * Make upload multi-threaded. 1864 * Dropbox 1865 * Don't retry 461 errors. 1866 1867 ## v1.30 - 2016-06-18 1868 1869 * New Features 1870 * Directory listing code reworked for more features and better error reporting (thanks to Klaus Post for help). This enables 1871 * Directory include filtering for efficiency 1872 * --max-depth parameter 1873 * Better error reporting 1874 * More to come 1875 * Retry more errors 1876 * Add --ignore-size flag - for uploading images to onedrive 1877 * Log -v output to stdout by default 1878 * Display the transfer stats in more human readable form 1879 * Make 0 size files specifiable with `--max-size 0b` 1880 * Add `b` suffix so we can specify bytes in --bwlimit, --min-size etc 1881 * Use "password:" instead of "password>" prompt - thanks Klaus Post and Leigh Klotz 1882 * Bug Fixes 1883 * Fix retry doing one too many retries 1884 * Local 1885 * Fix problems with OS X and UTF-8 characters 1886 * Amazon Drive 1887 * Check a file exists before uploading to help with 408 Conflict errors 1888 * Reauth on 401 errors - this has been causing a lot of problems 1889 * Work around spurious 403 errors 1890 * Restart directory listings on error 1891 * Google Drive 1892 * Check a file exists before uploading to help with duplicates 1893 * Fix retry of multipart uploads 1894 * Backblaze B2 1895 * Implement large file uploading 1896 * S3 1897 * Add AES256 server-side encryption for - thanks Justin R. Wilson 1898 * Google Cloud Storage 1899 * Make sure we don't use conflicting content types on upload 1900 * Add service account support - thanks Michal Witkowski 1901 * Swift 1902 * Add auth version parameter 1903 * Add domain option for openstack (v3 auth) - thanks Fabian Ruff 1904 1905 ## v1.29 - 2016-04-18 1906 1907 * New Features 1908 * Implement `-I, --ignore-times` for unconditional upload 1909 * Improve `dedupe`command 1910 * Now removes identical copies without asking 1911 * Now obeys `--dry-run` 1912 * Implement `--dedupe-mode` for non interactive running 1913 * `--dedupe-mode interactive` - interactive the default. 1914 * `--dedupe-mode skip` - removes identical files then skips anything left. 1915 * `--dedupe-mode first` - removes identical files then keeps the first one. 1916 * `--dedupe-mode newest` - removes identical files then keeps the newest one. 1917 * `--dedupe-mode oldest` - removes identical files then keeps the oldest one. 1918 * `--dedupe-mode rename` - removes identical files then renames the rest to be different. 1919 * Bug fixes 1920 * Make rclone check obey the `--size-only` flag. 1921 * Use "application/octet-stream" if discovered mime type is invalid. 1922 * Fix missing "quit" option when there are no remotes. 1923 * Google Drive 1924 * Increase default chunk size to 8 MB - increases upload speed of big files 1925 * Speed up directory listings and make more reliable 1926 * Add missing retries for Move and DirMove - increases reliability 1927 * Preserve mime type on file update 1928 * Backblaze B2 1929 * Enable mod time syncing 1930 * This means that B2 will now check modification times 1931 * It will upload new files to update the modification times 1932 * (there isn't an API to just set the mod time.) 1933 * If you want the old behaviour use `--size-only`. 1934 * Update API to new version 1935 * Fix parsing of mod time when not in metadata 1936 * Swift/Hubic 1937 * Don't return an MD5SUM for static large objects 1938 * S3 1939 * Fix uploading files bigger than 50GB 1940 1941 ## v1.28 - 2016-03-01 1942 1943 * New Features 1944 * Configuration file encryption - thanks Klaus Post 1945 * Improve `rclone config` adding more help and making it easier to understand 1946 * Implement `-u`/`--update` so creation times can be used on all remotes 1947 * Implement `--low-level-retries` flag 1948 * Optionally disable gzip compression on downloads with `--no-gzip-encoding` 1949 * Bug fixes 1950 * Don't make directories if `--dry-run` set 1951 * Fix and document the `move` command 1952 * Fix redirecting stderr on unix-like OSes when using `--log-file` 1953 * Fix `delete` command to wait until all finished - fixes missing deletes. 1954 * Backblaze B2 1955 * Use one upload URL per go routine fixes `more than one upload using auth token` 1956 * Add pacing, retries and reauthentication - fixes token expiry problems 1957 * Upload without using a temporary file from local (and remotes which support SHA1) 1958 * Fix reading metadata for all files when it shouldn't have been 1959 * Drive 1960 * Fix listing drive documents at root 1961 * Disable copy and move for Google docs 1962 * Swift 1963 * Fix uploading of chunked files with non ASCII characters 1964 * Allow setting of `storage_url` in the config - thanks Xavier Lucas 1965 * S3 1966 * Allow IAM role and credentials from environment variables - thanks Brian Stengaard 1967 * Allow low privilege users to use S3 (check if directory exists during Mkdir) - thanks Jakub Gedeon 1968 * Amazon Drive 1969 * Retry on more things to make directory listings more reliable 1970 1971 ## v1.27 - 2016-01-31 1972 1973 * New Features 1974 * Easier headless configuration with `rclone authorize` 1975 * Add support for multiple hash types - we now check SHA1 as well as MD5 hashes. 1976 * `delete` command which does obey the filters (unlike `purge`) 1977 * `dedupe` command to deduplicate a remote. Useful with Google Drive. 1978 * Add `--ignore-existing` flag to skip all files that exist on destination. 1979 * Add `--delete-before`, `--delete-during`, `--delete-after` flags. 1980 * Add `--memprofile` flag to debug memory use. 1981 * Warn the user about files with same name but different case 1982 * Make `--include` rules add their implict exclude * at the end of the filter list 1983 * Deprecate compiling with go1.3 1984 * Amazon Drive 1985 * Fix download of files > 10 GB 1986 * Fix directory traversal ("Next token is expired") for large directory listings 1987 * Remove 409 conflict from error codes we will retry - stops very long pauses 1988 * Backblaze B2 1989 * SHA1 hashes now checked by rclone core 1990 * Drive 1991 * Add `--drive-auth-owner-only` to only consider files owned by the user - thanks Björn Harrtell 1992 * Export Google documents 1993 * Dropbox 1994 * Make file exclusion error controllable with -q 1995 * Swift 1996 * Fix upload from unprivileged user. 1997 * S3 1998 * Fix updating of mod times of files with `+` in. 1999 * Local 2000 * Add local file system option to disable UNC on Windows. 2001 2002 ## v1.26 - 2016-01-02 2003 2004 * New Features 2005 * Yandex storage backend - thank you Dmitry Burdeev ("dibu") 2006 * Implement Backblaze B2 storage backend 2007 * Add --min-age and --max-age flags - thank you Adriano Aurélio Meirelles 2008 * Make ls/lsl/md5sum/size/check obey includes and excludes 2009 * Fixes 2010 * Fix crash in http logging 2011 * Upload releases to github too 2012 * Swift 2013 * Fix sync for chunked files 2014 * OneDrive 2015 * Re-enable server side copy 2016 * Don't mask HTTP error codes with JSON decode error 2017 * S3 2018 * Fix corrupting Content-Type on mod time update (thanks Joseph Spurrier) 2019 2020 ## v1.25 - 2015-11-14 2021 2022 * New features 2023 * Implement Hubic storage system 2024 * Fixes 2025 * Fix deletion of some excluded files without --delete-excluded 2026 * This could have deleted files unexpectedly on sync 2027 * Always check first with `--dry-run`! 2028 * Swift 2029 * Stop SetModTime losing metadata (eg X-Object-Manifest) 2030 * This could have caused data loss for files > 5GB in size 2031 * Use ContentType from Object to avoid lookups in listings 2032 * OneDrive 2033 * disable server side copy as it seems to be broken at Microsoft 2034 2035 ## v1.24 - 2015-11-07 2036 2037 * New features 2038 * Add support for Microsoft OneDrive 2039 * Add `--no-check-certificate` option to disable server certificate verification 2040 * Add async readahead buffer for faster transfer of big files 2041 * Fixes 2042 * Allow spaces in remotes and check remote names for validity at creation time 2043 * Allow '&' and disallow ':' in Windows filenames. 2044 * Swift 2045 * Ignore directory marker objects where appropriate - allows working with Hubic 2046 * Don't delete the container if fs wasn't at root 2047 * S3 2048 * Don't delete the bucket if fs wasn't at root 2049 * Google Cloud Storage 2050 * Don't delete the bucket if fs wasn't at root 2051 2052 ## v1.23 - 2015-10-03 2053 2054 * New features 2055 * Implement `rclone size` for measuring remotes 2056 * Fixes 2057 * Fix headless config for drive and gcs 2058 * Tell the user they should try again if the webserver method failed 2059 * Improve output of `--dump-headers` 2060 * S3 2061 * Allow anonymous access to public buckets 2062 * Swift 2063 * Stop chunked operations logging "Failed to read info: Object Not Found" 2064 * Use Content-Length on uploads for extra reliability 2065 2066 ## v1.22 - 2015-09-28 2067 2068 * Implement rsync like include and exclude flags 2069 * swift 2070 * Support files > 5GB - thanks Sergey Tolmachev 2071 2072 ## v1.21 - 2015-09-22 2073 2074 * New features 2075 * Display individual transfer progress 2076 * Make lsl output times in localtime 2077 * Fixes 2078 * Fix allowing user to override credentials again in Drive, GCS and ACD 2079 * Amazon Drive 2080 * Implement compliant pacing scheme 2081 * Google Drive 2082 * Make directory reads concurrent for increased speed. 2083 2084 ## v1.20 - 2015-09-15 2085 2086 * New features 2087 * Amazon Drive support 2088 * Oauth support redone - fix many bugs and improve usability 2089 * Use "golang.org/x/oauth2" as oauth libary of choice 2090 * Improve oauth usability for smoother initial signup 2091 * drive, googlecloudstorage: optionally use auto config for the oauth token 2092 * Implement --dump-headers and --dump-bodies debug flags 2093 * Show multiple matched commands if abbreviation too short 2094 * Implement server side move where possible 2095 * local 2096 * Always use UNC paths internally on Windows - fixes a lot of bugs 2097 * dropbox 2098 * force use of our custom transport which makes timeouts work 2099 * Thanks to Klaus Post for lots of help with this release 2100 2101 ## v1.19 - 2015-08-28 2102 2103 * New features 2104 * Server side copies for s3/swift/drive/dropbox/gcs 2105 * Move command - uses server side copies if it can 2106 * Implement --retries flag - tries 3 times by default 2107 * Build for plan9/amd64 and solaris/amd64 too 2108 * Fixes 2109 * Make a current version download with a fixed URL for scripting 2110 * Ignore rmdir in limited fs rather than throwing error 2111 * dropbox 2112 * Increase chunk size to improve upload speeds massively 2113 * Issue an error message when trying to upload bad file name 2114 2115 ## v1.18 - 2015-08-17 2116 2117 * drive 2118 * Add `--drive-use-trash` flag so rclone trashes instead of deletes 2119 * Add "Forbidden to download" message for files with no downloadURL 2120 * dropbox 2121 * Remove datastore 2122 * This was deprecated and it caused a lot of problems 2123 * Modification times and MD5SUMs no longer stored 2124 * Fix uploading files > 2GB 2125 * s3 2126 * use official AWS SDK from github.com/aws/aws-sdk-go 2127 * **NB** will most likely require you to delete and recreate remote 2128 * enable multipart upload which enables files > 5GB 2129 * tested with Ceph / RadosGW / S3 emulation 2130 * many thanks to Sam Liston and Brian Haymore at the [Utah Center for High Performance Computing](https://www.chpc.utah.edu/) for a Ceph test account 2131 * misc 2132 * Show errors when reading the config file 2133 * Do not print stats in quiet mode - thanks Leonid Shalupov 2134 * Add FAQ 2135 * Fix created directories not obeying umask 2136 * Linux installation instructions - thanks Shimon Doodkin 2137 2138 ## v1.17 - 2015-06-14 2139 2140 * dropbox: fix case insensitivity issues - thanks Leonid Shalupov 2141 2142 ## v1.16 - 2015-06-09 2143 2144 * Fix uploading big files which was causing timeouts or panics 2145 * Don't check md5sum after download with --size-only 2146 2147 ## v1.15 - 2015-06-06 2148 2149 * Add --checksum flag to only discard transfers by MD5SUM - thanks Alex Couper 2150 * Implement --size-only flag to sync on size not checksum & modtime 2151 * Expand docs and remove duplicated information 2152 * Document rclone's limitations with directories 2153 * dropbox: update docs about case insensitivity 2154 2155 ## v1.14 - 2015-05-21 2156 2157 * local: fix encoding of non utf-8 file names - fixes a duplicate file problem 2158 * drive: docs about rate limiting 2159 * google cloud storage: Fix compile after API change in "google.golang.org/api/storage/v1" 2160 2161 ## v1.13 - 2015-05-10 2162 2163 * Revise documentation (especially sync) 2164 * Implement --timeout and --conntimeout 2165 * s3: ignore etags from multipart uploads which aren't md5sums 2166 2167 ## v1.12 - 2015-03-15 2168 2169 * drive: Use chunked upload for files above a certain size 2170 * drive: add --drive-chunk-size and --drive-upload-cutoff parameters 2171 * drive: switch to insert from update when a failed copy deletes the upload 2172 * core: Log duplicate files if they are detected 2173 2174 ## v1.11 - 2015-03-04 2175 2176 * swift: add region parameter 2177 * drive: fix crash on failed to update remote mtime 2178 * In remote paths, change native directory separators to / 2179 * Add synchronization to ls/lsl/lsd output to stop corruptions 2180 * Ensure all stats/log messages to go stderr 2181 * Add --log-file flag to log everything (including panics) to file 2182 * Make it possible to disable stats printing with --stats=0 2183 * Implement --bwlimit to limit data transfer bandwidth 2184 2185 ## v1.10 - 2015-02-12 2186 2187 * s3: list an unlimited number of items 2188 * Fix getting stuck in the configurator 2189 2190 ## v1.09 - 2015-02-07 2191 2192 * windows: Stop drive letters (eg C:) getting mixed up with remotes (eg drive:) 2193 * local: Fix directory separators on Windows 2194 * drive: fix rate limit exceeded errors 2195 2196 ## v1.08 - 2015-02-04 2197 2198 * drive: fix subdirectory listing to not list entire drive 2199 * drive: Fix SetModTime 2200 * dropbox: adapt code to recent library changes 2201 2202 ## v1.07 - 2014-12-23 2203 2204 * google cloud storage: fix memory leak 2205 2206 ## v1.06 - 2014-12-12 2207 2208 * Fix "Couldn't find home directory" on OSX 2209 * swift: Add tenant parameter 2210 * Use new location of Google API packages 2211 2212 ## v1.05 - 2014-08-09 2213 2214 * Improved tests and consequently lots of minor fixes 2215 * core: Fix race detected by go race detector 2216 * core: Fixes after running errcheck 2217 * drive: reset root directory on Rmdir and Purge 2218 * fs: Document that Purger returns error on empty directory, test and fix 2219 * google cloud storage: fix ListDir on subdirectory 2220 * google cloud storage: re-read metadata in SetModTime 2221 * s3: make reading metadata more reliable to work around eventual consistency problems 2222 * s3: strip trailing / from ListDir() 2223 * swift: return directories without / in ListDir 2224 2225 ## v1.04 - 2014-07-21 2226 2227 * google cloud storage: Fix crash on Update 2228 2229 ## v1.03 - 2014-07-20 2230 2231 * swift, s3, dropbox: fix updated files being marked as corrupted 2232 * Make compile with go 1.1 again 2233 2234 ## v1.02 - 2014-07-19 2235 2236 * Implement Dropbox remote 2237 * Implement Google Cloud Storage remote 2238 * Verify Md5sums and Sizes after copies 2239 * Remove times from "ls" command - lists sizes only 2240 * Add add "lsl" - lists times and sizes 2241 * Add "md5sum" command 2242 2243 ## v1.01 - 2014-07-04 2244 2245 * drive: fix transfer of big files using up lots of memory 2246 2247 ## v1.00 - 2014-07-03 2248 2249 * drive: fix whole second dates 2250 2251 ## v0.99 - 2014-06-26 2252 2253 * Fix --dry-run not working 2254 * Make compatible with go 1.1 2255 2256 ## v0.98 - 2014-05-30 2257 2258 * s3: Treat missing Content-Length as 0 for some ceph installations 2259 * rclonetest: add file with a space in 2260 2261 ## v0.97 - 2014-05-05 2262 2263 * Implement copying of single files 2264 * s3 & swift: support paths inside containers/buckets 2265 2266 ## v0.96 - 2014-04-24 2267 2268 * drive: Fix multiple files of same name being created 2269 * drive: Use o.Update and fs.Put to optimise transfers 2270 * Add version number, -V and --version 2271 2272 ## v0.95 - 2014-03-28 2273 2274 * rclone.org: website, docs and graphics 2275 * drive: fix path parsing 2276 2277 ## v0.94 - 2014-03-27 2278 2279 * Change remote format one last time 2280 * GNU style flags 2281 2282 ## v0.93 - 2014-03-16 2283 2284 * drive: store token in config file 2285 * cross compile other versions 2286 * set strict permissions on config file 2287 2288 ## v0.92 - 2014-03-15 2289 2290 * Config fixes and --config option 2291 2292 ## v0.91 - 2014-03-15 2293 2294 * Make config file 2295 2296 ## v0.90 - 2013-06-27 2297 2298 * Project named rclone 2299 2300 ## v0.00 - 2012-11-18 2301 2302 * Project started 2303