a4147f5498
## Description This brings in another huge improvement in the backup speed dropping from ~15m to ~1.5m for an account with ~5000 files. This one also drastically reduces the number of requests we have to make for the same account from 5505 to just ~55. This also means that we don't get throttled anymore and we can easily run multiple backup jobs in parallel before we hit the 1024 limit. ~The code works as of now, but I have to double check the numbers as well as fix an issue with us opening too many files and causing program to crash with 'too many open files' when we bump up the numbers. With the current numbers, it works, but I wanna double check and optimize them. Plus some code cleanup.~ ## Does this PR need a docs update or release note? - [x] ✅ Yes, it's included - [ ] 🕐 Yes, but in a later PR - [ ] ⛔ No ## Type of change <!--- Please check the type of change your PR introduces: ---> - [ ] 🌻 Feature - [ ] 🐛 Bugfix - [ ] 🗺️ Documentation - [ ] 🤖 Test - [ ] 💻 CI/Deployment - [x] 🐹 Trivial/Minor ## Issue(s) <!-- Can reference multiple issues. Use one of the following "magic words" - "closes, fixes" to auto-close the Github issue. --> * #<issue> ## Test Plan <!-- How will this be tested prior to merging.--> - [ ] 💪 Manual - [x] ⚡ Unit test - [x] 💚 E2E
81 lines
3.7 KiB
Markdown
81 lines
3.7 KiB
Markdown
# Changelog
|
|
|
|
All notable changes to this project will be documented in this file.
|
|
|
|
The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
|
|
and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
|
|
|
|
## [Unreleased]
|
|
|
|
### Changed
|
|
|
|
- **Breaking Change**:
|
|
Changed how backup details are stored in the repository to
|
|
improve memory usage (#1735) from [vkamra](https://github.com/vkamra)
|
|
- Improve OneDrive backup speed (#1842) from [meain](https://github.com/meain)
|
|
|
|
## [v0.0.3] (alpha) - 2022-12-05
|
|
|
|
### Added
|
|
|
|
- Display backup size in backup list command (#1648) from [meain](https://github.com/meain)
|
|
- Improve OneDrive backup performance (#1607) from [meain](https://github.com/meain)
|
|
- Improve Exchange backup performance (#1608) from [meain](https://github.com/meain)
|
|
- Add flag to retain all progress bars (#1582) from [ryanfkeepers](https://github.com/ryanfkeepers)
|
|
- Fix resource owner display on backup list (#1580) from [ryanfkeepers](https://github.com/ryanfkeepers)
|
|
|
|
### Changed
|
|
|
|
- Improve logging (#1642) from [ryanfkeepers](https://github.com/ryanfkeepers)
|
|
- Generate separate backup for each resource owner (#1609) from [ashmrtn](https://github.com/ashmrtn)
|
|
- Print version info to stdout instead of stderr (#1503) from [meain](https://github.com/meain)
|
|
|
|
## [v0.0.2] (alpha) - 2022-11-14
|
|
|
|
### Added
|
|
|
|
- Added AWS X-Ray support for better observability (#1111) from [ryanfkeepers](https://github.com/ryanfkeepers)
|
|
- Allow disabling TLS and TLS verification (#1415) from [vkamra](https://github.com/vkamra)
|
|
- Add filtering based on path prefix/contains (#1224) from [ryanfkeepers](https://github.com/ryanfkeepers)
|
|
- Add info about doc owner for OneDrive files (#1366) from [meain](https://github.com/meain)
|
|
- Add end time for Exchange events from (#1366) [meain](https://github.com/meain)
|
|
|
|
### Changed
|
|
|
|
- Export `RepoAlreadyExists` error for sdk users (#1136)from [ryanfkeepers](https://github.com/ryanfkeepers)
|
|
- RudderStack logger now respects corso logger settings (#1324) from [ryanfkeepers](https://github.com/ryanfkeepers)
|
|
|
|
## [v0.0.1] (alpha) - 2022-10-24
|
|
|
|
### New features
|
|
|
|
- Supported M365 Services
|
|
|
|
- Exchange - email, events, contacts ([RM-8](https://github.com/alcionai/corso-roadmap/issues/28))
|
|
- OneDrive - files ([RM-12](https://github.com/alcionai/corso-roadmap/issues/28))
|
|
|
|
- Backup workflows
|
|
|
|
- Create a full backup ([RM-19](https://github.com/alcionai/corso-roadmap/issues/19))
|
|
- Create a backup for a specific service and all or some data types ([RM-19](https://github.com/alcionai/corso-roadmap/issues/19))
|
|
- Create a backup for all or a specific user ([RM-20](https://github.com/alcionai/corso-roadmap/issues/20))
|
|
- Delete a backup manually ([RM-24](https://github.com/alcionai/corso-roadmap/issues/24))
|
|
|
|
- Restore workflows
|
|
|
|
- List, filter, and view backup content details ([RM-23](https://github.com/alcionai/corso-roadmap/issues/23))
|
|
- Restore one or more items or folders from backup ([RM-28](https://github.com/alcionai/corso-roadmap/issues/28), [RM-29](https://github.com/alcionai/corso-roadmap/issues/29))
|
|
- Non-destructive restore to a new folder/calendar in the same account ([RM-30](https://github.com/alcionai/corso-roadmap/issues/30))
|
|
|
|
- Backup storage
|
|
|
|
- Zero knowledge encrypted backups with user conrolled passphrase ([RM-6](https://github.com/alcionai/corso-roadmap/issues/6))
|
|
- Initialize and connect to an S3-compliant backup repository ([RM-5](https://github.com/alcionai/corso-roadmap/issues/5))
|
|
|
|
- Miscellaneous
|
|
- Optional usage statistics reporting ([RM-35](https://github.com/alcionai/corso-roadmap/issues/35))
|
|
|
|
[Unreleased]: https://github.com/alcionai/corso/compare/v0.0.2...HEAD
|
|
[v0.0.2]: https://github.com/alcionai/corso/compare/v0.0.1...v0.0.2
|
|
[v0.0.1]: https://github.com/alcionai/corso/tag/v0.0.1
|