1029 Commits

Author SHA1 Message Date
Danny Adams
42a9499b71 Add file to /graph/betasdk/kiota-lock.json
File shows how app.kiota generator created the minimal SDK.
2023-01-25 14:31:16 -05:00
Danny Adams
740c8dc3e2 Updates to /graph/betasdk/beta_client.go
Removes the admin and groups properties for minimal beta connector.
2023-01-25 14:12:34 -05:00
Danny Adams
d2fb427146 Hydrate sites command directory. 2023-01-25 14:07:06 -05:00
Danny Adams
4fdd165afd Hydrate model directory. 2023-01-25 14:06:41 -05:00
Danny Adams
76cc59348a Go.mod: Update to libraries. 2023-01-25 14:04:51 -05:00
Danny Adams
9a0dd673c6 Kiota library mismatch from preview. 2023-01-25 13:13:10 -05:00
Danny Adams
b4118627a6 Kiota library mismatch from preview. 2023-01-25 13:12:37 -05:00
Danny Adams
a51b6e8444 Kiota library mismatch from preview. 2023-01-25 13:11:03 -05:00
ashmrtn
a4f2f0a437
Add deleted files to OneDrive excluded file list (#2250)
## Description

Begin populating a global exclude set with files deleted from OneDrive. The set contains the IDs of files that have been deleted.

This is actually safe to return from GraphConnector now (though it's not returned) as it uses item IDs instead of item names.

Future PRs will need to address handling of (potentially) moved files

## Does this PR need a docs update or release note?

- [ ]  Yes, it's included
- [ ] 🕐 Yes, but in a later PR
- [x]  No 

## Type of change

- [x] 🌻 Feature
- [ ] 🐛 Bugfix
- [ ] 🗺️ Documentation
- [ ] 🤖 Test
- [ ] 💻 CI/Deployment
- [ ] 🧹 Tech Debt/Cleanup

## Issue(s)

* #2242 

## Test Plan

- [ ] 💪 Manual
- [x]  Unit test
- [ ] 💚 E2E
2023-01-25 16:57:30 +00:00
ashmrtn
46d61c7246
Add a set of items that will be excluded from base directories during backup (#2143)
## Description

Some external services like OneDrive do not have the ability to determine the path a deleted item used to exist at, they only know the item's old ID. This patch allows Kopia Wrapper to handle those items by implementing a global exclude set. The patch assumes that items in base directories are unique as the items in every base directory are checked against the set.

This is not wired to anything outside of Kopia Wrapper. Currently this feature is disabled as the passed value is always nil.

## Does this PR need a docs update or release note?

- [ ]  Yes, it's included
- [ ] 🕐 Yes, but in a later PR
- [x]  No 

## Type of change

- [x] 🌻 Feature
- [ ] 🐛 Bugfix
- [ ] 🗺️ Documentation
- [ ] 🤖 Test
- [ ] 💻 CI/Deployment
- [ ] 🧹 Tech Debt/Cleanup

## Issue(s)

* closes #2121 

## Test Plan

- [ ] 💪 Manual
- [x]  Unit test
- [ ] 💚 E2E
2023-01-25 16:28:09 +00:00
Danny Adams
1acc6b9e18 Hydrate sites package. 2023-01-25 09:51:12 -05:00
Danny Adams
9a6d58b18c Inflate admin package. 2023-01-25 09:50:15 -05:00
Danny Adams
b27ce3d0e2 Inflate Models package. 2023-01-25 09:46:34 -05:00
Danny Adams
f5d514470d Inflate admin package. 2023-01-25 09:44:25 -05:00
Danny Adams
0a1e0d249f Package configuration. 2023-01-25 09:34:15 -05:00
Danny Adams
b1f7ab51e9 beta_client beta client formatting. 2023-01-25 09:23:13 -05:00
Danny Adams
b13f5b6fb6 Update shuffle. 2023-01-25 09:21:18 -05:00
Danny Adams
e51f654e46 Delete /betaSDK/sites package. 2023-01-25 09:02:25 -05:00
Danny Adams
50da437421 Updates package name for betasdk package. 2023-01-25 08:47:45 -05:00
Danny Adams
1d13f7d2df Updates betaSDK/groups package
Removes backing store from model.
2023-01-25 08:36:04 -05:00
Danny Adams
e9371379a6 Updates beta_client..go
Removal of backing store from model.
2023-01-25 08:34:27 -05:00
Danny Adams
ae69293fa6 Updates kiota-lock.json: Removal of backing store. 2023-01-25 08:31:40 -05:00
Danny Adams
66e560987e Adds Kiota-lock.json to betaSDK package. 2023-01-25 08:18:53 -05:00
Danny Adams
c3fd313a82 Adds betaSDK/sites package. Temp 2023-01-25 08:17:44 -05:00
Danny Adams
2d73ed3a6b Adds group package temporarily. 2023-01-25 08:17:11 -05:00
Danny Adams
988962c06e Adds admin file. Temp. 2023-01-25 08:16:35 -05:00
Danny Adams
5368cd38cf Issue #2174: Adds Beta Client to package from generator. 2023-01-25 08:16:09 -05:00
Danny Adams
2a93dc9caf Updates to graph_connector component and helper_test files.
Reverts back to msgraph-sdk-go.
2023-01-25 07:59:09 -05:00
Danny Adams
ea70fa6eee Updates to /connector/sharepoint package
Reverts sharepoint package to msgraph-sdk-go
2023-01-25 07:57:42 -05:00
Danny Adams
a090bed081 Update to /mockconnector/mock_data_collection_test.go
Package reverted back to msgraph-sdk-go
2023-01-25 07:45:10 -05:00
Danny Adams
702ec7f234 Updates to /connector/exchange package
Package reverted back to msgraph-sdk-go
2023-01-25 07:43:44 -05:00
Danny Adams
c221d388b1 Update to /connector/mockconnector/mock_data_list.go
Package reverted back to msgraph-sdk-go
2023-01-25 07:40:58 -05:00
dependabot[bot]
b2e7920201
⬆️ Bump github.com/aws/aws-sdk-go from 1.44.184 to 1.44.186 in /src (#2254)
Bumps [github.com/aws/aws-sdk-go](https://github.com/aws/aws-sdk-go) from 1.44.184 to 1.44.186.
<details>
<summary>Release notes</summary>
<p><em>Sourced from <a href="https://github.com/aws/aws-sdk-go/releases">github.com/aws/aws-sdk-go's releases</a>.</em></p>
<blockquote>
<h1>Release v1.44.186 (2023-01-24)</h1>
<h3>Service Client Updates</h3>
<ul>
<li><code>service/databrew</code>: Adds new service</li>
<li><code>service/route53</code>: Updates service API
<ul>
<li>Amazon Route 53 now supports the Asia Pacific (Melbourne) Region (ap-southeast-4) for latency records, geoproximity records, and private DNS for Amazon VPCs in that region.</li>
</ul>
</li>
<li><code>service/ssm-sap</code>: Updates service API, documentation, and paginators</li>
</ul>
<h1>Release v1.44.185 (2023-01-23)</h1>
<h3>Service Client Updates</h3>
<ul>
<li><code>service/lambda</code>: Updates service API and documentation
<ul>
<li>Release Lambda RuntimeManagementConfig, enabling customers to better manage runtime updates to their Lambda functions. This release adds two new APIs, GetRuntimeManagementConfig and PutRuntimeManagementConfig, as well as support on existing Create/Get/Update function APIs.</li>
</ul>
</li>
<li><code>service/sagemaker</code>: Updates service API and documentation
<ul>
<li>Amazon SageMaker Inference now supports P4de instance types.</li>
</ul>
</li>
</ul>
</blockquote>
</details>
<details>
<summary>Commits</summary>
<ul>
<li><a href="8035a306ff"><code>8035a30</code></a> Release v1.44.186 (2023-01-24) (<a href="https://github-redirect.dependabot.com/aws/aws-sdk-go/issues/4702">#4702</a>)</li>
<li><a href="96e5770aed"><code>96e5770</code></a> Release v1.44.185 (2023-01-23) (<a href="https://github-redirect.dependabot.com/aws/aws-sdk-go/issues/4698">#4698</a>)</li>
<li>See full diff in <a href="https://github.com/aws/aws-sdk-go/compare/v1.44.184...v1.44.186">compare view</a></li>
</ul>
</details>
<br />


[![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=github.com/aws/aws-sdk-go&package-manager=go_modules&previous-version=1.44.184&new-version=1.44.186)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores)

You can trigger a rebase of this PR by commenting `@dependabot rebase`.

[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)

---

<details>
<summary>Dependabot commands and options</summary>
<br />

You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
- `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)


</details>
2023-01-25 12:10:07 +00:00
Danny Adams
4853d6c0ce Updates to /connector/support package.
Package reverted back to msgraph-sdk-go
2023-01-25 06:47:32 -05:00
Danny Adams
2f9f61b4a6 Updates to /connector/graph/cache_container.go
Package reverted back to msgraph-sdk-go
2023-01-25 06:46:24 -05:00
Danny Adams
a22803e077 Updates ../connector/exchange/api package update
Package reverted back to msgraph-sdk-go
2023-01-25 06:44:59 -05:00
Danny Adams
10c605d02b Updates to /connector/onedrive package
Package reverted back to msgraph-sdk-go.
2023-01-25 06:33:44 -05:00
Danny Adams
63d2d7f4d8 /connector/graph package reverted back from beta packages. 2023-01-25 06:31:47 -05:00
Danny Adams
2fc8b36070 Update to go.mod & go.sum 2023-01-25 06:26:25 -05:00
Danny Adams
ec87d58078 Merge branch 'main' into beta-library-switch 2023-01-25 06:22:01 -05:00
Danny
42133ffc7d
[BUG FIX]: CLI: Details: Sharepoint (#2222)
## Description
Enabling backup commands for `SharePoint.Pages` in #2216 introduced failures when `backup details()` called in Corso. 
Test suite updated

## Does this PR need a docs update or release note?

- [x]  No 

## Type of change

- [x] 🐛 Bugfix


## Issue(s)

<!-- Can reference multiple issues. Use one of the following "magic words" - "closes, fixes" to auto-close the Github issue. -->
* related to  #2216<issue>
* related to #2173

## Test Plan

<!-- How will this be tested prior to merging.-->
- [x]  Unit test
2023-01-25 11:15:52 +00:00
Keepers
e828209a30
return gc stats errors in backup (#2248)
## Description

If gc.stats reports a non-zero error count at the
end of a backup, retrieve the error from the
status and return it as the backup operation err.

## Does this PR need a docs update or release note?

- [x]  No 

## Type of change

- [x] 🐛 Bugfix

## Test Plan

- [x]  Unit test
- [x] 💚 E2E
2023-01-25 10:44:00 +00:00
Vaibhav Kamra
4a6959f60f
Revert "Issue 2022 eventincr" (#2256)
Reverts alcionai/corso#2167. This is causing the integration test to fail consistently (in CI and local runs)
2023-01-25 10:21:00 +00:00
ashmrtn
ac73d874f9
Update kopia/switch back to upstream repo (#2235)
## Description

Update kopia version since upstream now includes recent PRs from our repo

Upstream now includes the following:
* io.ReadCloser interface for StreamingFiles
* properly pass file size for cached StreamingFiles

## Does this PR need a docs update or release note?

- [ ]  Yes, it's included
- [ ] 🕐 Yes, but in a later PR
- [x]  No 

## Type of change

- [ ] 🌻 Feature
- [ ] 🐛 Bugfix
- [ ] 🗺️ Documentation
- [ ] 🤖 Test
- [ ] 💻 CI/Deployment
- [x] 🧹 Tech Debt/Cleanup

## Issue(s)

* closes #2234
* closes #1732

## Test Plan

- [ ] 💪 Manual
- [x]  Unit test
- [x] 💚 E2E
2023-01-24 01:06:20 +00:00
Keepers
39c3c8a895
Issue 2022 eventincr (#2167)
## Description

Fixes and unskips the tests incremental integration tests
for exchange calendar events.

Currently blocked on LynneR displaying the calendar
fetch issues where it's only possible to retrieve her default
Calendar, Birthdays, and US Holidays calendars.

## Does this PR need a docs update or release note?

- [x]  No 

## Type of change

- [x] 🤖 Test

## Issue(s)

* #2022

## Test Plan

- [x] 💪 Manual
- [x] 💚 E2E
2023-01-23 21:38:09 +00:00
Keepers
e43455cc49
re-enable stderr logs in tests (#2215)
## Does this PR need a docs update or release note?

- [x]  No 

## Type of change

- [x] 🐛 Bugfix
- [x] 🤖 Test
- [x] 💻 CI/Deployment

## Test Plan

- [x] 💪 Manual
2023-01-23 19:52:26 +00:00
ashmrtn
b6a7095c7f
Don't retry if an item was not found (#2233)
## Description

When fetching item data, don't backoff and retry if Graph reported the item was not found. In this case, we mark it as succeeded as we can never get the data anyway.

## Does this PR need a docs update or release note?

- [ ]  Yes, it's included
- [ ] 🕐 Yes, but in a later PR
- [x]  No 

## Type of change

- [ ] 🌻 Feature
- [x] 🐛 Bugfix
- [ ] 🗺️ Documentation
- [ ] 🤖 Test
- [ ] 💻 CI/Deployment
- [x] 🧹 Tech Debt/Cleanup

## Issue(s)

* closes #2217

## Test Plan

- [x] 💪 Manual
- [ ]  Unit test
- [ ] 💚 E2E
2023-01-23 18:35:16 +00:00
Danny Adams
4a9e634d3f Updates /connector/sharepoint/site_page.go
Adds expansion call to retrieve relationship information.
2023-01-23 13:18:33 -05:00
dependabot[bot]
6f98cbf33a
⬆️ Bump github.com/aws/aws-sdk-go from 1.44.183 to 1.44.184 in /src (#2229)
Bumps [github.com/aws/aws-sdk-go](https://github.com/aws/aws-sdk-go) from 1.44.183 to 1.44.184.
<details>
<summary>Release notes</summary>
<p><em>Sourced from <a href="https://github.com/aws/aws-sdk-go/releases">github.com/aws/aws-sdk-go's releases</a>.</em></p>
<blockquote>
<h1>Release v1.44.184 (2023-01-20)</h1>
<h3>Service Client Updates</h3>
<ul>
<li><code>service/ec2</code>: Updates service API
<ul>
<li>C6in, M6in, M6idn, R6in and R6idn instances are powered by 3rd Generation Intel Xeon Scalable processors (code named Ice Lake) with an all-core turbo frequency of 3.5 GHz.</li>
</ul>
</li>
<li><code>service/ivs</code>: Updates service API and documentation</li>
<li><code>service/quicksight</code>: Updates service API and documentation
<ul>
<li>This release adds support for data bars in QuickSight table and increases pivot table field well limit.</li>
</ul>
</li>
</ul>
</blockquote>
</details>
<details>
<summary>Commits</summary>
<ul>
<li><a href="cd16b71be9"><code>cd16b71</code></a> Release v1.44.184 (2023-01-20) (<a href="https://github-redirect.dependabot.com/aws/aws-sdk-go/issues/4696">#4696</a>)</li>
<li>See full diff in <a href="https://github.com/aws/aws-sdk-go/compare/v1.44.183...v1.44.184">compare view</a></li>
</ul>
</details>
<br />


[![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=github.com/aws/aws-sdk-go&package-manager=go_modules&previous-version=1.44.183&new-version=1.44.184)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores)

You can trigger a rebase of this PR by commenting `@dependabot rebase`.

[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)

---

<details>
<summary>Dependabot commands and options</summary>
<br />

You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
- `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)


</details>
2023-01-23 06:22:00 +00:00
Danny
6d615810cd
CLI: Backup: SharePoint: Pages Enable (#2213)
## Description
Adds the functionality to select SharePoint Pages for backup.
<!-- Insert PR description-->

## Does this PR need a docs update or release note?
SharePoint commands remain hidden in terms of pages. 
- [x] 🕐 Yes, but in a later PR

## Type of change

<!--- Please check the type of change your PR introduces: --->
- [x] 🌻 Feature

## Issue(s)

<!-- Can reference multiple issues. Use one of the following "magic words" - "closes, fixes" to auto-close the Github issue. -->
* closes  #2216 <issue>
* closes #2107

## Test Plan

<!-- How will this be tested prior to merging.-->
- [x]  Unit test
2023-01-21 05:50:23 +00:00