513 Commits

Author SHA1 Message Date
Danny Adams
66e560987e Adds Kiota-lock.json to betaSDK package. 2023-01-25 08:18:53 -05:00
Danny Adams
c3fd313a82 Adds betaSDK/sites package. Temp 2023-01-25 08:17:44 -05:00
Danny Adams
2d73ed3a6b Adds group package temporarily. 2023-01-25 08:17:11 -05:00
Danny Adams
988962c06e Adds admin file. Temp. 2023-01-25 08:16:35 -05:00
Danny Adams
5368cd38cf Issue #2174: Adds Beta Client to package from generator. 2023-01-25 08:16:09 -05:00
Danny Adams
2a93dc9caf Updates to graph_connector component and helper_test files.
Reverts back to msgraph-sdk-go.
2023-01-25 07:59:09 -05:00
Danny Adams
ea70fa6eee Updates to /connector/sharepoint package
Reverts sharepoint package to msgraph-sdk-go
2023-01-25 07:57:42 -05:00
Danny Adams
a090bed081 Update to /mockconnector/mock_data_collection_test.go
Package reverted back to msgraph-sdk-go
2023-01-25 07:45:10 -05:00
Danny Adams
702ec7f234 Updates to /connector/exchange package
Package reverted back to msgraph-sdk-go
2023-01-25 07:43:44 -05:00
Danny Adams
c221d388b1 Update to /connector/mockconnector/mock_data_list.go
Package reverted back to msgraph-sdk-go
2023-01-25 07:40:58 -05:00
Danny Adams
4853d6c0ce Updates to /connector/support package.
Package reverted back to msgraph-sdk-go
2023-01-25 06:47:32 -05:00
Danny Adams
2f9f61b4a6 Updates to /connector/graph/cache_container.go
Package reverted back to msgraph-sdk-go
2023-01-25 06:46:24 -05:00
Danny Adams
a22803e077 Updates ../connector/exchange/api package update
Package reverted back to msgraph-sdk-go
2023-01-25 06:44:59 -05:00
Danny Adams
10c605d02b Updates to /connector/onedrive package
Package reverted back to msgraph-sdk-go.
2023-01-25 06:33:44 -05:00
Danny Adams
63d2d7f4d8 /connector/graph package reverted back from beta packages. 2023-01-25 06:31:47 -05:00
Danny Adams
ec87d58078 Merge branch 'main' into beta-library-switch 2023-01-25 06:22:01 -05:00
Keepers
e828209a30
return gc stats errors in backup (#2248)
## Description

If gc.stats reports a non-zero error count at the
end of a backup, retrieve the error from the
status and return it as the backup operation err.

## Does this PR need a docs update or release note?

- [x]  No 

## Type of change

- [x] 🐛 Bugfix

## Test Plan

- [x]  Unit test
- [x] 💚 E2E
2023-01-25 10:44:00 +00:00
ashmrtn
b6a7095c7f
Don't retry if an item was not found (#2233)
## Description

When fetching item data, don't backoff and retry if Graph reported the item was not found. In this case, we mark it as succeeded as we can never get the data anyway.

## Does this PR need a docs update or release note?

- [ ]  Yes, it's included
- [ ] 🕐 Yes, but in a later PR
- [x]  No 

## Type of change

- [ ] 🌻 Feature
- [x] 🐛 Bugfix
- [ ] 🗺️ Documentation
- [ ] 🤖 Test
- [ ] 💻 CI/Deployment
- [x] 🧹 Tech Debt/Cleanup

## Issue(s)

* closes #2217

## Test Plan

- [x] 💪 Manual
- [ ]  Unit test
- [ ] 💚 E2E
2023-01-23 18:35:16 +00:00
Danny Adams
4a9e634d3f Updates /connector/sharepoint/site_page.go
Adds expansion call to retrieve relationship information.
2023-01-23 13:18:33 -05:00
Keepers
b3d4b4687b
discovery api, filter guest and external users (#2188)
## Description

Adds the api client pkg pattern to the connector/
discovery package.  Most code changes are plain
lift-n-shift, with minor clean-ups along the way.

User retrieval is now filtered to only include
member and on-premise accounts.

## Does this PR need a docs update or release note?

- [x]  Yes, it's included

## Type of change

- [x] 🌻 Feature

## Issue(s)

* #2094

## Test Plan

- [x] 💪 Manual
- [x]  Unit test
2023-01-20 20:09:59 +00:00
ashmrtn
bb7f54b049
Update OneDrive metadata with folder moves (#2193)
## Description

Track folder moves and update the persisted metadata accordingly. Moves need to take into account subtree changes because OneDrive will not notify us of subfolders moving if nothing else was updated on the subfolder.

Handle updates by making a copy of the folder map for ease of updating and later on ease of finding out which collection paths have changed

## Does this PR need a docs update or release note?

- [ ]  Yes, it's included
- [ ] 🕐 Yes, but in a later PR
- [x]  No 

## Type of change

- [x] 🌻 Feature
- [ ] 🐛 Bugfix
- [ ] 🗺️ Documentation
- [ ] 🤖 Test
- [ ] 💻 CI/Deployment
- [ ] 🧹 Tech Debt/Cleanup

## Issue(s)

* #2120

## Test Plan

- [ ] 💪 Manual
- [x]  Unit test
- [ ] 💚 E2E
2023-01-20 19:18:59 +00:00
Danny
10efa650c7
Merge branch 'beta-library-switch' into backup-page-flow 2023-01-20 13:59:01 -05:00
ashmrtn
6651305d4f
Update OneDrive metadata with folder deletions (#2192)
## Description

Track folder and package deletions in OneDrive metadata for incremental backups. Add test for deletions

## Does this PR need a docs update or release note?

- [ ]  Yes, it's included
- [ ] 🕐 Yes, but in a later PR
- [x]  No 

## Type of change

- [x] 🌻 Feature
- [ ] 🐛 Bugfix
- [ ] 🗺️ Documentation
- [ ] 🤖 Test
- [ ] 💻 CI/Deployment
- [ ] 🧹 Tech Debt/Cleanup

## Issue(s)

* #2120

## Test Plan

- [x] 💪 Manual
- [x]  Unit test
- [ ] 💚 E2E
2023-01-20 17:02:23 +00:00
Danny Adams
f425d24364 Update support library to beta. 2023-01-20 11:11:11 -05:00
Danny Adams
585ce939ed Merge branch 'beta-library-switch' into backup-page-flow 2023-01-20 10:39:57 -05:00
Danny Adams
2f125d44a6 Merge branch 'main' into beta-library-switch 2023-01-20 09:40:57 -05:00
Danny Adams
2cd64c4775 Updates to internal/connector/graph_connector_helper_test.go
git status
2023-01-20 09:31:14 -05:00
Danny Adams
4009a5c2d4 Update /connector/ package
Beta Library replaces msgraph v1.0
2023-01-20 09:25:03 -05:00
Danny Adams
4687b134ef Update /connector/support package
Beta Library replaces msgraph v1.0
2023-01-20 09:24:11 -05:00
Danny Adams
2929c9f25e Update /connector/sharepoint package
Beta Library replaces msgraph v1.0
2023-01-20 09:23:41 -05:00
Danny Adams
7404c4c8b0 Update /connector/onedrive package
Beta Library replaces msgraph v1.0
2023-01-20 09:22:40 -05:00
Danny Adams
135c07a41a Update /connector/exchange package
Beta Library replaces msgraph v1.0
2023-01-20 09:22:15 -05:00
Danny Adams
3ccdda8ef0 Update /connector/mockconnector package
Change to Beta library.
2023-01-20 09:21:08 -05:00
Danny Adams
4952b81333 Update /connector/graph package
Change to Beta library.
2023-01-20 09:20:31 -05:00
Danny Adams
b82a6349f4 Update /connector/exchange/api package
Change to Beta library.
2023-01-20 09:19:38 -05:00
Danny Adams
519a449b2f Update /connector/discovery package
Change to Beta library.
2023-01-20 09:18:49 -05:00
ashmrtn
5d20e30062
Record graph error (#2195)
## Description

Record information about the error Graph returned if something went wrong when fetching an item.

## Does this PR need a docs update or release note?

- [ ]  Yes, it's included
- [ ] 🕐 Yes, but in a later PR
- [x]  No 

## Type of change

- [ ] 🌻 Feature
- [x] 🐛 Bugfix
- [ ] 🗺️ Documentation
- [ ] 🤖 Test
- [ ] 💻 CI/Deployment
- [x] 🧹 Tech Debt/Cleanup

## Issue(s)

* closes #2194

## Test Plan

- [x] 💪 Manual
- [ ]  Unit test
- [ ] 💚 E2E
2023-01-20 05:55:11 +00:00
ashmrtn
38b9fabb51
Check for and ignore item not found errors (#2202)
## Description

Item not found errors may appear because an item was moved or deleted between enumerating the items in a folder and fetching the data for the items in the folder. This keeps them from being reported as there is nothing we can do if the item data is no longer available.

This applies to all Exchange data categories

## Does this PR need a docs update or release note?

- [ ]  Yes, it's included
- [ ] 🕐 Yes, but in a later PR
- [x]  No 

## Type of change

- [ ] 🌻 Feature
- [x] 🐛 Bugfix
- [ ] 🗺️ Documentation
- [ ] 🤖 Test
- [ ] 💻 CI/Deployment
- [ ] 🧹 Tech Debt/Cleanup

## Issue(s)

* closes #2198

## Test Plan

- [x] 💪 Manual
- [ ]  Unit test
- [ ] 💚 E2E
2023-01-20 04:34:48 +00:00
ashmrtn
298ee35f05
Use mutex when appending to error (#2201)
## Description

Make error appending thread-safe since multiple goroutines may attempt to add an error at the same time.

## Does this PR need a docs update or release note?

- [ ]  Yes, it's included
- [ ] 🕐 Yes, but in a later PR
- [x]  No 

## Type of change

- [ ] 🌻 Feature
- [x] 🐛 Bugfix
- [ ] 🗺️ Documentation
- [ ] 🤖 Test
- [ ] 💻 CI/Deployment
- [ ] 🧹 Tech Debt/Cleanup

## Issue(s)

* closes #2197

## Test Plan

- [x] 💪 Manual
- [ ]  Unit test
- [ ] 💚 E2E
2023-01-20 04:16:39 +00:00
Danny
4473215882
GC: Backup: [FIX]Embedded image requires download (#2189)
## Description
Images copy/pasted into a message were not being saved previously.  Verified with Corso binary
<!-- Insert PR description-->

## Does this PR need a docs update or release note?

- [x]  Yes, in the ChangeLog.


## Type of change

<!--- Please check the type of change your PR introduces: --->
- [x] 🐛 Bugfix


## Issue(s)

<!-- Can reference multiple issues. Use one of the following "magic words" - "closes, fixes" to auto-close the Github issue. -->
* closes #2163<issue>

## Test Plan

<!-- How will this be tested prior to merging.-->
- [x]  Unit test
2023-01-20 00:32:18 +00:00
Keepers
8df00bd386
standardizes the calendar resolver interface (#2162)
## Description

Adds a little extra process into the calendar
resolver so that it mimics the mail and contact
resolvers.  This will allow us to collapse the
three resolvers into a more common handler
or interface.

We can take this change or drop it.  I added
the code in exploration of the event test failures,
and figured I'd throw it out just in case.

## Does this PR need a docs update or release note?

- [x]  No 

## Type of change

- [x] 🧹 Tech Debt/Cleanup

## Issue(s)

* #2022

## Test Plan

- [x] 💚 E2E
2023-01-19 22:30:14 +00:00
Danny Adams
7ef73b866a Update for Beta Connector. 2023-01-19 16:41:32 -05:00
Danny Adams
613de30664 Updates to error response. Test to verify time for cache. 2023-01-19 16:23:39 -05:00
Abin Simon
60a04c9ca4
Handle ResourceNotFound error when fetching drive (#2161)
## Description

Follow up for https://github.com/alcionai/corso/pull/2156. We might deice to change where we add the logic to handle this, as in if we should move it to discovery module.

## Does this PR need a docs update or release note?

- [x]  Yes, it's included
- [ ] 🕐 Yes, but in a later PR
- [ ]  No 

## Type of change

<!--- Please check the type of change your PR introduces: --->
- [ ] 🌻 Feature
- [x] 🐛 Bugfix
- [ ] 🗺️ Documentation
- [ ] 🤖 Test
- [ ] 💻 CI/Deployment
- [ ] 🧹 Tech Debt/Cleanup

## Issue(s)

<!-- Can reference multiple issues. Use one of the following "magic words" - "closes, fixes" to auto-close the Github issue. -->
* https://github.com/alcionai/corso/issues/2145
* https://github.com/alcionai/corso/pull/2156

## Test Plan

<!-- How will this be tested prior to merging.-->
- [x] 💪 Manual
- [ ]  Unit test
- [ ] 💚 E2E
2023-01-19 07:49:07 +00:00
Danny Adams
6b1e84732e Merge branch 'main' into beta-page-connector 2023-01-19 01:34:33 -05:00
Danny Adams
bbf3370879 Update to /connector/sharepoint/collection.go
Adds field to hold Beta service within struct for populate method.
2023-01-19 01:32:45 -05:00
Danny Adams
f5326c0304 Update /sharepoint/data_collections.g
Adds function collectPages() to logic of dataCollections.
2023-01-19 01:32:01 -05:00
Danny Adams
ec613b636d Updates to /sharepoint/site_page.go
Adds logic for fetching Page M365 IDs.
2023-01-19 01:31:13 -05:00
Danny Adams
764909e6e9 Updates to site_page.go
Removes minimal definition of SitePages from page.
2023-01-19 00:36:37 -05:00
Danny Adams
0c83eab068 Updates tests to reflect pageInfo library. 2023-01-19 00:33:49 -05:00