Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Azure Table API (Query Filter) For Timestamp #58

Open
MigsQuestionarre opened this issue May 15, 2023 · 2 comments
Open

Azure Table API (Query Filter) For Timestamp #58

MigsQuestionarre opened this issue May 15, 2023 · 2 comments

Comments

@MigsQuestionarre
Copy link

I want to ask about the query filter feature on the Azure Table API Source setting, I'm trying to transfer data from the Azure table API to a JSON file where the filter query uses the following timestamp query: "Timestamp ge datetime'2023-05-15T03:30:32.663Z"' after I run it already appears data transfer complete:
image
,but when looking at the json file nothing appears:
image
I want to make sure whether the feature for filtering queries for time already exists or not, or is there a writing error from what I input? thank you for your attention

the following additional notes are my migration settings:
image

@bowencode
Copy link
Collaborator

Queries can be tricky because of formatting. I think what you're seeing is probably a combination of the "eq" operator not getting an exact match or JSON encoding not actually reading the query as expected. Here's an example with a full time that matches a table timestamp and the JSON encoded characters:

"QueryFilter": "Timestamp eq datetime\u00272023-01-12T16:53:31.1714422Z\u0027"

With less precision on the query time it's probably better to use > and < to specify a range.

@MigsQuestionarre
Copy link
Author

Hello Mr. Bowen thank you for the feedback, i have try the solution that you suggest but unfortunately the same problems are still occuring. after that I also tried several other formats to try to get the data I wanted to migrate into the .json file, this are the following log of the formats I tried:
"QueryFilter": "Timestamp ge datetime\u00272023-05-17T03:06:07.691Z\u0027" Success Transfer, Still no data in json file
"QueryFilter": "Timestamp le datetime\u00272023-05-17T03:06:07.691Z\u0027" Success Transfer, Still no data in json file
"QueryFilter": "Timestamp eq datetime\u00272023-05-17T03:06:07.691Z\u0027" Success Transfer, Still no data in json file
"QueryFilter": "Timestamp gt datetime\u00272023-05-17T03:06:07.691Z\u0027" Success Transfer, Still no data in json file
"QueryFilter": "Timestamp ge datetime '2023-05-17T03:06:07.691Z'" Success Transfer, no data in json file
"QueryFilter": "Timestamp le datetime '2023-05-17T03:06:07.691Z'" Success Transfer, no data in json file
"QueryFilter": "Timestamp gt datetime '2023-05-17T03:06:07.691Z'" Success Transfer, no data in json file
"QueryFilter": "Timestamp eq datetime '2023-05-17T03:06:07.691Z'" Success Transfer, no data in json file
"QueryFilter": "Timestamp ge datetime'\u00272023-05-17T03:06:07.691Z\u0027'" Success Transfer, Still no data in json file
"QueryFilter": "Timestamp eq \u00272023-05-17T03:06:07.691Z\u0027" Success Transfer, Still no data in json file
"QueryFilter": "Timestamp ge datetime '2023-05-17T03:10:39.058Z\u002B00:00'" Fail Transfer
"QueryFilter": "Timestamp ge datetime '2023-05-17T03:10:39.058Z\u002B00'" Fail Transfer
"QueryFilter": "Timestamp ge datetime 2023-05-17T03:10:39.058Z\u002B00" Fail Transfer
"QueryFilter": "Timestamp ge datetime'u00272023-05-17T03:06:07.691Zu0027'" Fail Transfer
"QueryFilter": "Timestamp eq '\u00272023-05-17T03:06:07.691Z\u0027'" Fail Transfer
in the right hand sight i put the status after i execute the dmt.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants