Skip to content

Commit 082c1fb

Browse files
fivetran-reneelifivetran-reneeli
authored
Apple store nov 2024 updates (#27)
* version and temp deps * change seeds * i suppose it doesn't like when the seed isnt the same name as in upstream * docs * schema change and changelog * modified seeds * updates * schema * thought i change the identifier name.. * update changelog * updating changelog language * adjust versions in readme * deps
1 parent 0718f2c commit 082c1fb

33 files changed

+145
-244
lines changed

‎CHANGELOG.md

+4-1
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,7 @@
1-
# dbt_app_reporting version.version
1+
# dbt_app_reporting v0.5.0
2+
3+
## Breaking Changes: dbt_apple_store v0.5.0
4+
- This package has been updated to align with upstream schema changes introduced in version v0.5.0 of the `dbt_apple_store` package. For more information on the breaking changes, refer to the `dbt_apple_store` [release notes](https://github.com/fivetran/dbt_apple_store/releases/tag/v0.5.0).
25

36
## Documentation
47
- Added Quickstart model counts to README. ([#26](https://github.com/fivetran/dbt_app_reporting/pull/26))

‎README.md

+3-3
Original file line numberDiff line numberDiff line change
@@ -56,7 +56,7 @@ Include the following github package version in your `packages.yml`
5656
```yaml
5757
packages:
5858
- package: fivetran/app_reporting
59-
version: [">=0.4.0", "<0.5.0"] # we recommend using ranges to capture non-breaking changes automatically
59+
version: [">=0.5.0", "<0.6.0"] # we recommend using ranges to capture non-breaking changes automatically
6060
```
6161
6262
Do NOT include the individual app platform packages in this file. The app reporting package itself has dependencies on these packages and will install them as well.
@@ -171,10 +171,10 @@ This dbt package is dependent on the following dbt packages. For more informatio
171171
```yml
172172
packages:
173173
- package: fivetran/apple_store
174-
version: [">=0.4.0", "<0.5.0"]
174+
version: [">=0.5.0", "<0.6.0"]
175175
176176
- package: fivetran/apple_store_source
177-
version: [">=0.4.0", "<0.5.0"]
177+
version: [">=0.5.0", "<0.6.0"]
178178
179179
- package: fivetran/google_play
180180
version: [">=0.4.0", "<0.5.0"]

‎dbt_project.yml

+1-1
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
name: 'app_reporting'
2-
version: '0.4.0'
2+
version: '0.5.0'
33
config-version: 2
44
models:
55
app_reporting:

‎docs/catalog.json

+1-1
Large diffs are not rendered by default.

‎docs/index.html

+37-10
Large diffs are not rendered by default.

‎docs/manifest.json

+1-1
Large diffs are not rendered by default.

‎docs/run_results.json

-1
This file was deleted.

‎integration_tests/ci/sample.profiles.yml

+5-5
Original file line numberDiff line numberDiff line change
@@ -16,13 +16,13 @@ integration_tests:
1616
pass: "{{ env_var('CI_REDSHIFT_DBT_PASS') }}"
1717
dbname: "{{ env_var('CI_REDSHIFT_DBT_DBNAME') }}"
1818
port: 5439
19-
schema: app_reporting_integrations_test_6
19+
schema: app_reporting_integrations_test_9
2020
threads: 8
2121
bigquery:
2222
type: bigquery
2323
method: service-account-json
2424
project: 'dbt-package-testing'
25-
schema: app_reporting_integrations_test_6
25+
schema: app_reporting_integrations_test_9
2626
threads: 8
2727
keyfile_json: "{{ env_var('GCLOUD_SERVICE_KEY') | as_native }}"
2828
snowflake:
@@ -33,7 +33,7 @@ integration_tests:
3333
role: "{{ env_var('CI_SNOWFLAKE_DBT_ROLE') }}"
3434
database: "{{ env_var('CI_SNOWFLAKE_DBT_DATABASE') }}"
3535
warehouse: "{{ env_var('CI_SNOWFLAKE_DBT_WAREHOUSE') }}"
36-
schema: app_reporting_integrations_test_6
36+
schema: app_reporting_integrations_test_9
3737
threads: 8
3838
postgres:
3939
type: postgres
@@ -42,13 +42,13 @@ integration_tests:
4242
pass: "{{ env_var('CI_POSTGRES_DBT_PASS') }}"
4343
dbname: "{{ env_var('CI_POSTGRES_DBT_DBNAME') }}"
4444
port: 5432
45-
schema: app_reporting_integrations_test_6
45+
schema: app_reporting_integrations_test_9
4646
threads: 8
4747
databricks:
4848
catalog: "{{ env_var('CI_DATABRICKS_DBT_CATALOG') }}"
4949
host: "{{ env_var('CI_DATABRICKS_DBT_HOST') }}"
5050
http_path: "{{ env_var('CI_DATABRICKS_DBT_HTTP_PATH') }}"
51-
schema: app_reporting_integrations_test_6
51+
schema: app_reporting_integrations_test_9
5252
threads: 8
5353
token: "{{ env_var('CI_DATABRICKS_DBT_TOKEN') }}"
5454
type: databricks

‎integration_tests/dbt_project.yml

+12-55
Original file line numberDiff line numberDiff line change
@@ -1,13 +1,14 @@
11
name: 'app_reporting_integration_tests'
2-
version: '0.4.0'
2+
version: '0.5.0'
33
profile: 'integration_tests'
44
config-version: 2
55
vars:
66
# apple_store__using_subscriptions: true # uncomment this line when generating docs!
77
# google_play__using_subscriptions: true # uncomment this line when regenerating docs!
88
# google_play__using_earnings: true # uncomment this line when regenerating docs!
9-
google_play_schema: app_reporting_integrations_test_6
10-
apple_store_schema: app_reporting_integrations_test_6
9+
google_play_schema: app_reporting_integrations_test_9
10+
apple_store_schema: app_reporting_integrations_test_9
11+
1112
google_play_source:
1213
google_play_stats_installs_app_version_identifier: "stats_installs_app_version"
1314
google_play_stats_crashes_app_version_identifier: "stats_crashes_app_version"
@@ -28,22 +29,14 @@ vars:
2829
google_play_financial_stats_subscriptions_country_identifier: "financial_stats_subscriptions_country"
2930

3031
apple_store_source:
31-
apple_store_app_identifier: "app"
32-
apple_store_app_store_platform_version_source_type_report_identifier: "app_store_platform_version_source_type"
33-
apple_store_app_store_source_type_device_report_identifier: "app_store_source_type_device"
34-
apple_store_app_store_territory_source_type_report_identifier: "app_store_territory_source_type"
35-
apple_store_crashes_app_version_device_report_identifier: "crashes_app_version"
36-
apple_store_crashes_platform_version_device_report_identifier: "crashes_platform_version"
37-
apple_store_downloads_platform_version_source_type_report_identifier: "downloads_platform_version_source_type"
38-
apple_store_downloads_source_type_device_report_identifier: "downloads_source_type_device"
39-
apple_store_downloads_territory_source_type_report_identifier: "downloads_territory_source_type"
40-
apple_store_sales_account_identifier: "sales_account"
41-
apple_store_sales_subscription_event_summary_identifier: "sales_subscription_events"
32+
apple_store_app_identifier: "app_store_app"
33+
apple_store_sales_subscription_event_summary_identifier: "sales_subscription_event_summary"
4234
apple_store_sales_subscription_summary_identifier: "sales_subscription_summary"
43-
apple_store_usage_app_version_source_type_report_identifier: "usage_app_version_source_type"
44-
apple_store_usage_platform_version_source_type_report_identifier: "usage_platform_version_source_type"
45-
apple_store_usage_source_type_device_report_identifier: "usage_source_type_device"
46-
apple_store_usage_territory_source_type_report_identifier: usage_territory_source_type
35+
apple_store_discovery_and_engagement_standard_daily_identifier: "app_store_discovery_and_engagement_standard_daily"
36+
apple_store_crash_daily_identifier: "app_crash_daily"
37+
apple_store_download_standard_daily_identifier: "app_store_download_standard_daily"
38+
apple_store_session_standard_daily_identifier: "app_session_standard_daily"
39+
apple_store_installation_and_deletion_standard_daily_identifier: "app_store_installation_and_deletion_standard_daily"
4740

4841
apple_store__subscription_events:
4942
- 'Renew'
@@ -70,40 +63,4 @@ seeds:
7063
active_device_installs: "{{ 'int64' if target.type == 'bigquery' else 'bigint' }}"
7164
stats_ratings_app_version:
7265
+column_types:
73-
app_version_code: "{{ 'int64' if target.type == 'bigquery' else 'bigint' }}"
74-
app_store_platform_version_source_type:
75-
+column_types:
76-
date: timestamp
77-
crashes_platform_version:
78-
+column_types:
79-
date: timestamp
80-
crashes_app_version:
81-
+column_types:
82-
date: timestamp
83-
downloads_platform_version_source_type:
84-
+column_types:
85-
date: timestamp
86-
app_store_territory_source_type:
87-
+column_types:
88-
date: timestamp
89-
downloads_source_type_device:
90-
+column_types:
91-
date: timestamp
92-
app_store_source_type_device:
93-
+column_types:
94-
date: timestamp
95-
usage_source_type_device:
96-
+column_types:
97-
date: timestamp
98-
downloads_territory_source_type:
99-
+column_types:
100-
date: timestamp
101-
usage_territory_source_type:
102-
+column_types:
103-
date: timestamp
104-
usage_platform_version_source_type:
105-
+column_types:
106-
date: timestamp
107-
usage_app_version_source_type:
108-
+column_types:
109-
date: timestamp
66+
app_version_code: "{{ 'int64' if target.type == 'bigquery' else 'bigint' }}"

‎integration_tests/seeds/app.csv

-2
This file was deleted.

‎integration_tests/seeds/app_crash_daily.csv

+11
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,11 @@
1+
_fivetran_id,app_id,date,app_version,device,platform_version,crashes,unique_devices,_fivetran_synced
2+
mATdTIo1WH34/utbwQZkvLNs6wU=,239587236,2024-12-04,120614,iPhone,iOS 16.4,1,1,2024-12-11 05:13:33.444 +00:00
3+
PYNoHVNnmMuAKBkHqvpL2G6462E=,239587236,2024-12-05,1.3.4,Apple Vision,visionOS 1.0,1,1,2024-12-12 05:14:16.162 +00:00
4+
YKv85Suuzv2jkvVhAyg2F8WM7SY=,239587236,2024-12-05,1242228,iPhone,iOS 17.1,1,1,2024-12-12 05:14:16.173 +00:00
5+
fyzwmTKUa2Rcwyzp7iKJVNwa004=,239587236,2024-12-05,1206422,iPhone,iOS 15.1,1,1,2024-12-12 05:14:16.170 +00:00
6+
rI4nrxlzrGiShj+7lnkVNLA4DdU=,239587236,2024-12-05,120222,iPhone,iOS 17.4,1,1,2024-12-12 05:14:16.166 +00:00
7+
iBFL/ZX+cw+LEb9QzQ0EIDmIsqg=,239587236,2024-12-05,120222.1,iPhone,iOS 17.2,1,1,2024-12-12 05:14:16.189 +00:00
8+
RN7svEING9NuyLcOQkgRgcyPcGc=,239587236,2024-12-05,55555,iPhone,iOS 14.2,1,1,2024-12-12 05:14:16.175 +00:00
9+
WIP6VVo9+T0ptzvWfSChZ+oSK1w=,239587236,2024-12-05,55555.5,iPhone,iOS 17.4,1,1,2024-12-12 05:14:16.157 +00:00
10+
9liOcvJVocUOsGJdywFyCnwiIlg=,239587236,2024-12-06,55554,iPhone,iOS 18.1,1,1,2024-12-13 05:12:19.497 +00:00
11+
ow5NCW34KSFvzijb+vJaiqeZr9c=,239587236,2024-12-06,1,iPhone,iOS 17.5,1,1,2024-12-13 05:12:19.527 +00:00

‎integration_tests/seeds/app_session_standard_daily.csv

+11
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,11 @@
1+
_fivetran_id,app_id,date,app_version,device,platform_version,source_type,page_type,app_download_date,territory,sessions,total_session_duration,unique_devices,_fivetran_synced
2+
o5wEoLRdDH/NskmQrUaaZBKLaTM=,239587236,2024-11-08,329372.0,iPhone,iOS 17.6,App referrer,Product page,,US,14,797,5,2024-11-13 17:10:45.370 +00:00
3+
z5uCMEdxXVl3h0n+kYepEiVUtvo=,239587236,2024-11-09,120652.0,iPhone,iOS 16.7,App Store search,Product page,,IT,9,898,5,2024-11-14 17:10:29.921 +00:00
4+
VbvXuJhvMfNLeK0uN1kG/9H1K3c=,239587236,2024-11-09,329372.0,iPhone,iOS 18.1,Web referrer,Product page,,TW,23,752,5,2024-11-14 17:10:32.333 +00:00
5+
xq+QCXmwomsV+hoAVUXQ53pVevY=,239587236,2024-11-10,329372.0,iPhone,iOS 17.6,App Store search,No page,2024-11-02,PT,18,306,5,2024-11-15 17:15:52.331 +00:00
6+
Xa6PaV9l8ni0U6VGuNwSNMm7KdU=,239587236,2024-11-10,329372.1,iPhone,iOS 17.4,App Store search,No page,,HK,15,3198,7,2024-11-15 17:15:53.906 +00:00
7+
GF8h2QWP830nj8JLncVlc3ijoqA=,239587236,2024-11-10,329372.1,iPhone,iOS 17.6,App Store search,No page,2024-11-10,IL,20,2873,7,2024-11-15 17:15:53.993 +00:00
8+
kGwZC0OxQTTlblE1X/H4KjUpFv8=,239587236,2024-11-10,120658.0,iPhone,iOS 18.0,App Store search,Product page,,IT,6,76,6,2024-11-15 17:15:51.026 +00:00
9+
NgrBbeUJS4ydIChu1HbkUteIoM4=,239587236,2024-11-10,329372.0,iPhone,iOS 17.5,Web referrer,Product page,,SE,6,358,5,2024-11-15 17:15:52.045 +00:00
10+
iSC24SA4YvjP88OUma5VAuqbAIk=,239587236,2024-11-10,120654.0,iPhone,iOS 16.7,App Store search,No page,,LB,85,15485,5,2024-11-15 17:15:50.794 +00:00
11+
NSjp+2R/xirT0vO4JQMQfWDwEHk=,239587236,2024-11-10,329372.1,iPhone,iOS 17.4,App Store search,No page,,GB,11,385,5,2024-11-15 17:15:53.906 +00:00

‎integration_tests/seeds/app_store_app.csv

+2
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
1+
id,name,primary_locale,content_rights_declaration,was_made_for_kids,subscription_status_url,subscription_status_url_version,subscription_status_url_for_sandbox,subscription_status_url_version_for_sandbox,_fivetran_synced
2+
239587236,Sample,en-US,DOES_NOT_USE_THIRD_PARTY_CONTENT,,https://example.com/subscription_status,v1,https://sandbox.example.com/subscription_status,v2,2022-01-02 12:34:56.789000+00:00

‎integration_tests/seeds/app_store_discovery_and_engagement_standard_daily.csv

+11
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,11 @@
1+
_fivetran_id,app_id,date,event,page_type,source_type,engagement_type,device,platform_version,territory,counts,unique_counts,_fivetran_synced
2+
5SJIE4ZfUINJ3AI1T1A5AzRUqLc=,239587236,2024-11-04,Page view,Store sheet,App referrer,,iPhone,iOS 17.4,US,7,5,2024-11-07 17:10:21.652 +00:00
3+
fTN+30viu9DOGf7xi0alJ3h3HMs=,239587236,2024-11-04,Page view,Store sheet,App Store browse,,iPhone,iOS 17.3,US,6,6,2024-11-07 17:10:18.235 +00:00
4+
9zmUs3grlpd8K7mhYs6t0P7GGBc=,239587236,2024-11-04,Page view,Store sheet,App referrer,,iPhone,iOS 18.0,US,5,5,2024-11-07 17:10:21.376 +00:00
5+
Ar8iylQfK9915AfMCqvslNeqbco=,239587236,2024-11-05,Page view,Store sheet,App referrer,,iPad,iOS 16.7,FR,5,5,2024-11-08 17:11:38.625 +00:00
6+
vRqeI3eSZtOtBqzLpWvtQXheFDI=,239587236,2024-11-05,Tap,Store sheet,App Store browse,Open,iPhone,iOS 17.6,CA,6,6,2024-11-08 17:11:38.572 +00:00
7+
pvCxArKHnaAFxuZf63/1PYKkiR4=,239587236,2024-11-05,Tap,Store sheet,App Store browse,Open,iPhone,iOS 18.0,GR,5,5,2024-11-08 17:11:40.033 +00:00
8+
6lXCI/W8NqhA3UsQQFvU58cuTZw=,239587236,2024-11-05,Impression,No page,App Store search,,iPhone,iOS 16.6,FR,5,5,2024-11-08 17:11:31.470 +00:00
9+
32rZ60OOHhVps86YhkBS3Z8+BiE=,239587236,2024-11-05,Page view,Store sheet,App referrer,,iPhone,iOS 18.1,FR,5,5,2024-11-08 17:11:31.699 +00:00
10+
Gm1Bl6Omn5JN2deWlmUAYpfjc/w=,239587236,2024-11-05,Page view,Store sheet,App referrer,,iPhone,iOS 16.7,FR,11,5,2024-11-08 17:11:34.334 +00:00
11+
pK52DqMhmHqf7bp6bWbAV159zDQ=,239587236,2024-11-05,Page view,Store sheet,App referrer,,iPhone,iOS 18.0,FR,5,5,2024-11-08 17:11:31.056 +00:00

‎integration_tests/seeds/app_store_download_standard_daily.csv

+11
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,11 @@
1+
_fivetran_id,app_id,date,download_type,app_version,device,platform_version,source_type,page_type,pre_order,territory,counts,_fivetran_synced
2+
BkesX890oPBVMhTXQ/hiDdx6qtI=,239587236,2024-10-31,Auto-update,329372.0,iPhone,iOS 17.6,Web referrer,Product page,,SI,5,2024-11-02 17:08:18.158 +00:00
3+
0thg2HpfH+pyt51xfqsX2gjBqng=,239587236,2024-10-31,Auto-update,329372.1,Apple TV,tvOS 18.0,Unavailable,Product page,,AU,5,2024-11-02 17:08:23.298 +00:00
4+
lueVOUt20qfGZTy7okfwofpHWEw=,239587236,2024-10-31,Auto-update,329372.0,iPad,iOS 17.7,App referrer,Store sheet,,AU,5,2024-11-02 17:08:21.313 +00:00
5+
jB997hDHmq8fhclBbRLme9x+S2I=,239587236,2024-10-31,Auto-update,329372.1,iPhone,iOS 17.6,Unavailable,Product page,,PT,5,2024-11-02 17:08:24.920 +00:00
6+
4wA7BEsAKZf8NT1FwxQRAi/GfSI=,239587236,2024-10-31,Auto-update,329372.0,iPhone,iOS 18.1,Unavailable,No page,,DE,5,2024-11-02 17:08:20.343 +00:00
7+
eKdeGwYA7mc5y+dG/KIypR37d6U=,239587236,2024-10-31,Auto-update,120652.0,iPad,iOS 18.0,Unavailable,No page,,JP,5,2024-11-02 17:08:18.687 +00:00
8+
Ropru4fq66wJDBlw8uX7S3Y8C3c=,239587236,2024-10-31,Auto-update,329372.0,Apple TV,tvOS 17.2,App Store search,No page,,AU,6,2024-11-02 17:08:23.535 +00:00
9+
O7UP8N94zIg8GGMIx9B+G1NdIso=,239587236,2024-10-31,Auto-update,329372.1,iPad,iOS 16.3,App Store search,No page,,MY,8,2024-11-02 17:08:20.909 +00:00
10+
rHAiOrf6uCyTLOQI83Sp/4U7I3w=,239587236,2024-10-31,Auto-update,120658.0,iPhone,iOS 18.1,App Store browse,No page,,HK,9,2024-11-02 17:08:25.364 +00:00
11+
QP/giakN+TvGdJeYYUri1dZ9eAU=,239587236,2024-10-31,Manual update,120654.0,iPhone,iOS 17.5,Unavailable,No page,,MY,5,2024-11-02 17:08:20.541 +00:00

‎integration_tests/seeds/app_store_installation_and_deletion_standard_daily.csv

+11
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,11 @@
1+
_fivetran_id,app_id,date,event,download_type,app_version,device,platform_version,source_type,page_type,app_download_date,territory,counts,unique_devices,_fivetran_synced
2+
rLTCNO6J9D59i7ffRhp+E5EyleQ=,239587236,2024-11-11,Install,Manual update,329372.0,iPhone,iOS 17.5,Web referrer,Product page,,AU,5,5,2024-11-16 17:09:33.790 +00:00
3+
4NMQBTa2qQSIR9OAJEoekOzqANM=,239587236,2024-11-11,Install,Manual update,329372.1,iPhone,iOS 18.1,App Store browse,No page,2024-10-24,MX,6,6,2024-11-16 17:09:34.269 +00:00
4+
TGwYHBcBQrDPz5kyrHqwRquf2Pc=,239587236,2024-11-12,Install,Manual update,329372.0,iPhone,iOS 18.0,App Store search,No page,,CR,5,5,2024-11-18 05:10:16.445 +00:00
5+
QnICsNy0tjs++YD8Jd/gKnkVqr8=,239587236,2024-11-12,Install,Redownload,329372.1,iPhone,iOS 18.0,App Store browse,No page,2024-11-11,US,12,5,2024-11-18 05:10:17.222 +00:00
6+
4tfCNvQ77h0QLLhbIfilFbxr4Oo=,239587236,2024-11-12,Install,Manual update,329372.1,iPad,iOS 17.7,App Store search,No page,,KR,8,6,2024-11-18 05:10:16.576 +00:00
7+
Vki6Z8OPqh87H8+vc0ISkQ5S9aU=,239587236,2024-11-12,Install,Manual update,329372.0,iPhone,iOS 17.6,Unavailable,No page,,SG,7,7,2024-11-18 05:10:16.424 +00:00
8+
uYwjMGDUKeWHsgF0G6BBREsc8gg=,239587236,2024-11-12,Install,Manual update,329372.1,iPad,iOS 18.0,App Store search,Product page,,US,50,45,2024-11-18 05:10:16.605 +00:00
9+
53TtP8bqpftYRBqkTsZLXsnjG2A=,239587236,2024-11-12,Install,Manual update,329372.1,iPhone,iOS 18.1,Unavailable,No page,,TR,23,20,2024-11-18 05:10:17.173 +00:00
10+
hpZC6khrDuFKOt5BHC8E4yxeunY=,239587236,2024-11-12,Install,Manual update,329372.1,iPad,iOS 17.6,App Store browse,No page,,AU,16,16,2024-11-18 05:10:16.529 +00:00
11+
DjTfw5IHcig1bhl3leRb5SExOis=,239587236,2025-01-27,Delete,,120670.0,iPhone,iOS 18.2,App Store browse,No page,,US,6,6,2025-01-28 17:09:31.693 +00:00

‎integration_tests/seeds/app_store_platform_version_source_type.csv

-11
This file was deleted.

‎integration_tests/seeds/app_store_source_type_device.csv

-11
This file was deleted.

0 commit comments

Comments
 (0)