GitBook: [master] 25 pages and 46 assets modified

Jimao · Apr 16, 2021 · 0b4eddc · 0b4eddc
1 parent df80593
commit 0b4eddc
Show file tree

Hide file tree

Showing 58 changed files with 156 additions and 139 deletions.
diff --git a/docs/.gitbook/assets/activate-webhook.png b/docs/.gitbook/assets/activate-webhook.png
diff --git a/docs/.gitbook/assets/airbyte-dashboard.png b/docs/.gitbook/assets/airbyte-dashboard.png
diff --git a/docs/.gitbook/assets/app-information.png b/docs/.gitbook/assets/app-information.png
diff --git a/docs/.gitbook/assets/app-name-modal.png b/docs/.gitbook/assets/app-name-modal.png
diff --git a/docs/.gitbook/assets/change-to-date-time.png b/docs/.gitbook/assets/change-to-date-time.png
diff --git a/....gitbook/assets/23_change-to-per-week.png → ...gitbook/assets/change-to-per-week (1).png b/....gitbook/assets/23_change-to-per-week.png → ...gitbook/assets/change-to-per-week (1).png
diff --git a/docs/.gitbook/assets/choose-postgres-destination.png b/docs/.gitbook/assets/choose-postgres-destination.png
diff --git a/docs/.gitbook/assets/click.png b/docs/.gitbook/assets/click.png
diff --git a/docs/.gitbook/assets/17_datasources.png → docs/.gitbook/assets/datasources (2).png b/docs/.gitbook/assets/17_datasources.png → docs/.gitbook/assets/datasources (2).png
diff --git a/docs/.gitbook/assets/destination.png b/docs/.gitbook/assets/destination.png
diff --git a/docs/.gitbook/assets/drag-created-at.png b/docs/.gitbook/assets/drag-created-at.png
diff --git a/...sets/31_time-spent-in-weekly-webinars.png → ...duration-spent-in-weekly-webinars (1).png b/...sets/31_time-spent-in-weekly-webinars.png → ...duration-spent-in-weekly-webinars (1).png
diff --git a/docs/.gitbook/assets/empty-meeting-sheet.png b/docs/.gitbook/assets/empty-meeting-sheet.png
diff --git a/...ets/25_evolution-of-meetings-per-week.png → ...ts/evolution-of-meetings-per-week (1).png b/...ets/25_evolution-of-meetings-per-week.png → ...ts/evolution-of-meetings-per-week (1).png
diff --git a/docs/.gitbook/assets/fill-in-connection-details.png b/docs/.gitbook/assets/fill-in-connection-details.png
diff --git a/docs/.gitbook/assets/hours-spent-in-weekly-meetings.png b/docs/.gitbook/assets/hours-spent-in-weekly-meetings.png
diff --git a/docs/.gitbook/assets/14_launch.png → docs/.gitbook/assets/launch (1).png b/docs/.gitbook/assets/14_launch.png → docs/.gitbook/assets/launch (1).png
diff --git a/...assets/29_meetings-participant-ranked.png → ...ssets/meetings-participant-ranked (1).png b/...assets/29_meetings-participant-ranked.png → ...ssets/meetings-participant-ranked (1).png
diff --git a/docs/.gitbook/assets/meetings-per-week.png b/docs/.gitbook/assets/meetings-per-week.png
diff --git a/docs/.gitbook/assets/number-of-webinars-participants.png b/docs/.gitbook/assets/number-of-webinars-participants.png
diff --git a/...r_of_participants_per_weekly_meetings.png → ..._participants_per_weekly_meetings (1).png b/...r_of_participants_per_weekly_meetings.png → ..._participants_per_weekly_meetings (1).png
diff --git a/docs/.gitbook/assets/number_of_webinar_attended_per_week.png b/docs/.gitbook/assets/number_of_webinar_attended_per_week.png
diff --git a/...itbook/assets/12_postgres_credentials.png → ...tbook/assets/postgres_credentials (1).png b/...itbook/assets/12_postgres_credentials.png → ...tbook/assets/postgres_credentials (1).png
diff --git a/docs/.gitbook/assets/13_schema.png → docs/.gitbook/assets/schema (1).png b/docs/.gitbook/assets/13_schema.png → docs/.gitbook/assets/schema (1).png
diff --git a/docs/.gitbook/assets/setting-zoom-connector-name.png b/docs/.gitbook/assets/setting-zoom-connector-name.png
diff --git a/docs/.gitbook/assets/09_setup-successful.png → .../.gitbook/assets/setup-successful (1).png b/docs/.gitbook/assets/09_setup-successful.png → .../.gitbook/assets/setup-successful (1).png
diff --git a/docs/.gitbook/assets/15_sync-screen.png → docs/.gitbook/assets/sync-screen (1).png b/docs/.gitbook/assets/15_sync-screen.png → docs/.gitbook/assets/sync-screen (1).png
diff --git a/.../.gitbook/assets/16_tableau-dashboard.png → ....gitbook/assets/tableau-dashboard (1).png b/.../.gitbook/assets/16_tableau-dashboard.png → ....gitbook/assets/tableau-dashboard (1).png
diff --git a/docs/.gitbook/assets/tableau-view-with-all-tables.png b/docs/.gitbook/assets/tableau-view-with-all-tables.png
diff --git a/docs/.gitbook/assets/view-jwt-token.png b/docs/.gitbook/assets/view-jwt-token.png
diff --git a/docs/.gitbook/assets/weekly-webinars.png b/docs/.gitbook/assets/weekly-webinars.png
diff --git a/docs/.gitbook/assets/zoom-dashboard.png b/docs/.gitbook/assets/zoom-dashboard.png
diff --git a/...sets/04_zoom-marketplace-build-screen.png → ...ets/zoom-marketplace-build-screen (1).png b/...sets/04_zoom-marketplace-build-screen.png → ...ets/zoom-marketplace-build-screen (1).png
diff --git a/docs/SUMMARY.md b/docs/SUMMARY.md
@@ -93,7 +93,7 @@
   * [High-level View](architecture/high-level-view.md)
   * [Workers & Jobs](architecture/jobs.md)
   * [Technical Stack](architecture/tech-stack.md)
-  * [Change Data Capture (CDC)](architecture/cdc.md)
+  * [Change Data Capture \(CDC\)](architecture/cdc.md)
 * [Contributing to Airbyte](contributing-to-airbyte/README.md)
   * [Code of Conduct](contributing-to-airbyte/code-of-conduct.md)
   * [Developing Locally](contributing-to-airbyte/developing-locally.md)

diff --git a/docs/architecture/cdc.md b/docs/architecture/cdc.md
@@ -1,21 +1,25 @@
-# Change Data Capture (CDC)
+# Change Data Capture \(CDC\)
 
 ## What is log-based incremental replication?
-Many common databases support writing all record changes to log files for the purpose of replication. A consumer of these log files (such as Airbyte) can read these logs while keeping track of the current position within the logs in order to read all record changes coming from `DELETE`/`INSERT`/`UPDATE` statements.  
+
+Many common databases support writing all record changes to log files for the purpose of replication. A consumer of these log files \(such as Airbyte\) can read these logs while keeping track of the current position within the logs in order to read all record changes coming from `DELETE`/`INSERT`/`UPDATE` statements.
 
 ## Syncing
+
 The orchestration for syncing is similar to non-CDC database sources. After selecting a sync interval, syncs are launched regularly. We read data from the log up to the time that the sync was started. We do not treat CDC sources as infinite streaming sources. You should ensure that your schedule for running these syncs is frequent enough to consume the logs that are generated. The first time the sync is run, a snapshot of the current state of the data will be taken. This is done using `SELECT` statements and is effectively a Full Refresh. Subsequent syncs will use the logs to determine which changes took place since the last sync and update those. Airbyte keeps track of the current log position between syncs.
 
 A single sync might have some tables configured for Full Refresh replication and others for Incremental. If CDC is configured at the source level, all tables with Incremental selected will use CDC. All Full Refresh tables will replicate using the same process as non-CDC sources. However, these tables will still include CDC metadata columns by default.
 
 The Airbyte Protocol outputs records from sources. Records from `UPDATE` statements appear the same way as records from `INSERT` statements. We support different options for how to sync this data into destinations using primary keys, so you can choose to append this data, delete in place, etc.
 
 We add some metadata columns for CDC sources:
+
 * `ab_cdc_lsn` is the point in the log where the record was retrieved
 * `ab_cdc_updated_at` is the timestamp for the database transaction that resulted in this record change and is present for records from `DELETE`/`INSERT`/`UPDATE` statements 
 * `ab_cdc_deleted_at` is the timestamp for the database transaction that resulted in this record change and is only present for records from `DELETE` statements
 
 ## Limitations
+
 * CDC incremental is only supported for tables with primary keys. A CDC source can still choose to replicate tables without primary keys as Full Refresh or a non-CDC source can be configured for the same database to replicate the tables without primary keys using standard incremental replication.
 * Data must be in tables, not views.
 * The modifications you are trying to capture must be made using `DELETE`/`INSERT`/`UPDATE`. For example, changes made from `TRUNCATE`/`ALTER`  won't appear in logs and therefore in your destination.
@@ -24,10 +28,13 @@ We add some metadata columns for CDC sources:
 * The records produced by `DELETE` statements only contain primary keys. All other data fields are unset.
 
 ## Current Support
+
 * [Postgres](../integrations/sources/postgres.md)
 
 ## Coming Soon
+
 * [MySQL](../integrations/sources/mysql.md)
 * [SQL Server / MSSQL](../integrations/sources/mssql.md)
 * Oracle DB
-* Please [create a ticket](https://github.com/airbytehq/airbyte/issues/new/choose) if you need CDC support on another database!
+* Please [create a ticket](https://github.com/airbytehq/airbyte/issues/new/choose) if you need CDC support on another database!
+
diff --git a/docs/architecture/jobs.md b/docs/architecture/jobs.md
@@ -9,21 +9,15 @@ In Airbyte, all interactions with connectors are run as jobs performed by a Work
 
 ## Worker Responsibilities
 
-The worker has 4 main responsibilities in its lifecycle.
-1. Spin up any connector docker containers that are needed for the job.
-2. They facilitate message passing to or from a connector docker container (more on this [below](#message-passing)).
-3. Shut down any connector docker containers that it started.
-4. Return the output of the job. (See [Airbyte Specification](./airbyte-specification.md) to understand the output of each worker type.)
+The worker has 4 main responsibilities in its lifecycle. 1. Spin up any connector docker containers that are needed for the job. 2. They facilitate message passing to or from a connector docker container \(more on this [below](jobs.md#message-passing)\). 3. Shut down any connector docker containers that it started. 4. Return the output of the job. \(See [Airbyte Specification](airbyte-specification.md) to understand the output of each worker type.\)
 
 ## Message Passing
 
-There are 2 flavors of workers:
-1. There are workers that interact with a single connector (e.g. spec, check, discover)
-2. There are workers that interact with 2 connectors (e.g. sync, reset)
+There are 2 flavors of workers: 1. There are workers that interact with a single connector \(e.g. spec, check, discover\) 2. There are workers that interact with 2 connectors \(e.g. sync, reset\)
 
-In the first case, the worker is generally extracting data from the connector and reporting it back to the scheduler. It does this by listening to STDOUT of the connector. In the second case, the worker is facilitating passing data (via record messages) from the source to the destination. It does this by listening on STDOUT of the source and writing to STDIN on the destination.
+In the first case, the worker is generally extracting data from the connector and reporting it back to the scheduler. It does this by listening to STDOUT of the connector. In the second case, the worker is facilitating passing data \(via record messages\) from the source to the destination. It does this by listening on STDOUT of the source and writing to STDIN on the destination.
 
-For more information on the schema of the messages that are passed, refer to [Airbyte Specification](./airbyte-specification.md).
+For more information on the schema of the messages that are passed, refer to [Airbyte Specification](airbyte-specification.md).
 
 ## Worker Lifecycle
 

diff --git a/docs/architecture/tech-stack.md b/docs/architecture/tech-stack.md
@@ -10,7 +10,9 @@
 * Orchestration: [Temporal](https://temporal.io)
 
 ## Connectors
-Connectors can be written in any language. However the most common languages are: 
+
+Connectors can be written in any language. However the most common languages are:
+
 * Python 3.7.9
 * Java 14
 
@@ -26,3 +28,4 @@ Connectors can be written in any language. However the most common languages are
 * Containerization: [Docker](https://www.docker.com/) and [Docker Compose](https://docs.docker.com/compose/)
 * Linter \(Frontend\): [Prettier](https://prettier.io/)
 * Formatter \(Backend\): [Spotless](https://github.com/diffplug/spotless)
+
diff --git a/docs/career-and-open-positions/README.md b/docs/career-and-open-positions/README.md
@@ -4,7 +4,7 @@
 
 [Airbyte](http://airbyte.io) is the upcoming open-source standard for EL\(T\). We enable data teams to replicate data from applications, APIs, and databases to data warehouses, lakes, and other destinations. We believe only an open-source approach can solve the problem of data integration, as it enables us to cover the long tail of integrations while enabling teams to adapt prebuilt connectors to their needs.
 
-Airbyte is remote friendly, with most of the team still based in the Silicon Valley. We’re fully open as a company. Our **[company handbook](https://handbook.airbyte.io)**, **[culture & values](https://handbook.airbyte.io/company/culture-and-values)**, **[strategy](https://handbook.airbyte.io/strategy/strategy)** and **[roadmap](../roadmap.md)** are open to all.
+Airbyte is remote friendly, with most of the team still based in the Silicon Valley. We’re fully open as a company. Our [**company handbook**](https://handbook.airbyte.io), [**culture & values**](https://handbook.airbyte.io/company/culture-and-values), [**strategy**](https://handbook.airbyte.io/strategy/strategy) and [**roadmap**](../roadmap.md) are open to all.
 
 We're backed by some of the world's [top investors](./#our-investors) and believe in product-led growth, where we build something awesome and let our product bring the users, rather than an outbound sales engine with cold calls.
 
@@ -50,12 +50,12 @@ If the written interview is a success, we might set you up with one or 2 additio
 
 Once all of this done, we will discuss the process internally and get back to you very fast \(velocity is everything here\)! So about 2-3 calls and one written interview, that's it!
 
-## **[Our Benefits](https://handbook.airbyte.io/people/benefits)**
+## [**Our Benefits**](https://handbook.airbyte.io/people/benefits)
 
 * **Flexible work environment as fully remote** - we don’t look at when you log in, log out or how much time you work. We trust you, it’s the only way remote can actually work. 
-* **[Unlimited vacation policy](https://handbook.airbyte.io/people/time-off)** with mandatory minimum time off - so you can fit work around your life.
-* **[Co-working space stipend](https://handbook.airbyte.io/people/expense-policy#work-space)** - we provide everyone with $200/month to use on a coworking space of their choice, if any.
-* **[Parental leave](https://handbook.airbyte.io/people/time-off#parental-leave)** \(for both parents, after one year spent with the company\) - so those raising families can do so while still working for us.
+* [**Unlimited vacation policy**](https://handbook.airbyte.io/people/time-off) with mandatory minimum time off - so you can fit work around your life.
+* [**Co-working space stipend**](https://handbook.airbyte.io/people/expense-policy#work-space) - we provide everyone with $200/month to use on a coworking space of their choice, if any.
+* [**Parental leave**](https://handbook.airbyte.io/people/time-off#parental-leave) \(for both parents, after one year spent with the company\) - so those raising families can do so while still working for us.
 * **Open book policy** - we reimburse books that employees want to purchase for their professional and career development. 
 * **Continuous learning / training policy** - we sponsor the conferences and training programs you feel would add to your development in the company. 
 * **Health insurance** for those from countries that do not provide this freely. Through Savvy in the US, which means you can choose the insurance you want and will receive a stipend from the company. 

diff --git a/docs/career-and-open-positions/founding-developer-advocate.md b/docs/career-and-open-positions/founding-developer-advocate.md
@@ -1,10 +1,10 @@
-# Senior Developer Advocate
+# Founding Developer Advocate
 
 ## **About Airbyte**
 
 [Airbyte](http://airbyte.io) is the upcoming open-source standard for EL\(T\). We enable data teams to replicate data from applications, APIs, and databases to data warehouses, lakes, and other destinations. We believe only an open-source approach can solve the problem of data integration, as it enables us to cover the long tail of integrations while enabling teams to adapt prebuilt connectors to their needs.
 
-Airbyte is remote friendly, with most of the team still based in the Silicon Valley. We’re fully open as a company. Our **[company handbook](https://handbook.airbyte.io)**, **[culture & values](https://handbook.airbyte.io/company/culture-and-values)**, **[strategy](https://handbook.airbyte.io/strategy/strategy)** and **[roadmap](../roadmap.md)** are open to all.
+Airbyte is remote friendly, with most of the team still based in the Silicon Valley. We’re fully open as a company. Our [**company handbook**](https://handbook.airbyte.io), [**culture & values**](https://handbook.airbyte.io/company/culture-and-values), [**strategy**](https://handbook.airbyte.io/strategy/strategy) and [**roadmap**](../roadmap.md) are open to all.
 
 We're backed by some of the world's [top investors](./#our-investors) and believe in product-led growth, where we build something awesome and let our product bring the users, rather than an outbound sales engine with cold calls.
 
@@ -42,9 +42,9 @@ North America.
 ## **We provide**
 
 * **Flexible work environment as fully remote** - we don’t look at when you log in, log out or how much time you work. We trust you, it’s the only way remote can actually work. 
-* **[Unlimited vacation policy](https://handbook.airbyte.io/people/time-off)** with mandatory minimum time off - so you can fit work around your life.
-* **[Co-working space stipend](https://handbook.airbyte.io/people/expense-policy#work-space)** - we provide everyone with $200/month to use on a coworking space of their choice, if any.
-* **[Parental leave](https://handbook.airbyte.io/people/time-off#parental-leave)** \(for both parents, after one year spent with the company\) - so those raising families can do so while still working for us.
+* [**Unlimited vacation policy**](https://handbook.airbyte.io/people/time-off) with mandatory minimum time off - so you can fit work around your life.
+* [**Co-working space stipend**](https://handbook.airbyte.io/people/expense-policy#work-space) - we provide everyone with $200/month to use on a coworking space of their choice, if any.
+* [**Parental leave**](https://handbook.airbyte.io/people/time-off#parental-leave) \(for both parents, after one year spent with the company\) - so those raising families can do so while still working for us.
 * **Open book policy** - we reimburse books that employees want to purchase for their professional and career development. 
 * **Continuous learning / training policy** - we sponsor the conferences and training programs you feel would add to your development in the company. 
 * **Health insurance** for those from countries that do not provide this freely. Through Savvy in the US, which means you can choose the insurance you want and will receive a stipend from the company. 

diff --git a/docs/career-and-open-positions/operations-manager.md b/docs/career-and-open-positions/operations-manager.md
@@ -4,7 +4,7 @@
 
 [Airbyte](http://airbyte.io) is the upcoming open-source standard for EL\(T\). We enable data teams to replicate data from applications, APIs, and databases to data warehouses, lakes, and other destinations. We believe only an open-source approach can solve the problem of data integration, as it enables us to cover the long tail of integrations while enabling teams to adapt prebuilt connectors to their needs.
 
-Airbyte is remote friendly, with most of the team still based in the Silicon Valley. We’re fully open as a company. Our **[company handbook](https://handbook.airbyte.io)**, **[culture & values](https://handbook.airbyte.io/company/culture-and-values)**, **[strategy](https://handbook.airbyte.io/strategy/strategy)** and **[roadmap](../roadmap.md)** are open to all.
+Airbyte is remote friendly, with most of the team still based in the Silicon Valley. We’re fully open as a company. Our [**company handbook**](https://handbook.airbyte.io), [**culture & values**](https://handbook.airbyte.io/company/culture-and-values), [**strategy**](https://handbook.airbyte.io/strategy/strategy) and [**roadmap**](../roadmap.md) are open to all.
 
 We're backed by some of the world's [top investors](./#our-investors) and believe in product-led growth, where we build something awesome and let our product bring the users, rather than an outbound sales engine with cold calls.
 
@@ -44,9 +44,9 @@ Remote
 ## **We provide**
 
 * **Flexible work environment as fully remote** - we don’t look at when you log in, log out or how much time you work. We trust you, it’s the only way remote can actually work. 
-* **[Unlimited vacation policy](https://handbook.airbyte.io/people/time-off)** with mandatory minimum time off - so you can fit work around your life.
-* **[Co-working space stipend](https://handbook.airbyte.io/people/expense-policy#work-space)** - we provide everyone with $200/month to use on a coworking space of their choice, if any.
-* **[Parental leave](https://handbook.airbyte.io/people/time-off#parental-leave)** \(for both parents, after one year spent with the company\) - so those raising families can do so while still working for us.
+* [**Unlimited vacation policy**](https://handbook.airbyte.io/people/time-off) with mandatory minimum time off - so you can fit work around your life.
+* [**Co-working space stipend**](https://handbook.airbyte.io/people/expense-policy#work-space) - we provide everyone with $200/month to use on a coworking space of their choice, if any.
+* [**Parental leave**](https://handbook.airbyte.io/people/time-off#parental-leave) \(for both parents, after one year spent with the company\) - so those raising families can do so while still working for us.
 * **Open book policy** - we reimburse books that employees want to purchase for their professional and career development. 
 * **Continuous learning / training policy** - we sponsor the conferences and training programs you feel would add to your development in the company. 
 * **Health insurance** for those from countries that do not provide this freely. Through Savvy in the US, which means you can choose the insurance you want and will receive a stipend from the company. 

diff --git a/docs/career-and-open-positions/senior-software-engineer.md b/docs/career-and-open-positions/senior-software-engineer.md
@@ -39,9 +39,9 @@ Wherever you want!
 ## **Perks!!!**
 
 * **Flexible work environment as fully remote** - we don’t look at when you log in, log out or how much time you work. We trust you, it’s the only way remote can actually work. 
-* **[Unlimited vacation policy](https://handbook.airbyte.io/people/time-off)** with mandatory minimum time off - so you can fit work around your life.
-* **[Co-working space stipend](https://handbook.airbyte.io/people/expense-policy#work-space)** - we provide everyone with $200/month to use on a coworking space of their choice, if any.
-* **[Parental leave](https://handbook.airbyte.io/people/time-off#parental-leave)** \(for both parents, after one year spent with the company\) - so those raising families can do so while still working for us.
+* [**Unlimited vacation policy**](https://handbook.airbyte.io/people/time-off) with mandatory minimum time off - so you can fit work around your life.
+* [**Co-working space stipend**](https://handbook.airbyte.io/people/expense-policy#work-space) - we provide everyone with $200/month to use on a coworking space of their choice, if any.
+* [**Parental leave**](https://handbook.airbyte.io/people/time-off#parental-leave) \(for both parents, after one year spent with the company\) - so those raising families can do so while still working for us.
 * **Open book policy** - we reimburse books that employees want to purchase for their professional and career development. 
 * **Continuous learning / training policy** - we sponsor the conferences and training programs you feel would add to your development in the company. 
 * **Health insurance** for those from countries that do not provide this freely. Through Savvy in the US, which means you can choose the insurance you want and will receive a stipend from the company. 

diff --git a/docs/changelog/connectors.md b/docs/changelog/connectors.md
@@ -14,11 +14,11 @@ Check out our [connector roadmap](https://github.com/airbytehq/airbyte/projects/
 
 ## 04/13/2021
 
-* New connector: **[Oracle DB](https://docs.airbyte.io/integrations/sources/oracle)**
+* New connector: [**Oracle DB**](https://docs.airbyte.io/integrations/sources/oracle)
 
 ## 04/07/2021
 
-* New connector: **[Google Workspace Admin Reports](https://docs.airbyte.io/integrations/sources/google-workspace-admin-reports)** (audit logs)
+* New connector: [**Google Workspace Admin Reports**](https://docs.airbyte.io/integrations/sources/google-workspace-admin-reports) \(audit logs\)
 * Bugfix in the base python connector library that caused errors to be silently skipped rather than failing the sync
 * **Exchangeratesapi.io** bugfix: to point to the updated API URL
 * **Redshift destination** bugfix: quote keywords “DATETIME” and “TIME” when used as identifiers