v5.0 - v5.5 Data Sync Documentation
  • Overview
  • Release Notes
    • V4.5
    • V4.6
    • v4.7
    • v4.8
    • v4.9
    • v4.10
    • v4.12
    • v4.13
  • v4 Connections Installation Guide
    • v5 Connections and CLI Installation Guide
  • v4 Worker/Listener Installation Guide
    • v5 Worker/Listener Installation Guide
  • Upgrades & Config Changes
  • Builder Guide
    • Overview
    • Types of Data Syncs
    • Subscribing to Event Streams
      • Supported Stream Sources
        • Amazon Simple Queue Service (SQS)
        • Cinchy Change Data Capture
        • Data Polling
        • Kafka Topic
        • MongoDB
        • Salesforce
          • Push Topic
          • Platform Event
    • Configuring a Data Sync
      • Connections Experience & XML Config Reference
        • Info
          • Parameters
            • String Escape
        • Source Config Reference
          • Schema Columns
            • Calculated Column Examples
          • Auth Requests
          • Request Headers
          • Pagination
          • Source Filter
        • Target Destination Config Reference
          • Column Mappings
          • Target Destination Filter
        • Sync Behaviour
        • Post Sync
        • Permissions
        • Jobs
        • Connections Usage Example
      • Data Validation
      • Transformations
        • StringReplacement
      • Supported Data Sources
        • File Based Source
          • Binary File
            • Binary File Data Source Example
          • Delimited File
            • Delimited File Data Source XML Example
          • Fixed Width File
          • Excel
            • Excel Source XML Example
        • Cinchy Event Broker/CDC
          • Cinchy Event Broker/CDC XML Config Example
        • Cinchy Table
          • Cinchy Table XML Config Example
        • Cinchy Query
          • Cinchy Query Data Source Example
        • Copper
        • DB2
        • Dynamics 2015
        • Dynamics
        • DynamoDB
        • Kafka Topic
          • Apache AVRO Data Format
          • Kafka Topic Source Example
        • LDAP
        • MongoDB Collection
          • MongoDB Collection Source XML Example
        • MongoDB Collection (Cinchy Event Triggered)
        • MS SQL Server Query
        • MS SQL Server Table
        • ODBC Table
        • ODBC Query
        • Oracle Table
        • Oracle Query
        • Parquet
        • Polling Event
          • Polling Event Example
        • REST API (Cinchy Event Triggered)
        • REST API
          • REST API XML Example
        • SAP SuccessFactors
        • Salesforce Object (Bulk API)
        • Salesforce Platform Event
        • Salesforce Push Topic
        • Snowflake
          • Snowflake Source XML Example
        • SOAP 1.2 Web Service
      • Supported Sync Targets
        • Cinchy Table
        • DB2 Table
        • Dynamics
        • Kafka Topic
        • MongoDB Collection (Column Based)
        • MS SQL Server Table
        • Oracle Table
        • REST API
        • Salesforce
        • Salesforce Object
        • Snowflake Table
          • Snowflake Table Target XML Example
        • SOAP 1.2 Web Service
    • Common Design Patterns
    • Testing a Data Sync
    • Promoting a Data Sync
    • Scheduling a Data Sync
    • CLI Command List
    • Connections Functions
    • Monitoring
  • Cinchy Platform Documentation
Powered by GitBook
On this page
  • Application Upgrades
  • Cinchy Platform
  • Cinchy CLI Worker
  • Cinchy Listener
  • Configuration Changes
  • Adding Fields
  • Removing Fields
  • Changing Column Mapping
  • Changing Sync Key

Was this helpful?

Upgrades & Config Changes

There's multiple components in the Connector architecture and they are upgraded individually.

Application Upgrades

Cinchy Platform

Cinchy Platform hosts the configurations for the listener and worker. Any new features that require a change in the data model (e.g. New configurable setting in the listener, change in structure of the error messages) will require you to upgrade your Cinchy Platform instance. New versions of Cinchy Platform are backwards compatible with your old data sync configurations, so it is recommended that you upgrade your Cinchy Platform first if you want to use a new feature.

Cinchy CLI Worker

The CLI worker reads a configuration from Cinchy Platform and performs the data synchronization. You can use multiple versions of the CLI Worker at the same time with a single instance of Cinchy Platform, so you can test or run your configurations through a new CLI worker locally before promoting that version of the CLI to production.

If you are running batch syncs, you can simply switch out the CLI you are using between jobs. For the CLI worker service, disable the listener subscriptions first and check that there are no more outstanding messages in the queue before shutting down the worker service. You can then start up the newer CLI worker service pointing to the same queue in SQL, and then enable your listener configurations.

Cinchy Listener

The Listener picks up the subscriptions from Cinchy Platform. Similar to the worker, if you are upgrading for a new feature in the listener you should upgrade Cinchy Platform first. To upgrade the Listener, disable all subscriptions first before shutting down the Listener. When you start up the new Listener, make sure it is using the same state configuration file so it can pick up where the last one left off and you do not lose any messages.

Configuration Changes

Adding Fields

If you are adding more fields to sync, ensure the columns are in the target system first. You can then swap in the new data sync configuration whenever and it will get picked up for future execution.

Removing Fields

If you are removing fields to sync, swap out your data sync configuration. You can optionally delete the field in the source and/or target system afterwards.

Changing Column Mapping

If there are no fields being added or deleted, simply swap out your sync configuration. If you need to add or remove fields, follow the guidelines above of when to swap in the config versus making the data model changes (add columns first, swap out config, validate config, delete unneeded columns).

Changing Sync Key

Simply swap out your data sync configuration if you are changing the sync key. It is a good idea to check if your new sync key is unique in both your source and target. The CLI worker will sync using the first record it found in the source to the first record it finds in the target. Checking for duplicate sync keys will allow you to understand whether any unexpected behavior will occur.

Previousv5 Worker/Listener Installation GuideNextOverview

Last updated 4 years ago

Was this helpful?