Skip to main content
Version: v3.0 print this page

External Amorphic Datasource

Overview​

The External Amorphic Datasource feature enables seamless ingestion of catalog metadata from one Amorphic environment to another. Once ingested, these resources become accessible in the Catalog section of your target Amorphic platform.

Creating an External Amorphic Datasource​

Prerequisites​

  • Amorphic URL of the source environment -- The URL follows the format https://{api_id}.execute-api.{region}.amazonaws.com/{stagename}. To locate this URL, navigate to your Amorphic profile, click on "About ADP" section where you'll find the complete URL.
  • Access Token for authentication -- Create an access token in your Amorphic User Profile & Settings page. Ensure the token has catalog access permissions by selecting the appropriate role during creation.

Steps to Create​

  1. Navigate to the datasource creation page
  2. Select "External Amorphic" as the datasource type
  3. Enter the required credentials:
    • Amorphic URL
    • Access Token

External Amorphic Datasource Creation

Additional Configuration Options​

Asset Filters​

  • Configure specific expressions to filter which assets are fetched from the source environment
  • Helps in selective data ingestion based on your requirements

Schedule Configuration​

  • On-Demand: Default option, requires manual triggering
  • Scheduled: Enable this option to set up automated ingestion
    • Requires a valid cron expression for scheduling
    • Allows for regular, automated data synchronization

Managing Sync Jobs​

On-Demand Synchronization​

  1. Navigate to the sync jobs section
  2. Locate your external Amorphic datasource
  3. Click the Sync Now button to trigger immediate synchronization

External Amorphic Datasource Sync Jobs

Updating Configuration​

You can modify the following settings of your External Amorphic datasource:

  • Amorphic URL
  • Access Token
  • Asset Filters
  • Schedule Configuration

External Amorphic Datasource Updation

Viewing Ingested Data​

After successful synchronization:

  1. Navigate to Discover → Catalog
  2. All ingested assets will be visible in the catalog
  3. To filter for migrated resources:
    • Use the Datasource Name filter
    • Select "External Amorphic Datasource"

External Amorphic Datasource Catalog

Best Practices​

  • Regularly update your access tokens for security
  • Use asset filters to minimize unnecessary data transfer
  • Set up scheduled synchronization for regular data updates
  • Monitor sync jobs to ensure successful data ingestion
info

Note: Sometimes, due to how AWS works behind the scenes, the first attempt to create a external Amorphic datasource or start a sync job might fail—even if all the configurations are correct. If that happens, please wait a few minutes and try again.