Datasources

Amorphic Datasources are external systems or repositories from which data is ingested into platform datasets. They enable users to connect to and pull data from a wide variety of sources, such as streams, SaaS applications, external APIs, and S3 buckets, into Amorphic for processing and analysis.

Below is the sample resource definition file for Datasources:

{
    "rDatasource": {
        "Type": "Datasource",
        "Properties": {
            "DatasourceConfig":{
                "JdbcURL":"jdbc:postgresql://hostname.com:5432/database",
                "Username":{
                    "!Environ": "DB_USERNAME"
                },
                "Password":{
                    "!Environ": "DB_PASSWORD"
                },
                "PublicAccessibility":"yes"
            },
            "DatasourceType":"jdbc",
            "DatasourceName":"pqsqldata",
            "Description":"Postgress as datasource",
            "Keywords":["DB : PostgreSQL","Owner: asysuser"],
            "IngestionType":"normaldataload",
            "DatasourceVersion":"5.0"
        }
    }
}

In the above JSON configuration, rDatasource is a logical resource that must be unique across the repository. It serves as a unique identifier for a resource among all the resources created.

The Properties section accepts a dictionary, which takes the Datasource configuration as input. The specific configuration used will depend on the DatasourceType and IngestionType specified.