esProc connects to databases via ODBC or JDBC. But it also provides Search External Library functionality in case a database to be connected doesn’t support JDBC and ODBC connectivity.
esProc, by default, supports a variety of external libraries. They are AlicloudCli, AvroCli, CassandraCli, CdcCli, DynamodbCli, ElasticsearchCli, FinancialCli, FtpCli, HbaseCli, HdfsFileCli, HiveCli, InfluxdbCli, InformixCli, KafkaCli, MathCli, MongoCli, Olap4jCli, OssCli, R2dbcCli, RedisCli, S3Cli, SalesforceCli, SapCli, SparkCli, WasCli, WebcrawlCli, WebserviceCli and ZipCli. There are two steps for using these external libraries.
1. Deploying external libraries. For this refer to Deployment;
2. Connecting to external libraries. For this refer to Connection.
Here are functionalities of those external libraries:
|
External library |
Functionality |
|
For accessing Alibaba Cloud platform to perform connection, data querying, and other operations. |
|
|
For handling Avro files, including retrieve and export. |
|
|
For accessing Cassandra database to perform connection, data querying, and other operations. |
|
|
For accessing data collected through a data synchronization tool. |
|
|
For providing Debezium, a data synchronization tool, for CdcCli. |
|
|
For accessing DynamoDB database to perform table creation, data querying, and other operations. |
|
|
For accessing Elasticsearch service to execute get/put commands, and other operations. |
|
|
For performing financial analytics, such as net present value and future value of an investment. |
|
|
For accessing the FTP service to perform file upload/download, and other operations. |
|
|
For accessing Google Cloud Storage to perform data copy, storage bucket management, and other operations. |
|
|
For accessing HBase database to perform data querying, filtering, and other operations. |
|
|
For accessing HDFS file system to perform file upload/download, and other operations. |
|
|
For accessing Hive database to perform connection, retrieving data of ORC/Parquet format, and other operations. |
|
|
For accessing InfluxDB database, including connection, data querying, and other operations. |
|
|
For accessing Informix database to perform data extraction, sharding definition settings, and other operations. |
|
|
For accessing Kafka service to retrieve messages, set consumer group offset, and other operations. |
|
|
For performing mathematical analytics, such as computing covariance and standard variance. |
|
|
For accessing Mongo database to perform connection, data querying, and other operations. |
|
|
For providing Ogg, a data synchronization tool, for CdcCli. |
|
|
For accessing a multidimensional database to perform connection, data querying, and other operations. |
|
|
For accessing Operations Support Systems, a cloud storage service, to perform data copying, storage bucket management, and other operations. |
|
|
For creating a R2DBC connection to perform database connection, data querying, and other operations. |
|
|
For accessing Redis database to perform connection, execute commands, and so on. |
|
|
For accessing AWS S3 service to perform data copying, storage bucket management, and other operations. |
|
|
For accessing Salesforce cloud to perform service connection through SOAP API or REST API, data querying, and other operations. |
|
|
For accessing SAP service to perform connection, data querying, and other operations. |
|
|
For accessing Spark database to perform connection, data querying, and other operations. |
|
|
For accessing Windows Azure Storage service, to perform data copying, storage bucket management, and other operations. |
|
|
For providing a web crawling tool. |
|
|
For accessing web service to create connection, get data, and so on. |
|
|
For providing a compression tool to perform compression, decompression, and other operations. |