Parameters to set in the postgresql.conf file are shown.
Parameters related to memory
pgx_inference.total_model_size_limit (integer)
Set the upper limit for the total size of model files that can be loaded. The default value is -1 (unlimited). If the unit is not specified, it is considered as MB.
Parameters related to the inference server
pgx_inference.triton_model_repository_path (string)
Set the path of the model repository specified during the setup of the inference server used in conjunction with Fujitsu Enterprise Postgres. This cannot be omitted. If omitted, the database instance will fail to start. This directory must have permissions set so that the OS user starting Fujitsu Enterprise Postgres can read and write. If the privileges are inappropriate, a warning appears in the server log.
pgx_inference.triton_ort_extensions_library_filename (string)
This corresponds to the model_operations.op_library_filename of the Triton Inference Server. Specify the absolute path of the shared library (onnxruntime-extensions) on the server where the Triton Inference Server is running. To reflect changes in the value, restart the database instance. It cannot be omitted. If omitted, the database instance will fail to start.
pgx_inference.triton_grpc_port (integer)
This is the port number used when sending requests to the inference server. set the port number specified during the setup of the inference server. The default value is 8001.
pgx_inference.triton_use_ssl (boolean)
Specify whether to enable SSL communication with the Triton Inference Server. The default value is false.
pgx_inference.triton_grpc_root_certificates (string)
Specify the path to the CA file for verifying the server certificate chain used for gRPC connection. If the pgx_inference.trtion_use_ssl parameter is true, it cannot be omitted. If omitted, the instance will fail to start.
pgx_inference.triton_grpc_certificate_chain (string)
Specify the path of the client certificate chain used for gRPC connection. If the pgx_inference.trtion_use_ssl parameter is true, it cannot be omitted. If omitted, the instance will fail to start.
pgx_inference.triton_grpc_private_key (string)
Specify the path to the client private key used for gRPC connection. If the pgx_inference.trtion_use_ssl parameter is true, it cannot be omitted. If omitted, the instance will fail to start.
