ai.djl.python.engine Python engine environment.

ai.djl.python.engine

ai.djl.python.engine PyModel is the Python engine implementation of Model .

ai.djl.python.engine

ai.djl.python.engine

ai.djl.python.engine

ai.djl.serving.util A class that hold configuration information.

ai.djl.serving.plugins The PluginManager is responsible to load and manage plugins from the file system. Th...

ai.djl.serving.util A class that holds all opened ChannelGroup and EventLoopGroup .

ai.djl.serving The main entry point for model server.

ai.djl.serving A special io.netty.channel.ChannelInboundHandler which offers an easy way to initial...

ai.djl.serving.cache A cache that can be used for streaming online caching, streaming pagination, or asyn...

ai.djl.serving.cache A class that manages response cache.

ai.djl.serving.http HttpRequestHandler that tries to process a http- request using the configured Request...

ai.djl.serving.http a parser for inbound request.

ai.djl.serving.http A class handling inbound HTTP requests for the management API.

ai.djl.serving.kserve This class represents the KServe inputs and output structure for KServe infer and mo...

ai.djl.serving.kserve This class represents the response for KServe model metadata request.

ai.djl.serving.workflow A flow of executing ai.djl.Model s and custom functions.

ai.djl.serving.models A class that represents a webservice endpoint.

ai.djl.serving.models A class that in charge of managing models.

ai.djl.serving.wlm WorkLoadManager is responsible to manage the work load of worker thread. the manage ...

ai.djl.serving.plugins DependencyManager is responsible to manage extra maven dependencies.

ai.djl.serving.plugins A registry for plugin components.

ai.djl.serving.plugins Represents a loaded Plug-in. A plug-in contains MetaData, handler and resource mappi...

ai.djl.serving.plugins The Plugin Manager is responsible to load and manage plugins from the filesystem. Th...

ai.djl.serving.plugins A HTTP endpoint handler to return information about the loaded plugins. This class i...

ai.djl.serving.util A URLClassLoader that can add new class at runtime.

ai.djl.serving.wlm.util A Job containing metadata from the ai.djl.serving. wlm.WorkLoadManager .

ai.djl.serving.wlm abstract class for all BatchAggregators. A batch aggregator check working queue and ...

ai.djl.serving.wlm A function describing the action to take in a Job .

ai.djl.serving.wlm A WorkerPoolConfig represents a task that could be run in the WorkLoadManager . Each...

ai.djl.serving.wlm A class represents an inference job.

ai.djl.serving.wlm An adapter is a modification producing a variation of a model that can be used durin...

ai.djl.serving.wlm A class represent a loaded model and it's metadata.

ai.djl.serving.wlm Manages the work load for a single model.

ai.djl.serving.wlm The WorkerThread is the worker managed by the WorkLoadManager .

ai.djl.serving.wlm The WorkerGroup manages the WorkerPool for a particular Device .

ai.djl.serving.wlm WORKER_STARTED,WORKER_MODEL_LOADED,WORKER_STOPPED, WORKER_BUSY,WORKER_ERROR,WORKER_SCALED_DOWN An enum represents state of a worker.

ai.djl.serving.wlm.util This manages some configurations used by the ai. djl.serving.wlm.WorkLoadManager .

ai.djl.serving.workflow An expression defining a local value in a Workflow .

ai.djl.serving.workflow.function A lambda function that can be run within a Workflow .

ai.djl.serving.workflow This class is for parsing the JSON or YAML definition for a Workflow . It can then b...

ai.djl.serving.workflow.function Workflow function "adapter" applies an adapted model to an input. To use this workfl...

ai.djl.serving.workflow.function An internal WorkflowFunction that is used to execute a WorkerPoolConfig (typically a...