|
TensorRT
|
Allows a serialized engine to be deserialized. More...
#include <NvInfer.h>
Public Member Functions | |
| virtual nvinfer1::ICudaEngine * | deserializeCudaEngine (const void *blob, std::size_t size, IPluginFactory *pluginFactory)=0 |
| Deserialize an engine from a stream. More... | |
| virtual void | destroy ()=0 |
| Destroy this object. | |
| virtual void | setGpuAllocator (IGpuAllocator *allocator)=0 |
| Set the GPU allocator. More... | |
Allows a serialized engine to be deserialized.
|
pure virtual |
Deserialize an engine from a stream.
| blob | The memory that holds the serialized engine. |
| size | The size of the memory. |
| pluginFactory | The plugin factory, if any plugins are used by the network, otherwise nullptr. |
|
pure virtual |
Set the GPU allocator.
| allocator | Set the GPU allocator to be used by the runtime. All GPU memory acquired will use this allocator. If NULL is passed, the default allocator will be used. |
Default: uses cudaMalloc/cudaFree.
If nullptr is passed, the default allocator will be used.