How to increase MiniBatchSize

Name: 'NVIDIA GeForce RTX 2060'

Index: 1

ComputeCapability: '7.5'

SupportsDouble: 1

DriverVersion: 11.7000

ToolkitVersion: 11.2000

MaxThreadsPerBlock: 1024

MaxShmemPerBlock: 49152

MaxThreadBlockSize: [1024 1024 64]

MaxGridSize: [2.1475e+09 65535 65535]

SIMDWidth: 32

TotalMemory: 6.4421e+09

AvailableMemory: 5.0929e+09

MultiprocessorCount: 30

ClockRateKHz: 1200000

ComputeMode: 'Default'

GPUOverlapsTransfers: 1

KernelExecutionTimeout: 1

CanMapHostMemory: 1

DeviceSupported: 1

DeviceAvailable: 1

DeviceSelected: 1

** This is my GPU , so how can i increase MiniBatchSize more than 2 , with out error

Answer 1

[Joss Knight]

It depends on what you're doing. Some ideas:

• Get a new GPU with more memory
• Use a smaller model
• If your model accepts a variable input size, use a smaller input
• For object detectors, reduce the number of patches per image
• Run on the CPU