support vLLM inference #7
Description
Nice work! Is it possible to run with vLLM?
Another question, for the REC task, if there are multiple objects for the same referring, it will output multiple objects or just one?
{{ message }}
Nice work! Is it possible to run with vLLM?
Another question, for the REC task, if there are multiple objects for the same referring, it will output multiple objects or just one?