2026-01-07T21:04:10+0000 [INFO] [cli] Starting production HTTP BentoServer from "service:Summarization" listening on http://127.0.0.1:3000 (Press CTRL+C to quit) 2026-01-07T21:04:12+0000 [INFO] [entry_service:Summarization:1] Service Summarization initialized 2026-01-07T21:04:12+0000 [INFO] [entry_service:Summarization:1] 127.0.0.1:30550 (scheme=http,method=GET,path=/,type=,length=) (status=200,type=text/html; charset=utf-8,length=2945) 11.944ms (trace=30773eb0b0252db85e288bb594576d9f,span=7f9270065690f364,sampled=0,service.name=None) nvm 2026-01-07T21:04:13+0000 [ERROR] [entry_service:Summarization:1] Exception on /summarize [POST] (trace=3587b18bb8b90150c586630ed4512523,span=6169d1361d89e644,sampled=0,service.name=None) Traceback (most recent call last): File "/usr/local/lib/python3.11/dist-packages/_bentoml_impl/server/app.py", line 599, in api_endpoint_wrapper resp = await self.api_endpoint(name, request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/_bentoml_impl/server/app.py", line 654, in api_endpoint input_data = await method.input_spec.from_http_request(request, serde) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/_bentoml_sdk/io_models.py", line 213, in from_http_request return await serde.parse_request(request, t.cast(t.Type[IODescriptor], cls)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/_bentoml_impl/serde.py", line 74, in parse_request return self.deserialize_model( ^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/_bentoml_impl/serde.py", line 240, in deserialize_model obj = cls.model_validate(obj) ^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/pydantic/main.py", line 716, in model_validate return cls.__pydantic_validator__.validate_python( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ pydantic_core._pydantic_core.ValidationError: 1 validation error for Input Input should be a valid dictionary or instance of Input [type=model_type, input_value=0, input_type=int] For further information visit https://errors.pydantic.dev/2.12/v/model_type 2026-01-07T21:04:13+0000 [INFO] [entry_service:Summarization:1] 127.0.0.1:22992 (scheme=http,method=POST,path=/summarize,type=application/vnd.bentoml+pickle,length=173) (status=400,type=application/json,length=200) 479.681ms (trace=3587b18bb8b90150c586630ed4512523,span=6169d1361d89e644,sampled=0,service.name=None) nvm 2026-01-07T21:04:15+0000 [ERROR] [entry_service:Summarization:1] Exception on /summarize [POST] (trace=4beb534593f652b9e67be641cdf6a1fb,span=06835e5cbe760838,sampled=0,service.name=None) Traceback (most recent call last): File "/usr/local/lib/python3.11/dist-packages/_bentoml_impl/server/app.py", line 599, in api_endpoint_wrapper resp = await self.api_endpoint(name, request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/_bentoml_impl/server/app.py", line 654, in api_endpoint input_data = await method.input_spec.from_http_request(request, serde) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/_bentoml_sdk/io_models.py", line 213, in from_http_request return await serde.parse_request(request, t.cast(t.Type[IODescriptor], cls)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/_bentoml_impl/serde.py", line 74, in parse_request return self.deserialize_model( ^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/_bentoml_impl/serde.py", line 240, in deserialize_model obj = cls.model_validate(obj) ^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/pydantic/main.py", line 716, in model_validate return cls.__pydantic_validator__.validate_python( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ pydantic_core._pydantic_core.ValidationError: 1 validation error for Input Input should be a valid dictionary or instance of Input [type=model_type, input_value=0, input_type=int] For further information visit https://errors.pydantic.dev/2.12/v/model_type 2026-01-07T21:04:15+0000 [INFO] [entry_service:Summarization:1] 127.0.0.1:52100 (scheme=http,method=POST,path=/summarize,type=application/vnd.bentoml+pickle,length=182) (status=400,type=application/json,length=200) 488.826ms (trace=4beb534593f652b9e67be641cdf6a1fb,span=06835e5cbe760838,sampled=0,service.name=None) 2026-01-07T21:04:16+0000 [ERROR] [entry_service:Summarization:1] Exception on /summarize [POST] (trace=3d6cf87272edaf22060085f2966d5288,span=81ed8b638595c476,sampled=0,service.name=None) Traceback (most recent call last): File "/usr/local/lib/python3.11/dist-packages/_bentoml_impl/server/app.py", line 599, in api_endpoint_wrapper resp = await self.api_endpoint(name, request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/_bentoml_impl/server/app.py", line 654, in api_endpoint input_data = await method.input_spec.from_http_request(request, serde) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/_bentoml_sdk/io_models.py", line 213, in from_http_request return await serde.parse_request(request, t.cast(t.Type[IODescriptor], cls)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/_bentoml_impl/serde.py", line 74, in parse_request return self.deserialize_model( ^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/_bentoml_impl/serde.py", line 240, in deserialize_model obj = cls.model_validate(obj) ^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/pydantic/main.py", line 716, in model_validate return cls.__pydantic_validator__.validate_python( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ pydantic_core._pydantic_core.ValidationError: 1 validation error for Input Input should be a valid dictionary or instance of Input [type=model_type, input_value=, input_type=_wrap_close] For further information visit https://errors.pydantic.dev/2.12/v/model_type 2026-01-07T21:04:16+0000 [INFO] [entry_service:Summarization:1] 127.0.0.1:44432 (scheme=http,method=POST,path=/summarize,type=application/vnd.bentoml+pickle,length=169) (status=400,type=application/json,length=200) 3.846ms (trace=3d6cf87272edaf22060085f2966d5288,span=81ed8b638595c476,sampled=0,service.name=None) 2026-01-07T21:04:17+0000 [INFO] [entry_service:Summarization:1] Service instance cleanup finalized