2026-01-07T21:04:27+0000 [INFO] [cli] Starting production HTTP BentoServer from "service:Summarization" listening on http://127.0.0.1:3001 (Press CTRL+C to quit) 2026-01-07T21:04:29+0000 [INFO] [entry_service:Summarization:1] Service Summarization initialized 2026-01-07T21:04:29+0000 [INFO] [entry_service:Summarization:1] 127.0.0.1:58097 (scheme=http,method=GET,path=/,type=,length=) (status=200,type=text/html; charset=utf-8,length=2945) 15.285ms (trace=225bd93d0b8b9703e230ab997ce94b14,span=ae9c21fe391b373b,sampled=0,service.name=None) 2026-01-07T21:04:29+0000 [ERROR] [entry_service:Summarization:1] Exception on /summarize [POST] (trace=1eb9f27c14a148916942c9b221129163,span=3b6d31a7042780ec,sampled=0,service.name=None) Traceback (most recent call last): File "/usr/local/lib/python3.11/dist-packages/_bentoml_impl/server/app.py", line 713, in api_endpoint_wrapper resp = await self.api_endpoint(name, request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/_bentoml_impl/server/app.py", line 770, in api_endpoint raise BentoMLException( bentoml.exceptions.BentoMLException: application/vnd.bentoml+pickle is not allowed in main server 2026-01-07T21:04:29+0000 [INFO] [entry_service:Summarization:1] 127.0.0.1:23964 (scheme=http,method=POST,path=/summarize,type=application/vnd.bentoml+pickle,length=175) (status=415,type=application/json,length=74) 2.221ms (trace=1eb9f27c14a148916942c9b221129163,span=3b6d31a7042780ec,sampled=0,service.name=None) 2026-01-07T21:04:29+0000 [ERROR] [entry_service:Summarization:1] Exception on /summarize [POST] (trace=799a2f5eb5d2e81c4bf958491a5ceb38,span=01e0d65717aa3e8d,sampled=0,service.name=None) Traceback (most recent call last): File "/usr/local/lib/python3.11/dist-packages/_bentoml_impl/server/app.py", line 713, in api_endpoint_wrapper resp = await self.api_endpoint(name, request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/_bentoml_impl/server/app.py", line 779, in api_endpoint input_data = await method.input_spec.from_http_request(request, serde) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/_bentoml_sdk/io_models.py", line 213, in from_http_request return await serde.parse_request(request, t.cast(t.Type[IODescriptor], cls)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/_bentoml_impl/serde.py", line 184, in parse_request return self.deserialize_model(Payload((body,), metadata=request.headers), cls) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/_bentoml_impl/serde.py", line 187, in deserialize_model return cls.model_validate_json(b"".join(payload.data) or b"{}") ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/pydantic/main.py", line 766, in model_validate_json return cls.__pydantic_validator__.validate_json( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ pydantic_core._pydantic_core.ValidationError: 1 validation error for Input Invalid JSON: expected value at line 1 column 1 [type=json_invalid, input_value=b"\x80\x04\x95\xa4\x00\x0....txt'\x94\x85\x94R\x94.", input_type=bytes] For further information visit https://errors.pydantic.dev/2.12/v/json_invalid 2026-01-07T21:04:29+0000 [INFO] [entry_service:Summarization:1] 127.0.0.1:45502 (scheme=http,method=POST,path=/summarize,type=Application/Vnd.BentoML+Pickle,length=175) (status=400,type=application/json,length=196) 3.800ms (trace=799a2f5eb5d2e81c4bf958491a5ceb38,span=01e0d65717aa3e8d,sampled=0,service.name=None) 2026-01-07T21:04:29+0000 [ERROR] [entry_service:Summarization:1] Exception on /summarize [POST] (trace=b3af36a41e50ed56ba89f9a8669635fc,span=ce3ae247a9075982,sampled=0,service.name=None) Traceback (most recent call last): File "/usr/local/lib/python3.11/dist-packages/_bentoml_impl/server/app.py", line 713, in api_endpoint_wrapper resp = await self.api_endpoint(name, request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/_bentoml_impl/server/app.py", line 770, in api_endpoint raise BentoMLException( bentoml.exceptions.BentoMLException: application/vnd.bentoml+pickle is not allowed in main server 2026-01-07T21:04:29+0000 [INFO] [entry_service:Summarization:1] 127.0.0.1:52599 (scheme=http,method=POST,path=/summarize,type=application/vnd.bentoml+pickle; charset=UTF-8,length=175) (status=415,type=application/json,length=74) 1.199ms (trace=b3af36a41e50ed56ba89f9a8669635fc,span=ce3ae247a9075982,sampled=0,service.name=None) 2026-01-07T21:04:29+0000 [ERROR] [entry_service:Summarization:1] Exception on /summarize [POST] (trace=9c0a3646a39ea2db2c239414ba862331,span=cf5fa3620bb72db5,sampled=0,service.name=None) Traceback (most recent call last): File "/usr/local/lib/python3.11/dist-packages/_bentoml_impl/server/app.py", line 713, in api_endpoint_wrapper resp = await self.api_endpoint(name, request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/_bentoml_impl/server/app.py", line 770, in api_endpoint raise BentoMLException( bentoml.exceptions.BentoMLException: application/vnd.bentoml+pickle is not allowed in main server 2026-01-07T21:04:29+0000 [INFO] [entry_service:Summarization:1] 127.0.0.1:53322 (scheme=http,method=POST,path=/summarize,type=application/vnd.bentoml+pickle; q=1,length=175) (status=415,type=application/json,length=74) 1.506ms (trace=9c0a3646a39ea2db2c239414ba862331,span=cf5fa3620bb72db5,sampled=0,service.name=None) 2026-01-07T21:04:29+0000 [ERROR] [entry_service:Summarization:1] Exception on /summarize [POST] (trace=b12334edf696ff33e6ad9bad1815b40d,span=aa61d62714dddc72,sampled=0,service.name=None) Traceback (most recent call last): File "/usr/local/lib/python3.11/dist-packages/_bentoml_impl/server/app.py", line 713, in api_endpoint_wrapper resp = await self.api_endpoint(name, request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/_bentoml_impl/server/app.py", line 779, in api_endpoint input_data = await method.input_spec.from_http_request(request, serde) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/_bentoml_sdk/io_models.py", line 213, in from_http_request return await serde.parse_request(request, t.cast(t.Type[IODescriptor], cls)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/_bentoml_impl/serde.py", line 184, in parse_request return self.deserialize_model(Payload((body,), metadata=request.headers), cls) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/_bentoml_impl/serde.py", line 187, in deserialize_model return cls.model_validate_json(b"".join(payload.data) or b"{}") ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/pydantic/main.py", line 766, in model_validate_json return cls.__pydantic_validator__.validate_json( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ pydantic_core._pydantic_core.ValidationError: 1 validation error for Input Invalid JSON: expected value at line 1 column 1 [type=json_invalid, input_value=b"\x80\x04\x95\xa4\x00\x0....txt'\x94\x85\x94R\x94.", input_type=bytes] For further information visit https://errors.pydantic.dev/2.12/v/json_invalid 2026-01-07T21:04:29+0000 [INFO] [entry_service:Summarization:1] 127.0.0.1:39364 (scheme=http,method=POST,path=/summarize,type=application/vnd.bentoml+PICKLE,length=175) (status=400,type=application/json,length=196) 2.918ms (trace=b12334edf696ff33e6ad9bad1815b40d,span=aa61d62714dddc72,sampled=0,service.name=None) 2026-01-07T21:04:29+0000 [ERROR] [entry_service:Summarization:1] Exception on /summarize [POST] (trace=081500d365dc2e903fc6c6fb1ba82464,span=9ff980b1f39a3f9b,sampled=0,service.name=None) Traceback (most recent call last): File "/usr/local/lib/python3.11/dist-packages/_bentoml_impl/server/app.py", line 713, in api_endpoint_wrapper resp = await self.api_endpoint(name, request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/_bentoml_impl/server/app.py", line 770, in api_endpoint raise BentoMLException( bentoml.exceptions.BentoMLException: application/vnd.bentoml+pickle is not allowed in main server 2026-01-07T21:04:29+0000 [INFO] [entry_service:Summarization:1] 127.0.0.1:28214 (scheme=http,method=POST,path=/summarize,type=application/vnd.bentoml+pickle,length=175) (status=415,type=application/json,length=74) 1.304ms (trace=081500d365dc2e903fc6c6fb1ba82464,span=9ff980b1f39a3f9b,sampled=0,service.name=None) 2026-01-07T21:04:29+0000 [ERROR] [entry_service:Summarization:1] Exception on /summarize [POST] (trace=3ccf260bcb2bf3bebd6fe8edea049e89,span=18bee3a22cccb71e,sampled=0,service.name=None) Traceback (most recent call last): File "/usr/local/lib/python3.11/dist-packages/_bentoml_impl/server/app.py", line 713, in api_endpoint_wrapper resp = await self.api_endpoint(name, request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/_bentoml_impl/server/app.py", line 770, in api_endpoint raise BentoMLException( bentoml.exceptions.BentoMLException: application/vnd.bentoml+pickle is not allowed in main server 2026-01-07T21:04:29+0000 [INFO] [entry_service:Summarization:1] 127.0.0.1:59257 (scheme=http,method=POST,path=/summarize,type=application/vnd.bentoml+pickle;param=x,length=175) (status=415,type=application/json,length=74) 1.065ms (trace=3ccf260bcb2bf3bebd6fe8edea049e89,span=18bee3a22cccb71e,sampled=0,service.name=None) 2026-01-07T21:04:29+0000 [ERROR] [entry_service:Summarization:1] Exception on /summarize [POST] (trace=147ffd0bd80b4e0d881d20481d4118a9,span=6374af43cb0f9b34,sampled=0,service.name=None) Traceback (most recent call last): File "/usr/local/lib/python3.11/dist-packages/_bentoml_impl/server/app.py", line 713, in api_endpoint_wrapper resp = await self.api_endpoint(name, request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/_bentoml_impl/server/app.py", line 779, in api_endpoint input_data = await method.input_spec.from_http_request(request, serde) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/_bentoml_sdk/io_models.py", line 213, in from_http_request return await serde.parse_request(request, t.cast(t.Type[IODescriptor], cls)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/_bentoml_impl/serde.py", line 184, in parse_request return self.deserialize_model(Payload((body,), metadata=request.headers), cls) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/_bentoml_impl/serde.py", line 187, in deserialize_model return cls.model_validate_json(b"".join(payload.data) or b"{}") ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/pydantic/main.py", line 766, in model_validate_json return cls.__pydantic_validator__.validate_json( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ pydantic_core._pydantic_core.ValidationError: 1 validation error for Input Invalid JSON: expected value at line 1 column 1 [type=json_invalid, input_value=b"\x80\x04\x95\xa4\x00\x0....txt'\x94\x85\x94R\x94.", input_type=bytes] For further information visit https://errors.pydantic.dev/2.12/v/json_invalid 2026-01-07T21:04:29+0000 [INFO] [entry_service:Summarization:1] 127.0.0.1:26335 (scheme=http,method=POST,path=/summarize,type=application/octet-stream,length=175) (status=400,type=application/json,length=196) 2.018ms (trace=147ffd0bd80b4e0d881d20481d4118a9,span=6374af43cb0f9b34,sampled=0,service.name=None) 2026-01-07T21:04:29+0000 [ERROR] [entry_service:Summarization:1] Exception on /summarize [POST] (trace=087349451cbbf2ae573e4207fed41362,span=6dd38e5c44bec37c,sampled=0,service.name=None) Traceback (most recent call last): File "/usr/local/lib/python3.11/dist-packages/_bentoml_impl/server/app.py", line 713, in api_endpoint_wrapper resp = await self.api_endpoint(name, request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/_bentoml_impl/server/app.py", line 779, in api_endpoint input_data = await method.input_spec.from_http_request(request, serde) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/_bentoml_sdk/io_models.py", line 213, in from_http_request return await serde.parse_request(request, t.cast(t.Type[IODescriptor], cls)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/_bentoml_impl/serde.py", line 184, in parse_request return self.deserialize_model(Payload((body,), metadata=request.headers), cls) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/_bentoml_impl/serde.py", line 187, in deserialize_model return cls.model_validate_json(b"".join(payload.data) or b"{}") ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/pydantic/main.py", line 766, in model_validate_json return cls.__pydantic_validator__.validate_json( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ pydantic_core._pydantic_core.ValidationError: 1 validation error for Input Invalid JSON: expected value at line 1 column 1 [type=json_invalid, input_value=b"\x80\x04\x95\xa4\x00\x0....txt'\x94\x85\x94R\x94.", input_type=bytes] For further information visit https://errors.pydantic.dev/2.12/v/json_invalid 2026-01-07T21:04:29+0000 [INFO] [entry_service:Summarization:1] 127.0.0.1:49186 (scheme=http,method=POST,path=/summarize,type=text/plain,length=175) (status=400,type=application/json,length=196) 2.302ms (trace=087349451cbbf2ae573e4207fed41362,span=6dd38e5c44bec37c,sampled=0,service.name=None) 2026-01-07T21:04:29+0000 [ERROR] [entry_service:Summarization:1] Exception on /summarize [POST] (trace=b755a3386f76ca6c5b2e40263831f6e0,span=3cc7a5ad1ee12139,sampled=0,service.name=None) Traceback (most recent call last): File "/usr/local/lib/python3.11/dist-packages/_bentoml_impl/server/app.py", line 713, in api_endpoint_wrapper resp = await self.api_endpoint(name, request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/_bentoml_impl/server/app.py", line 779, in api_endpoint input_data = await method.input_spec.from_http_request(request, serde) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/_bentoml_sdk/io_models.py", line 213, in from_http_request return await serde.parse_request(request, t.cast(t.Type[IODescriptor], cls)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/_bentoml_impl/serde.py", line 184, in parse_request return self.deserialize_model(Payload((body,), metadata=request.headers), cls) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/_bentoml_impl/serde.py", line 187, in deserialize_model return cls.model_validate_json(b"".join(payload.data) or b"{}") ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/pydantic/main.py", line 766, in model_validate_json return cls.__pydantic_validator__.validate_json( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ pydantic_core._pydantic_core.ValidationError: 1 validation error for Input Invalid JSON: expected value at line 1 column 1 [type=json_invalid, input_value=b"\x80\x04\x95\xa5\x00\x0....txt'\x94\x85\x94R\x94.", input_type=bytes] For further information visit https://errors.pydantic.dev/2.12/v/json_invalid 2026-01-07T21:04:29+0000 [INFO] [entry_service:Summarization:1] 127.0.0.1:24062 (scheme=http,method=POST,path=/summarize,type=application/vnd.bentoml+pickle, application/json,length=176) (status=400,type=application/json,length=196) 1.823ms (trace=b755a3386f76ca6c5b2e40263831f6e0,span=3cc7a5ad1ee12139,sampled=0,service.name=None) 2026-01-07T21:04:30+0000 [INFO] [entry_service:Summarization:1] Service instance cleanup finalized