Search results

[Bug] DeepSeek V4 8-card serving 性能验证与瓶颈分析

Status: Open.

#95 In hw-native-sys/pypto-serving;

· high-cloud opened on Jul 16, 2026

Offline generate_batch lacks token-level chunked prefill → task-ring heap deadlock (507018) on long prompts

Status: Open.

#91 In hw-native-sys/pypto-serving;

· ChaoWao opened on Jul 15, 2026

[Feature] Extend Qwen3 device sampling to support top-k

Status: Open.

#74 In hw-native-sys/pypto-serving;

· zmnobug opened on Jul 13, 2026

[Feature] Lib-Serving Decoupling Architecture Design

Status: Open.

#65 In hw-native-sys/pypto-serving;

· bumble0918 opened on Jul 10, 2026

[Feature] Add DeepSeekV4 Flash serving support

enhancementNew feature or requestNew feature or request

Status: Open.

#62 In hw-native-sys/pypto-serving;

· ndleslx opened on Jul 9, 2026

[Bug] test_prefix_cache_reuses_prefix_and_preserves_output fails

bugSomething isn't workingSomething isn't working

Status: Open.

Bug

#54 In hw-native-sys/pypto-serving;

· lterrac opened on Jul 2, 2026

[Feature] Add native Qwen3-14B A8W8 serving path

Status: Open.

#52 In hw-native-sys/pypto-serving;

· vegetabledoww opened on Jul 1, 2026

[Feature] Let L3 own/pool the 4 per-step decode input tensors (skip per-token rtMalloc/rtFree)

Status: Open.

#44 In hw-native-sys/pypto-serving;

· ChaoWao opened on Jun 26, 2026

[Bug] Qwen3-14B 泛化验证报告

bugSomething isn't workingSomething isn't working

Status: Open.

#43 In hw-native-sys/pypto-serving;

· sunghajung6688 opened on Jun 25, 2026

[Bug] Hash prefix cache cold-hit-miss sequence can crash Qwen3-14B prefill with 507018

Status: Open.

#41 In hw-native-sys/pypto-serving;

· zmnobug opened on Jun 25, 2026

[Feature] Add radix prefix cache backend for paged KV reuse

Status: Open.

#38 In hw-native-sys/pypto-serving;

· zmnobug opened on Jun 18, 2026

[Feature] Parallel Strategies Support

enhancementNew feature or requestNew feature or request

Status: Open.

#36 In hw-native-sys/pypto-serving;

· ndleslx opened on Jun 16, 2026