dealignai/Qwen3.8-Flash-Next-UNCENSORED-FP8
hf dealignai/Qwen3.8-Flash-Next-UNCENSORED-FP8 2 sources, 4 claims · Watch
What each source says
| Property | Source | Said | Means here | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Author author not compared | GGUF quantisations | BattleGhostreceipt
What the source handed over{
"_id": "6a93ec390927cf9636c9f574",
"author": "BattleGhost",
"cardData": {
"base_model": "dealignai/Qwen3.8-Flash-Next-UNCENSORED-FP8",
"library_name": "llama.cpp",
"license": "other",
"license_link": "https://huggingface.co/dealignai/Qwen3.8-Flash-Next-UNCENSORED-FP8/blob/main/LICENSE",
"license_name": "qwen-community-license-1.0",
"pipeline_tag": "text-generation",
"tags": [
"gguf",
"qwen",
"qwen4_exp",
"iq2_xxs",
"uncensored",
"abliterated"
]
},
"createdAt": "2026-08-30T08:39:21.000Z",
"downloads": 32460,
"gated": false,
"id": "BattleGhost/Qwen3.8-Flash-Next-UNCENSORED-IQ2_XXS-GGUF",
"lastModified": "2026-08-30T08:52:54.000Z",
"library_name": "llama.cpp",
"likes": 2,
"modelId": "BattleGhost/Qwen3.8-Flash-Next-UNCENSORED-IQ2_XXS-GGUF",
"pipeline_tag": "text-generation",
"private": false,
"sha": "40517194425692dd2eee02ab166fdec57ec759bf",
"siblings": [
{
"rfilename": ".gitattributes"
},
{
"rfilename": "Qwen3.8-Flash-Next-UNCENSORED-IQ2_XXS.gguf"
},
{
"rfilename": "README.md"
}
],
"tags": [
"llama.cpp",
"gguf",
"qwen",
"qwen4_exp",
"iq2_xxs",
"uncensored",
"abliterated",
"text-generation",
"base_model:dealignai/Qwen3.8-Flash-Next-UNCENSORED-FP8",
"base_model:quantized:dealignai/Qwen3.8-Flash-Next-UNCENSORED-FP8",
"license:other",
"endpoints_compatible",
"region:us",
"imatrix",
"conversational"
]
} | — | ||||||||
| Author author not compared | Hugging Face models | dealignaireceipt
This source has not kept a receipt for this claim yet. The next update that reads it will. | — | ||||||||
| Base base | GGUF quantisations | dealignai/Qwen3.8-Flash-Next-UNCENSORED-FP8receipt
What the source handed over{
"_id": "6a93ec390927cf9636c9f574",
"author": "BattleGhost",
"cardData": {
"base_model": "dealignai/Qwen3.8-Flash-Next-UNCENSORED-FP8",
"library_name": "llama.cpp",
"license": "other",
"license_link": "https://huggingface.co/dealignai/Qwen3.8-Flash-Next-UNCENSORED-FP8/blob/main/LICENSE",
"license_name": "qwen-community-license-1.0",
"pipeline_tag": "text-generation",
"tags": [
"gguf",
"qwen",
"qwen4_exp",
"iq2_xxs",
"uncensored",
"abliterated"
]
},
"createdAt": "2026-08-30T08:39:21.000Z",
"downloads": 32460,
"gated": false,
"id": "BattleGhost/Qwen3.8-Flash-Next-UNCENSORED-IQ2_XXS-GGUF",
"lastModified": "2026-08-30T08:52:54.000Z",
"library_name": "llama.cpp",
"likes": 2,
"modelId": "BattleGhost/Qwen3.8-Flash-Next-UNCENSORED-IQ2_XXS-GGUF",
"pipeline_tag": "text-generation",
"private": false,
"sha": "40517194425692dd2eee02ab166fdec57ec759bf",
"siblings": [
{
"rfilename": ".gitattributes"
},
{
"rfilename": "Qwen3.8-Flash-Next-UNCENSORED-IQ2_XXS.gguf"
},
{
"rfilename": "README.md"
}
],
"tags": [
"llama.cpp",
"gguf",
"qwen",
"qwen4_exp",
"iq2_xxs",
"uncensored",
"abliterated",
"text-generation",
"base_model:dealignai/Qwen3.8-Flash-Next-UNCENSORED-FP8",
"base_model:quantized:dealignai/Qwen3.8-Flash-Next-UNCENSORED-FP8",
"license:other",
"endpoints_compatible",
"region:us",
"imatrix",
"conversational"
]
} | — | ||||||||
| Downloads downloads not compared | GGUF quantisations | 1111receipt
What the source handed over{
"_id": "6a93cecb729422ce6c88b315",
"author": "BattleGhost",
"cardData": {
"base_model": "dealignai/Qwen3.8-Flash-Next-UNCENSORED-FP8",
"library_name": "llama.cpp",
"license": "other",
"license_link": "https://huggingface.co/dealignai/Qwen3.8-Flash-Next-UNCENSORED-FP8/blob/main/LICENSE",
"license_name": "qwen-community-license-1.0",
"pipeline_tag": "text-generation",
"tags": [
"gguf",
"qwen",
"qwen4_exp",
"bf16",
"uncensored",
"abliterated"
]
},
"createdAt": "2026-08-30T06:33:47.000Z",
"downloads": 1111,
"gated": false,
"id": "BattleGhost/Qwen3.8-Flash-Next-UNCENSORED-BF16-GGUF",
"lastModified": "2026-08-30T07:10:57.000Z",
"library_name": "llama.cpp",
"likes": 0,
"modelId": "BattleGhost/Qwen3.8-Flash-Next-UNCENSORED-BF16-GGUF",
"pipeline_tag": "text-generation",
"private": false,
"sha": "972429acc83771b7e44837c7d04e50f7694817c7",
"siblings": [
{
"rfilename": ".gitattributes"
},
{
"rfilename": "Qwen3.8-Flash-Next-UNCENSORED-BF16-00001-of-00008.gguf"
},
{
"rfilename": "Qwen3.8-Flash-Next-UNCENSORED-BF16-00002-of-00008.gguf"
},
{
"rfilename": "Qwen3.8-Flash-Next-UNCENSORED-BF16-00003-of-00008.gguf"
},
{
"rfilename": "Qwen3.8-Flash-Next-UNCENSORED-BF16-00004-of-00008.gguf"
},
{
"rfilename": "Qwen3.8-Flash-Next-UNCENSORED-BF16-00005-of-00008.gguf"
},
{
"rfilename": "Qwen3.8-Flash-Next-UNCENSORED-BF16-00006-of-00008.gguf"
},
{
"rfilename": "Qwen3.8-Flash-Next-UNCENSORED-BF16-00007-of-00008.gguf"
},
{
"rfilename": "Qwen3.8-Flash-Next-UNCENSORED-BF16-00008-of-00008.gguf"
},
{
"rfilename": "README.md"
}
],
"tags": [
"llama.cpp",
"gguf",
"qwen",
"qwen4_exp",
"bf16",
"uncensored",
"abliterated",
"text-generation",
"base_model:dealignai/Qwen3.8-Flash-Next-UNCENSORED-FP8",
"base_model:quantized:dealignai/Qwen3.8-Flash-Next-UNCENSORED-FP8",
"license:other",
"endpoints_compatible",
"region:us",
"conversational"
]
} | — | ||||||||
| Downloads downloads not compared | 32460receipt
What the source handed over{
"_id": "6a93ec390927cf9636c9f574",
"author": "BattleGhost",
"cardData": {
"base_model": "dealignai/Qwen3.8-Flash-Next-UNCENSORED-FP8",
"library_name": "llama.cpp",
"license": "other",
"license_link": "https://huggingface.co/dealignai/Qwen3.8-Flash-Next-UNCENSORED-FP8/blob/main/LICENSE",
"license_name": "qwen-community-license-1.0",
"pipeline_tag": "text-generation",
"tags": [
"gguf",
"qwen",
"qwen4_exp",
"iq2_xxs",
"uncensored",
"abliterated"
]
},
"createdAt": "2026-08-30T08:39:21.000Z",
"downloads": 32460,
"gated": false,
"id": "BattleGhost/Qwen3.8-Flash-Next-UNCENSORED-IQ2_XXS-GGUF",
"lastModified": "2026-08-30T08:52:54.000Z",
"library_name": "llama.cpp",
"likes": 2,
"modelId": "BattleGhost/Qwen3.8-Flash-Next-UNCENSORED-IQ2_XXS-GGUF",
"pipeline_tag": "text-generation",
"private": false,
"sha": "40517194425692dd2eee02ab166fdec57ec759bf",
"siblings": [
{
"rfilename": ".gitattributes"
},
{
"rfilename": "Qwen3.8-Flash-Next-UNCENSORED-IQ2_XXS.gguf"
},
{
"rfilename": "README.md"
}
],
"tags": [
"llama.cpp",
"gguf",
"qwen",
"qwen4_exp",
"iq2_xxs",
"uncensored",
"abliterated",
"text-generation",
"base_model:dealignai/Qwen3.8-Flash-Next-UNCENSORED-FP8",
"base_model:quantized:dealignai/Qwen3.8-Flash-Next-UNCENSORED-FP8",
"license:other",
"endpoints_compatible",
"region:us",
"imatrix",
"conversational"
]
} | — | |||||||||
| Downloads downloads not compared | Hugging Face models | 1166receipt
What the source handed over{
"_asked": "dealignai/Qwen3.8-Flash-Next-UNCENSORED-FP8",
"_id": "6a8fb29c94a3c738db5e513e",
"author": "dealignai",
"cardData": {
"base_model": "Qwen/Qwen3.8-Flash-Next-FP8",
"license": "apache-2.0",
"pipeline_tag": "text-generation",
"tags": [
"qwen",
"qwen3.8",
"flash-next",
"fp8",
"uncensored",
"moe",
"text-generation",
"vision",
"vision-language",
"multi-token-prediction"
]
},
"config": {
"architectures": [
"Qwen4ExpForConditionalGeneration"
],
"chat_template_jinja": "{%- set image_count = namespace(value=0) %}\n{%- set video_count = namespace(value=0) %}\n{%- macro render_content(content, do_vision_count, is_system_content=false) %}\n {%- if content is string %}\n {{- content }}\n {%- elif content is iterable and content is not mapping %}\n {%- for item in content %}\n {%- if 'image' in item or 'image_url' in item or item.type == 'image' %}\n {%- if is_system_content %}\n {{- raise_exception('System message cannot contain images.') }}\n {%- endif %}\n {%- if do_vision_count %}\n {%- set image_count.value = image_count.value + 1 %}\n {%- endif %}\n {%- if add_vision_id %}\n {{- 'Picture ' ~ image_count.value ~ ': ' }}\n {%- endif %}\n {{- '<|vision_start|><|image_pad|><|vision_end|>' }}\n {%- elif 'video' in item or item.type == 'video' %}\n {%- if is_system_content %}\n {{- raise_exception('System message cannot contain videos.') }}\n {%- endif %}\n {%- if do_vision_count %}\n {%- set video_count.value = video_count.value + 1 %}\n {%- endif %}\n {%- if add_vision_id %}\n {{- 'Video ' ~ video_count.value ~ ': ' }}\n {%- endif %}\n {{- '<|vision_start|><|video_pad|><|vision_end|>' }}\n {%- elif 'text' in item %}\n {{- item.text }}\n {%- else %}\n {{- raise_exception('Unexpected item type in content.') }}\n {%- endif %}\n {%- endfor %}\n {%- elif content is none or content is undefined %}\n {{- '' }}\n {%- else %}\n {{- raise_exception('Unexpected content type.') }}\n {%- endif %}\n{%- endmacro %}\n{%- if not messages %}\n {{- raise_exception('No messages provided.') }}\n{%- endif %}\n{%- set reasoning_instructions = '' %}\n{%- if enable_thinking is undefined or enable_thinking is true %}\n {%- set resolved_reasoning_effort = reasoning_effort|default('xhigh') %}\n {%- if resolved_reasoning_effort not in ('xhigh', 'medium', 'low') %}\n {{- raise_exception('Unexpected reasoning effort ' ~ reasoning_effort ~ '. Supported types are xhigh (default), medium, and low.') }}\n {%- endif %}\n {%- if resolved_reasoning_effort == 'xhigh' %}\n {%- set reasoning_instructions = 'Reasoning effort is set to xhigh. Please think carefully through the task, validate key assumptions, consider plausible alternatives, and prioritize correctness, consistency, and clarity in the final answer.' %}\n {%- elif resolved_reasoning_effort == 'low' %}\n {%- set reasoning_instructions = 'Reasoning effort is set to low. Keep your thinking brief and focused, moving directly to the conclusion without unnecessary elaboration.' %}\n {%- endif %}\n{%- endif %}\n{%- if tools and tools is iterable and tools is not mapping %}\n {{- '<|im_start|>system\\n' }}\n {%- if reasoning_instructions %}\n {{- reasoning_instructions + '\\n\\n' }}\n {%- endif %}\n {{- \"# Tools\\n\\nYou have access to the following functions:\\n\\n<tools>\" }}\n {%- for tool in tools %}\n {{- \"\\n\" }}\n {{- tool | tojson }}\n {%- endfor %}\n {{- \"\\n</tools>\" }}\n {{- '\\n\\nIf you choose to call a function ONLY reply in the following format with NO suffix:\\n\\n<tool_call>\\n<function=example_function_name>\\n<parameter=example_parameter_1>\\nvalue_1\\n</parameter>\\n<parameter=example_parameter_2>\\nThis is the value for the second parameter\\nthat can span\\nmultiple lines\\n</parameter>\\n</function>\\n</tool_call>\\n\\n<IMPORTANT>\\nReminder:\\n- Function calls MUST follow the specified format: an inner <function=...></function> block must be nested within <tool_call></tool_call> XML tags\\n- Required parameters MUST be specified\\n- You may provide optional reasoning for your function call in natural language BEFORE the function call, but NOT after\\n- If there is no function call available, answer the question like normal with your current knowledge and do not tell the user about function calls\\n</IMPORTANT>' }}\n {%- if messages[0].role == 'system' %}\n {%- set content = render_content(messages[0].content, false, true)|trim %}\n {%- if content %}\n {{- '\\n\\n' + content }}\n {%- endif %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n{%- else %}\n {%- if messages[0].role == 'system' %}\n {%- set content = render_content(messages[0].content, false, true)|trim %}\n {%- if content %}\n {{- '<|im_start|>system\\n' + (reasoning_instructions + '\\n\\n' if reasoning_instructions else '') + content + '<|im_end|>\\n' }}\n {%- elif reasoning_instructions %}\n {{- '<|im_start|>system\\n' + reasoning_instructions + '<|im_end|>\\n' }}\n {%- endif %}\n {%- elif reasoning_instructions %}\n {{- '<|im_start|>system\\n' + reasoning_instructions + '<|im_end|>\\n' }}\n {%- endif %}\n{%- endif %}\n{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}\n{%- for message in messages[::-1] %}\n {%- set index = (messages|length - 1) - loop.index0 %}\n {%- if ns.multi_step_tool and message.role == \"user\" %}\n {%- set content = render_content(message.content, false)|trim %}\n {%- if not(content.startswith('<tool_response>') and content.endswith('</tool_response>')) %}\n {%- set ns.multi_step_tool = false %}\n {%- set ns.last_query_index = index %}\n {%- endif %}\n {%- endif %}\n{%- endfor %}\n{%- if ns.multi_step_tool %}\n {{- raise_exception('No user query found in messages.') }}\n{%- endif %}\n{%- for message in messages %}\n {%- set content = render_content(message.content, true)|trim %}\n {%- if message.role == \"system\" %}\n {%- if not loop.first %}\n {{- raise_exception('System message must be at the beginning.') }}\n {%- endif %}\n {%- elif message.role == \"user\" %}\n {{- '<|im_start|>' + message.role + '\\n' + content + '<|im_end|>' + '\\n' }}\n {%- elif message.role == \"assistant\" %}\n {%- set reasoning_content = '' %}\n {%- if message.reasoning_content is string %}\n {%- set reasoning_content = message.reasoning_content %}\n {%- endif %}\n {%- set reasoning_content = reasoning_content|trim %}\n {%- if preserve_thinking is undefined or preserve_thinking is true or loop.index0 > ns.last_query_index %}\n {{- '<|im_start|>' + message.role + '\\n<think>\\n' + reasoning_content + '\\n</think>\\n\\n' + content }}\n {%- else %}\n {{- '<|im_start|>' + message.role + '\\n' + content }}\n {%- endif %}\n {%- if message.tool_calls and message.tool_calls is iterable and message.tool_calls is not mapping %}\n {%- for tool_call in message.tool_calls %}\n {%- if tool_call.function is defined %}\n {%- set tool_call = tool_call.function %}\n {%- endif %}\n {%- if loop.first %}\n {%- if content|trim %}\n {{- '\\n\\n<tool_call>\\n<function=' + tool_call.name + '>\\n' }}\n {%- else %}\n {{- '<tool_call>\\n<function=' + tool_call.name + '>\\n' }}\n {%- endif %}\n {%- else %}\n {{- '\\n<tool_call>\\n<function=' + tool_call.name + '>\\n' }}\n {%- endif %}\n {%- if tool_call.arguments is defined and tool_call.arguments != '' %}\n {%- for args_name, args_value in tool_call.arguments|items %}\n {{- '<parameter=' + args_name + '>\\n' }}\n {%- set args_value = args_value | string if args_value is string else args_value | tojson | safe %}\n {{- args_value }}\n {{- '\\n</parameter>\\n' }}\n {%- endfor %}\n {%- endif %}\n {{- '</function>\\n</tool_call>' }}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"tool\" %}\n {%- if loop.previtem and loop.previtem.role != \"tool\" %}\n {{- '<|im_start|>user' }}\n {%- endif %}\n {{- '\\n<tool_response>\\n' }}\n {{- content }}\n {{- '\\n</tool_response>' }}\n {%- if not loop.last and loop.nextitem.role != \"tool\" %}\n {{- '<|im_end|>\\n' }}\n {%- elif loop.last %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n {%- else %}\n {{- raise_exception('Unexpected message role.') }}\n {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n {{- '<|im_start|>assistant\\n' }}\n {%- if enable_thinking is defined and enable_thinking is false %}\n {{- '<think>\\n\\n</think>\\n\\n' }}\n {%- else %}\n {{- '<think>\\n' }}\n {%- endif %}\n{%- endif %}",
"model_type": "qwen4_exp",
"quantization_config": {
"modules_to_not_convert": [
"lm_head",
"model.language_model.embed_tokens",
"model.language_model.hyper_connection_mixer.input_mix_weight_down",
"model.language_model.hyper_connection_mixer.input_mix_weight_up",
"model.language_model.layers.0.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.0.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.0.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.0.linear_attn.conv1d",
"model.language_model.layers.0.linear_attn.in_proj_a",
"model.language_model.layers.0.linear_attn.in_proj_b",
"model.language_model.layers.0.linear_attn.in_proj_qkv",
"model.language_model.layers.0.linear_attn.in_proj_z",
"model.language_model.layers.0.linear_attn.out_proj",
"model.language_model.layers.0.mlp.gate",
"model.language_model.layers.0.mlp.shared_expert.down_proj",
"model.language_model.layers.0.mlp.shared_expert.gate_proj",
"model.language_model.layers.0.mlp.shared_expert.up_proj",
"model.language_model.layers.0.mlp.shared_expert_gate",
"model.language_model.layers.0.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.0.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.0.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.1.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.1.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.1.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.1.linear_attn.conv1d",
"model.language_model.layers.1.linear_attn.in_proj_a",
"model.language_model.layers.1.linear_attn.in_proj_b",
"model.language_model.layers.1.linear_attn.in_proj_qkv",
"model.language_model.layers.1.linear_attn.in_proj_z",
"model.language_model.layers.1.linear_attn.out_proj",
"model.language_model.layers.1.mlp.gate",
"model.language_model.layers.1.mlp.shared_expert.down_proj",
"model.language_model.layers.1.mlp.shared_expert.gate_proj",
"model.language_model.layers.1.mlp.shared_expert.up_proj",
"model.language_model.layers.1.mlp.shared_expert_gate",
"model.language_model.layers.1.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.1.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.1.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.1.ple.conv1d",
"model.language_model.layers.1.ple.key_proj",
"model.language_model.layers.1.ple.value_proj",
"model.language_model.layers.10.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.10.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.10.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.10.linear_attn.conv1d",
"model.language_model.layers.10.linear_attn.in_proj_a",
"model.language_model.layers.10.linear_attn.in_proj_b",
"model.language_model.layers.10.linear_attn.in_proj_qkv",
"model.language_model.layers.10.linear_attn.in_proj_z",
"model.language_model.layers.10.linear_attn.out_proj",
"model.language_model.layers.10.mlp.gate",
"model.language_model.layers.10.mlp.shared_expert.down_proj",
"model.language_model.layers.10.mlp.shared_expert.gate_proj",
"model.language_model.layers.10.mlp.shared_expert.up_proj",
"model.language_model.layers.10.mlp.shared_expert_gate",
"model.language_model.layers.10.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.10.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.10.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.11.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.11.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.11.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.11.mlp.gate",
"model.language_model.layers.11.mlp.shared_expert.down_proj",
"model.language_model.layers.11.mlp.shared_expert.gate_proj",
"model.language_model.layers.11.mlp.shared_expert.up_proj",
"model.language_model.layers.11.mlp.shared_expert_gate",
"model.language_model.layers.11.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.11.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.11.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.11.self_attn.indexer.index_qk_proj",
"model.language_model.layers.11.self_attn.k_proj",
"model.language_model.layers.11.self_attn.o_proj",
"model.language_model.layers.11.self_attn.q_proj",
"model.language_model.layers.11.self_attn.v_proj",
"model.language_model.layers.12.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.12.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.12.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.12.linear_attn.conv1d",
"model.language_model.layers.12.linear_attn.in_proj_a",
"model.language_model.layers.12.linear_attn.in_proj_b",
"model.language_model.layers.12.linear_attn.in_proj_qkv",
"model.language_model.layers.12.linear_attn.in_proj_z",
"model.language_model.layers.12.linear_attn.out_proj",
"model.language_model.layers.12.mlp.gate",
"model.language_model.layers.12.mlp.shared_expert.down_proj",
"model.language_model.layers.12.mlp.shared_expert.gate_proj",
"model.language_model.layers.12.mlp.shared_expert.up_proj",
"model.language_model.layers.12.mlp.shared_expert_gate",
"model.language_model.layers.12.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.12.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.12.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.13.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.13.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.13.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.13.linear_attn.conv1d",
"model.language_model.layers.13.linear_attn.in_proj_a",
"model.language_model.layers.13.linear_attn.in_proj_b",
"model.language_model.layers.13.linear_attn.in_proj_qkv",
"model.language_model.layers.13.linear_attn.in_proj_z",
"model.language_model.layers.13.linear_attn.out_proj",
"model.language_model.layers.13.mlp.gate",
"model.language_model.layers.13.mlp.shared_expert.down_proj",
"model.language_model.layers.13.mlp.shared_expert.gate_proj",
"model.language_model.layers.13.mlp.shared_expert.up_proj",
"model.language_model.layers.13.mlp.shared_expert_gate",
"model.language_model.layers.13.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.13.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.13.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.14.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.14.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.14.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.14.linear_attn.conv1d",
"model.language_model.layers.14.linear_attn.in_proj_a",
"model.language_model.layers.14.linear_attn.in_proj_b",
"model.language_model.layers.14.linear_attn.in_proj_qkv",
"model.language_model.layers.14.linear_attn.in_proj_z",
"model.language_model.layers.14.linear_attn.out_proj",
"model.language_model.layers.14.mlp.gate",
"model.language_model.layers.14.mlp.shared_expert.down_proj",
"model.language_model.layers.14.mlp.shared_expert.gate_proj",
"model.language_model.layers.14.mlp.shared_expert.up_proj",
"model.language_model.layers.14.mlp.shared_expert_gate",
"model.language_model.layers.14.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.14.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.14.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.15.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.15.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.15.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.15.mlp.gate",
"model.language_model.layers.15.mlp.shared_expert.down_proj",
"model.language_model.layers.15.mlp.shared_expert.gate_proj",
"model.language_model.layers.15.mlp.shared_expert.up_proj",
"model.language_model.layers.15.mlp.shared_expert_gate",
"model.language_model.layers.15.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.15.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.15.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.15.self_attn.indexer.index_qk_proj",
"model.language_model.layers.15.self_attn.k_proj",
"model.language_model.layers.15.self_attn.o_proj",
"model.language_model.layers.15.self_attn.q_proj",
"model.language_model.layers.15.self_attn.v_proj",
"model.language_model.layers.16.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.16.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.16.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.16.linear_attn.conv1d",
"model.language_model.layers.16.linear_attn.in_proj_a",
"model.language_model.layers.16.linear_attn.in_proj_b",
"model.language_model.layers.16.linear_attn.in_proj_qkv",
"model.language_model.layers.16.linear_attn.in_proj_z",
"model.language_model.layers.16.linear_attn.out_proj",
"model.language_model.layers.16.mlp.gate",
"model.language_model.layers.16.mlp.shared_expert.down_proj",
"model.language_model.layers.16.mlp.shared_expert.gate_proj",
"model.language_model.layers.16.mlp.shared_expert.up_proj",
"model.language_model.layers.16.mlp.shared_expert_gate",
"model.language_model.layers.16.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.16.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.16.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.17.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.17.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.17.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.17.linear_attn.conv1d",
"model.language_model.layers.17.linear_attn.in_proj_a",
"model.language_model.layers.17.linear_attn.in_proj_b",
"model.language_model.layers.17.linear_attn.in_proj_qkv",
"model.language_model.layers.17.linear_attn.in_proj_z",
"model.language_model.layers.17.linear_attn.out_proj",
"model.language_model.layers.17.mlp.gate",
"model.language_model.layers.17.mlp.shared_expert.down_proj",
"model.language_model.layers.17.mlp.shared_expert.gate_proj",
"model.language_model.layers.17.mlp.shared_expert.up_proj",
"model.language_model.layers.17.mlp.shared_expert_gate",
"model.language_model.layers.17.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.17.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.17.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.18.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.18.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.18.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.18.linear_attn.conv1d",
"model.language_model.layers.18.linear_attn.in_proj_a",
"model.language_model.layers.18.linear_attn.in_proj_b",
"model.language_model.layers.18.linear_attn.in_proj_qkv",
"model.language_model.layers.18.linear_attn.in_proj_z",
"model.language_model.layers.18.linear_attn.out_proj",
"model.language_model.layers.18.mlp.gate",
"model.language_model.layers.18.mlp.shared_expert.down_proj",
"model.language_model.layers.18.mlp.shared_expert.gate_proj",
"model.language_model.layers.18.mlp.shared_expert.up_proj",
"model.language_model.layers.18.mlp.shared_expert_gate",
"model.language_model.layers.18.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.18.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.18.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.19.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.19.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.19.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.19.mlp.gate",
"model.language_model.layers.19.mlp.shared_expert.down_proj",
"model.language_model.layers.19.mlp.shared_expert.gate_proj",
"model.language_model.layers.19.mlp.shared_expert.up_proj",
"model.language_model.layers.19.mlp.shared_expert_gate",
"model.language_model.layers.19.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.19.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.19.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.19.self_attn.indexer.index_qk_proj",
"model.language_model.layers.19.self_attn.k_proj",
"model.language_model.layers.19.self_attn.o_proj",
"model.language_model.layers.19.self_attn.q_proj",
"model.language_model.layers.19.self_attn.v_proj",
"model.language_model.layers.2.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.2.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.2.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.2.linear_attn.conv1d",
"model.language_model.layers.2.linear_attn.in_proj_a",
"model.language_model.layers.2.linear_attn.in_proj_b",
"model.language_model.layers.2.linear_attn.in_proj_qkv",
"model.language_model.layers.2.linear_attn.in_proj_z",
"model.language_model.layers.2.linear_attn.out_proj",
"model.language_model.layers.2.mlp.gate",
"model.language_model.layers.2.mlp.shared_expert.down_proj",
"model.language_model.layers.2.mlp.shared_expert.gate_proj",
"model.language_model.layers.2.mlp.shared_expert.up_proj",
"model.language_model.layers.2.mlp.shared_expert_gate",
"model.language_model.layers.2.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.2.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.2.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.20.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.20.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.20.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.20.linear_attn.conv1d",
"model.language_model.layers.20.linear_attn.in_proj_a",
"model.language_model.layers.20.linear_attn.in_proj_b",
"model.language_model.layers.20.linear_attn.in_proj_qkv",
"model.language_model.layers.20.linear_attn.in_proj_z",
"model.language_model.layers.20.linear_attn.out_proj",
"model.language_model.layers.20.mlp.gate",
"model.language_model.layers.20.mlp.shared_expert.down_proj",
"model.language_model.layers.20.mlp.shared_expert.gate_proj",
"model.language_model.layers.20.mlp.shared_expert.up_proj",
"model.language_model.layers.20.mlp.shared_expert_gate",
"model.language_model.layers.20.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.20.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.20.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.21.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.21.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.21.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.21.linear_attn.conv1d",
"model.language_model.layers.21.linear_attn.in_proj_a",
"model.language_model.layers.21.linear_attn.in_proj_b",
"model.language_model.layers.21.linear_attn.in_proj_qkv",
"model.language_model.layers.21.linear_attn.in_proj_z",
"model.language_model.layers.21.linear_attn.out_proj",
"model.language_model.layers.21.mlp.gate",
"model.language_model.layers.21.mlp.shared_expert.down_proj",
"model.language_model.layers.21.mlp.shared_expert.gate_proj",
"model.language_model.layers.21.mlp.shared_expert.up_proj",
"model.language_model.layers.21.mlp.shared_expert_gate",
"model.language_model.layers.21.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.21.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.21.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.22.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.22.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.22.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.22.linear_attn.conv1d",
"model.language_model.layers.22.linear_attn.in_proj_a",
"model.language_model.layers.22.linear_attn.in_proj_b",
"model.language_model.layers.22.linear_attn.in_proj_qkv",
"model.language_model.layers.22.linear_attn.in_proj_z",
"model.language_model.layers.22.linear_attn.out_proj",
"model.language_model.layers.22.mlp.gate",
"model.language_model.layers.22.mlp.shared_expert.down_proj",
"model.language_model.layers.22.mlp.shared_expert.gate_proj",
"model.language_model.layers.22.mlp.shared_expert.up_proj",
"model.language_model.layers.22.mlp.shared_expert_gate",
"model.language_model.layers.22.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.22.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.22.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.23.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.23.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.23.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.23.mlp.gate",
"model.language_model.layers.23.mlp.shared_expert.down_proj",
"model.language_model.layers.23.mlp.shared_expert.gate_proj",
"model.language_model.layers.23.mlp.shared_expert.up_proj",
"model.language_model.layers.23.mlp.shared_expert_gate",
"model.language_model.layers.23.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.23.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.23.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.23.self_attn.indexer.index_qk_proj",
"model.language_model.layers.23.self_attn.k_proj",
"model.language_model.layers.23.self_attn.o_proj",
"model.language_model.layers.23.self_attn.q_proj",
"model.language_model.layers.23.self_attn.v_proj",
"model.language_model.layers.24.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.24.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.24.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.24.linear_attn.conv1d",
"model.language_model.layers.24.linear_attn.in_proj_a",
"model.language_model.layers.24.linear_attn.in_proj_b",
"model.language_model.layers.24.linear_attn.in_proj_qkv",
"model.language_model.layers.24.linear_attn.in_proj_z",
"model.language_model.layers.24.linear_attn.out_proj",
"model.language_model.layers.24.mlp.gate",
"model.language_model.layers.24.mlp.shared_expert.down_proj",
"model.language_model.layers.24.mlp.shared_expert.gate_proj",
"model.language_model.layers.24.mlp.shared_expert.up_proj",
"model.language_model.layers.24.mlp.shared_expert_gate",
"model.language_model.layers.24.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.24.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.24.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.25.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.25.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.25.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.25.linear_attn.conv1d",
"model.language_model.layers.25.linear_attn.in_proj_a",
"model.language_model.layers.25.linear_attn.in_proj_b",
"model.language_model.layers.25.linear_attn.in_proj_qkv",
"model.language_model.layers.25.linear_attn.in_proj_z",
"model.language_model.layers.25.linear_attn.out_proj",
"model.language_model.layers.25.mlp.gate",
"model.language_model.layers.25.mlp.shared_expert.down_proj",
"model.language_model.layers.25.mlp.shared_expert.gate_proj",
"model.language_model.layers.25.mlp.shared_expert.up_proj",
"model.language_model.layers.25.mlp.shared_expert_gate",
"model.language_model.layers.25.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.25.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.25.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.26.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.26.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.26.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.26.linear_attn.conv1d",
"model.language_model.layers.26.linear_attn.in_proj_a",
"model.language_model.layers.26.linear_attn.in_proj_b",
"model.language_model.layers.26.linear_attn.in_proj_qkv",
"model.language_model.layers.26.linear_attn.in_proj_z",
"model.language_model.layers.26.linear_attn.out_proj",
"model.language_model.layers.26.mlp.gate",
"model.language_model.layers.26.mlp.shared_expert.down_proj",
"model.language_model.layers.26.mlp.shared_expert.gate_proj",
"model.language_model.layers.26.mlp.shared_expert.up_proj",
"model.language_model.layers.26.mlp.shared_expert_gate",
"model.language_model.layers.26.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.26.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.26.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.27.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.27.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.27.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.27.mlp.gate",
"model.language_model.layers.27.mlp.shared_expert.down_proj",
"model.language_model.layers.27.mlp.shared_expert.gate_proj",
"model.language_model.layers.27.mlp.shared_expert.up_proj",
"model.language_model.layers.27.mlp.shared_expert_gate",
"model.language_model.layers.27.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.27.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.27.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.27.self_attn.indexer.index_qk_proj",
"model.language_model.layers.27.self_attn.k_proj",
"model.language_model.layers.27.self_attn.o_proj",
"model.language_model.layers.27.self_attn.q_proj",
"model.language_model.layers.27.self_attn.v_proj",
"model.language_model.layers.28.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.28.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.28.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.28.linear_attn.conv1d",
"model.language_model.layers.28.linear_attn.in_proj_a",
"model.language_model.layers.28.linear_attn.in_proj_b",
"model.language_model.layers.28.linear_attn.in_proj_qkv",
"model.language_model.layers.28.linear_attn.in_proj_z",
"model.language_model.layers.28.linear_attn.out_proj",
"model.language_model.layers.28.mlp.gate",
"model.language_model.layers.28.mlp.shared_expert.down_proj",
"model.language_model.layers.28.mlp.shared_expert.gate_proj",
"model.language_model.layers.28.mlp.shared_expert.up_proj",
"model.language_model.layers.28.mlp.shared_expert_gate",
"model.language_model.layers.28.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.28.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.28.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.29.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.29.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.29.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.29.linear_attn.conv1d",
"model.language_model.layers.29.linear_attn.in_proj_a",
"model.language_model.layers.29.linear_attn.in_proj_b",
"model.language_model.layers.29.linear_attn.in_proj_qkv",
"model.language_model.layers.29.linear_attn.in_proj_z",
"model.language_model.layers.29.linear_attn.out_proj",
"model.language_model.layers.29.mlp.gate",
"model.language_model.layers.29.mlp.shared_expert.down_proj",
"model.language_model.layers.29.mlp.shared_expert.gate_proj",
"model.language_model.layers.29.mlp.shared_expert.up_proj",
"model.language_model.layers.29.mlp.shared_expert_gate",
"model.language_model.layers.29.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.29.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.29.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.3.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.3.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.3.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.3.mlp.gate",
"model.language_model.layers.3.mlp.shared_expert.down_proj",
"model.language_model.layers.3.mlp.shared_expert.gate_proj",
"model.language_model.layers.3.mlp.shared_expert.up_proj",
"model.language_model.layers.3.mlp.shared_expert_gate",
"model.language_model.layers.3.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.3.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.3.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.3.self_attn.indexer.index_qk_proj",
"model.language_model.layers.3.self_attn.k_proj",
"model.language_model.layers.3.self_attn.o_proj",
"model.language_model.layers.3.self_attn.q_proj",
"model.language_model.layers.3.self_attn.v_proj",
"model.language_model.layers.30.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.30.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.30.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.30.linear_attn.conv1d",
"model.language_model.layers.30.linear_attn.in_proj_a",
"model.language_model.layers.30.linear_attn.in_proj_b",
"model.language_model.layers.30.linear_attn.in_proj_qkv",
"model.language_model.layers.30.linear_attn.in_proj_z",
"model.language_model.layers.30.linear_attn.out_proj",
"model.language_model.layers.30.mlp.gate",
"model.language_model.layers.30.mlp.shared_expert.down_proj",
"model.language_model.layers.30.mlp.shared_expert.gate_proj",
"model.language_model.layers.30.mlp.shared_expert.up_proj",
"model.language_model.layers.30.mlp.shared_expert_gate",
"model.language_model.layers.30.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.30.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.30.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.31.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.31.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.31.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.31.mlp.gate",
"model.language_model.layers.31.mlp.shared_expert.down_proj",
"model.language_model.layers.31.mlp.shared_expert.gate_proj",
"model.language_model.layers.31.mlp.shared_expert.up_proj",
"model.language_model.layers.31.mlp.shared_expert_gate",
"model.language_model.layers.31.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.31.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.31.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.31.self_attn.indexer.index_qk_proj",
"model.language_model.layers.31.self_attn.k_proj",
"model.language_model.layers.31.self_attn.o_proj",
"model.language_model.layers.31.self_attn.q_proj",
"model.language_model.layers.31.self_attn.v_proj",
"model.language_model.layers.32.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.32.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.32.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.32.linear_attn.conv1d",
"model.language_model.layers.32.linear_attn.in_proj_a",
"model.language_model.layers.32.linear_attn.in_proj_b",
"model.language_model.layers.32.linear_attn.in_proj_qkv",
"model.language_model.layers.32.linear_attn.in_proj_z",
"model.language_model.layers.32.linear_attn.out_proj",
"model.language_model.layers.32.mlp.gate",
"model.language_model.layers.32.mlp.shared_expert.down_proj",
"model.language_model.layers.32.mlp.shared_expert.gate_proj",
"model.language_model.layers.32.mlp.shared_expert.up_proj",
"model.language_model.layers.32.mlp.shared_expert_gate",
"model.language_model.layers.32.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.32.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.32.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.33.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.33.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.33.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.33.linear_attn.conv1d",
"model.language_model.layers.33.linear_attn.in_proj_a",
"model.language_model.layers.33.linear_attn.in_proj_b",
"model.language_model.layers.33.linear_attn.in_proj_qkv",
"model.language_model.layers.33.linear_attn.in_proj_z",
"model.language_model.layers.33.linear_attn.out_proj",
"model.language_model.layers.33.mlp.gate",
"model.language_model.layers.33.mlp.shared_expert.down_proj",
"model.language_model.layers.33.mlp.shared_expert.gate_proj",
"model.language_model.layers.33.mlp.shared_expert.up_proj",
"model.language_model.layers.33.mlp.shared_expert_gate",
"model.language_model.layers.33.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.33.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.33.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.34.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.34.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.34.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.34.linear_attn.conv1d",
"model.language_model.layers.34.linear_attn.in_proj_a",
"model.language_model.layers.34.linear_attn.in_proj_b",
"model.language_model.layers.34.linear_attn.in_proj_qkv",
"model.language_model.layers.34.linear_attn.in_proj_z",
"model.language_model.layers.34.linear_attn.out_proj",
"model.language_model.layers.34.mlp.gate",
"model.language_model.layers.34.mlp.shared_expert.down_proj",
"model.language_model.layers.34.mlp.shared_expert.gate_proj",
"model.language_model.layers.34.mlp.shared_expert.up_proj",
"model.language_model.layers.34.mlp.shared_expert_gate",
"model.language_model.layers.34.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.34.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.34.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.35.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.35.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.35.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.35.mlp.gate",
"model.language_model.layers.35.mlp.shared_expert.down_proj",
"model.language_model.layers.35.mlp.shared_expert.gate_proj",
"model.language_model.layers.35.mlp.shared_expert.up_proj",
"model.language_model.layers.35.mlp.shared_expert_gate",
"model.language_model.layers.35.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.35.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.35.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.35.self_attn.indexer.index_qk_proj",
"model.language_model.layers.35.self_attn.k_proj",
"model.language_model.layers.35.self_attn.o_proj",
"model.language_model.layers.35.self_attn.q_proj",
"model.language_model.layers.35.self_attn.v_proj",
"model.language_model.layers.36.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.36.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.36.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.36.linear_attn.conv1d",
"model.language_model.layers.36.linear_attn.in_proj_a",
"model.language_model.layers.36.linear_attn.in_proj_b",
"model.language_model.layers.36.linear_attn.in_proj_qkv",
"model.language_model.layers.36.linear_attn.in_proj_z",
"model.language_model.layers.36.linear_attn.out_proj",
"model.language_model.layers.36.mlp.gate",
"model.language_model.layers.36.mlp.shared_expert.down_proj",
"model.language_model.layers.36.mlp.shared_expert.gate_proj",
"model.language_model.layers.36.mlp.shared_expert.up_proj",
"model.language_model.layers.36.mlp.shared_expert_gate",
"model.language_model.layers.36.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.36.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.36.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.37.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.37.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.37.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.37.linear_attn.conv1d",
"model.language_model.layers.37.linear_attn.in_proj_a",
"model.language_model.layers.37.linear_attn.in_proj_b",
"model.language_model.layers.37.linear_attn.in_proj_qkv",
"model.language_model.layers.37.linear_attn.in_proj_z",
"model.language_model.layers.37.linear_attn.out_proj",
"model.language_model.layers.37.mlp.gate",
"model.language_model.layers.37.mlp.shared_expert.down_proj",
"model.language_model.layers.37.mlp.shared_expert.gate_proj",
"model.language_model.layers.37.mlp.shared_expert.up_proj",
"model.language_model.layers.37.mlp.shared_expert_gate",
"model.language_model.layers.37.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.37.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.37.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.38.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.38.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.38.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.38.linear_attn.conv1d",
"model.language_model.layers.38.linear_attn.in_proj_a",
"model.language_model.layers.38.linear_attn.in_proj_b",
"model.language_model.layers.38.linear_attn.in_proj_qkv",
"model.language_model.layers.38.linear_attn.in_proj_z",
"model.language_model.layers.38.linear_attn.out_proj",
"model.language_model.layers.38.mlp.gate",
"model.language_model.layers.38.mlp.shared_expert.down_proj",
"model.language_model.layers.38.mlp.shared_expert.gate_proj",
"model.language_model.layers.38.mlp.shared_expert.up_proj",
"model.language_model.layers.38.mlp.shared_expert_gate",
"model.language_model.layers.38.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.38.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.38.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.39.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.39.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.39.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.39.mlp.gate",
"model.language_model.layers.39.mlp.shared_expert.down_proj",
"model.language_model.layers.39.mlp.shared_expert.gate_proj",
"model.language_model.layers.39.mlp.shared_expert.up_proj",
"model.language_model.layers.39.mlp.shared_expert_gate",
"model.language_model.layers.39.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.39.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.39.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.39.self_attn.indexer.index_qk_proj",
"model.language_model.layers.39.self_attn.k_proj",
"model.language_model.layers.39.self_attn.o_proj",
"model.language_model.layers.39.self_attn.q_proj",
"model.language_model.layers.39.self_attn.v_proj",
"model.language_model.layers.4.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.4.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.4.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.4.linear_attn.conv1d",
"model.language_model.layers.4.linear_attn.in_proj_a",
"model.language_model.layers.4.linear_attn.in_proj_b",
"model.language_model.layers.4.linear_attn.in_proj_qkv",
"model.language_model.layers.4.linear_attn.in_proj_z",
"model.language_model.layers.4.linear_attn.out_proj",
"model.language_model.layers.4.mlp.gate",
"model.language_model.layers.4.mlp.shared_expert.down_proj",
"model.language_model.layers.4.mlp.shared_expert.gate_proj",
"model.language_model.layers.4.mlp.shared_expert.up_proj",
"model.language_model.layers.4.mlp.shared_expert_gate",
"model.language_model.layers.4.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.4.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.4.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.40.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.40.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.40.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.40.linear_attn.conv1d",
"model.language_model.layers.40.linear_attn.in_proj_a",
"model.language_model.layers.40.linear_attn.in_proj_b",
"model.language_model.layers.40.linear_attn.in_proj_qkv",
"model.language_model.layers.40.linear_attn.in_proj_z",
"model.language_model.layers.40.linear_attn.out_proj",
"model.language_model.layers.40.mlp.gate",
"model.language_model.layers.40.mlp.shared_expert.down_proj",
"model.language_model.layers.40.mlp.shared_expert.gate_proj",
"model.language_model.layers.40.mlp.shared_expert.up_proj",
"model.language_model.layers.40.mlp.shared_expert_gate",
"model.language_model.layers.40.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.40.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.40.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.41.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.41.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.41.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.41.linear_attn.conv1d",
"model.language_model.layers.41.linear_attn.in_proj_a",
"model.language_model.layers.41.linear_attn.in_proj_b",
"model.language_model.layers.41.linear_attn.in_proj_qkv",
"model.language_model.layers.41.linear_attn.in_proj_z",
"model.language_model.layers.41.linear_attn.out_proj",
"model.language_model.layers.41.mlp.gate",
"model.language_model.layers.41.mlp.shared_expert.down_proj",
"model.language_model.layers.41.mlp.shared_expert.gate_proj",
"model.language_model.layers.41.mlp.shared_expert.up_proj",
"model.language_model.layers.41.mlp.shared_expert_gate",
"model.language_model.layers.41.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.41.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.41.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.42.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.42.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.42.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.42.linear_attn.conv1d",
"model.language_model.layers.42.linear_attn.in_proj_a",
"model.language_model.layers.42.linear_attn.in_proj_b",
"model.language_model.layers.42.linear_attn.in_proj_qkv",
"model.language_model.layers.42.linear_attn.in_proj_z",
"model.language_model.layers.42.linear_attn.out_proj",
"model.language_model.layers.42.mlp.gate",
"model.language_model.layers.42.mlp.shared_expert.down_proj",
"model.language_model.layers.42.mlp.shared_expert.gate_proj",
"model.language_model.layers.42.mlp.shared_expert.up_proj",
"model.language_model.layers.42.mlp.shared_expert_gate",
"model.language_model.layers.42.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.42.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.42.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.43.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.43.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.43.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.43.mlp.gate",
"model.language_model.layers.43.mlp.shared_expert.down_proj",
"model.language_model.layers.43.mlp.shared_expert.gate_proj",
"model.language_model.layers.43.mlp.shared_expert.up_proj",
"model.language_model.layers.43.mlp.shared_expert_gate",
"model.language_model.layers.43.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.43.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.43.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.43.self_attn.indexer.index_qk_proj",
"model.language_model.layers.43.self_attn.k_proj",
"model.language_model.layers.43.self_attn.o_proj",
"model.language_model.layers.43.self_attn.q_proj",
"model.language_model.layers.43.self_attn.v_proj",
"model.language_model.layers.44.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.44.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.44.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.44.linear_attn.conv1d",
"model.language_model.layers.44.linear_attn.in_proj_a",
"model.language_model.layers.44.linear_attn.in_proj_b",
"model.language_model.layers.44.linear_attn.in_proj_qkv",
"model.language_model.layers.44.linear_attn.in_proj_z",
"model.language_model.layers.44.linear_attn.out_proj",
"model.language_model.layers.44.mlp.gate",
"model.language_model.layers.44.mlp.shared_expert.down_proj",
"model.language_model.layers.44.mlp.shared_expert.gate_proj",
"model.language_model.layers.44.mlp.shared_expert.up_proj",
"model.language_model.layers.44.mlp.shared_expert_gate",
"model.language_model.layers.44.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.44.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.44.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.45.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.45.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.45.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.45.linear_attn.conv1d",
"model.language_model.layers.45.linear_attn.in_proj_a",
"model.language_model.layers.45.linear_attn.in_proj_b",
"model.language_model.layers.45.linear_attn.in_proj_qkv",
"model.language_model.layers.45.linear_attn.in_proj_z",
"model.language_model.layers.45.linear_attn.out_proj",
"model.language_model.layers.45.mlp.gate",
"model.language_model.layers.45.mlp.shared_expert.down_proj",
"model.language_model.layers.45.mlp.shared_expert.gate_proj",
"model.language_model.layers.45.mlp.shared_expert.up_proj",
"model.language_model.layers.45.mlp.shared_expert_gate",
"model.language_model.layers.45.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.45.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.45.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.46.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.46.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.46.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.46.linear_attn.conv1d",
"model.language_model.layers.46.linear_attn.in_proj_a",
"model.language_model.layers.46.linear_attn.in_proj_b",
"model.language_model.layers.46.linear_attn.in_proj_qkv",
"model.language_model.layers.46.linear_attn.in_proj_z",
"model.language_model.layers.46.linear_attn.out_proj",
"model.language_model.layers.46.mlp.gate",
"model.language_model.layers.46.mlp.shared_expert.down_proj",
"model.language_model.layers.46.mlp.shared_expert.gate_proj",
"model.language_model.layers.46.mlp.shared_expert.up_proj",
"model.language_model.layers.46.mlp.shared_expert_gate",
"model.language_model.layers.46.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.46.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.46.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.47.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.47.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.47.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.47.mlp.gate",
"model.language_model.layers.47.mlp.shared_expert.down_proj",
"model.language_model.layers.47.mlp.shared_expert.gate_proj",
"model.language_model.layers.47.mlp.shared_expert.up_proj",
"model.language_model.layers.47.mlp.shared_expert_gate",
"model.language_model.layers.47.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.47.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.47.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.47.self_attn.indexer.index_qk_proj",
"model.language_model.layers.47.self_attn.k_proj",
"model.language_model.layers.47.self_attn.o_proj",
"model.language_model.layers.47.self_attn.q_proj",
"model.language_model.layers.47.self_attn.v_proj",
"model.language_model.layers.5.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.5.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.5.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.5.linear_attn.conv1d",
"model.language_model.layers.5.linear_attn.in_proj_a",
"model.language_model.layers.5.linear_attn.in_proj_b",
"model.language_model.layers.5.linear_attn.in_proj_qkv",
"model.language_model.layers.5.linear_attn.in_proj_z",
"model.language_model.layers.5.linear_attn.out_proj",
"model.language_model.layers.5.mlp.gate",
"model.language_model.layers.5.mlp.shared_expert.down_proj",
"model.language_model.layers.5.mlp.shared_expert.gate_proj",
"model.language_model.layers.5.mlp.shared_expert.up_proj",
"model.language_model.layers.5.mlp.shared_expert_gate",
"model.language_model.layers.5.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.5.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.5.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.6.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.6.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.6.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.6.linear_attn.conv1d",
"model.language_model.layers.6.linear_attn.in_proj_a",
"model.language_model.layers.6.linear_attn.in_proj_b",
"model.language_model.layers.6.linear_attn.in_proj_qkv",
"model.language_model.layers.6.linear_attn.in_proj_z",
"model.language_model.layers.6.linear_attn.out_proj",
"model.language_model.layers.6.mlp.gate",
"model.language_model.layers.6.mlp.shared_expert.down_proj",
"model.language_model.layers.6.mlp.shared_expert.gate_proj",
"model.language_model.layers.6.mlp.shared_expert.up_proj",
"model.language_model.layers.6.mlp.shared_expert_gate",
"model.language_model.layers.6.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.6.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.6.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.7.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.7.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.7.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.7.mlp.gate",
"model.language_model.layers.7.mlp.shared_expert.down_proj",
"model.language_model.layers.7.mlp.shared_expert.gate_proj",
"model.language_model.layers.7.mlp.shared_expert.up_proj",
"model.language_model.layers.7.mlp.shared_expert_gate",
"model.language_model.layers.7.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.7.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.7.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.7.self_attn.indexer.index_qk_proj",
"model.language_model.layers.7.self_attn.k_proj",
"model.language_model.layers.7.self_attn.o_proj",
"model.language_model.layers.7.self_attn.q_proj",
"model.language_model.layers.7.self_attn.v_proj",
"model.language_model.layers.8.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.8.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.8.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.8.linear_attn.conv1d",
"model.language_model.layers.8.linear_attn.in_proj_a",
"model.language_model.layers.8.linear_attn.in_proj_b",
"model.language_model.layers.8.linear_attn.in_proj_qkv",
"model.language_model.layers.8.linear_attn.in_proj_z",
"model.language_model.layers.8.linear_attn.out_proj",
"model.language_model.layers.8.mlp.gate",
"model.language_model.layers.8.mlp.shared_expert.down_proj",
"model.language_model.layers.8.mlp.shared_expert.gate_proj",
"model.language_model.layers.8.mlp.shared_expert.up_proj",
"model.language_model.layers.8.mlp.shared_expert_gate",
"model.language_model.layers.8.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.8.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.8.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.9.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.9.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.9.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.9.linear_attn.conv1d",
"model.language_model.layers.9.linear_attn.in_proj_a",
"model.language_model.layers.9.linear_attn.in_proj_b",
"model.language_model.layers.9.linear_attn.in_proj_qkv",
"model.language_model.layers.9.linear_attn.in_proj_z",
"model.language_model.layers.9.linear_attn.out_proj",
"model.language_model.layers.9.mlp.gate",
"model.language_model.layers.9.mlp.shared_expert.down_proj",
"model.language_model.layers.9.mlp.shared_expert.gate_proj",
"model.language_model.layers.9.mlp.shared_expert.up_proj",
"model.language_model.layers.9.mlp.shared_expert_gate",
"model.language_model.layers.9.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.9.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.9.mlp_hyper_connection.input_mix_weight_up",
"model.visual.blocks.0.attn.proj",
"model.visual.blocks.0.attn.qkv",
"model.visual.blocks.0.mlp.linear_fc1",
"model.visual.blocks.0.mlp.linear_fc2",
"model.visual.blocks.1.attn.proj",
"model.visual.blocks.1.attn.qkv",
"model.visual.blocks.1.mlp.linear_fc1",
"model.visual.blocks.1.mlp.linear_fc2",
"model.visual.blocks.10.attn.proj",
"model.visual.blocks.10.attn.qkv",
"model.visual.blocks.10.mlp.linear_fc1",
"model.visual.blocks.10.mlp.linear_fc2",
"model.visual.blocks.11.attn.proj",
"model.visual.blocks.11.attn.qkv",
"model.visual.blocks.11.mlp.linear_fc1",
"model.visual.blocks.11.mlp.linear_fc2",
"model.visual.blocks.12.attn.proj",
"model.visual.blocks.12.attn.qkv",
"model.visual.blocks.12.mlp.linear_fc1",
"model.visual.blocks.12.mlp.linear_fc2",
"model.visual.blocks.13.attn.proj",
"model.visual.blocks.13.attn.qkv",
"model.visual.blocks.13.mlp.linear_fc1",
"model.visual.blocks.13.mlp.linear_fc2",
"model.visual.blocks.14.attn.proj",
"model.visual.blocks.14.attn.qkv",
"model.visual.blocks.14.mlp.linear_fc1",
"model.visual.blocks.14.mlp.linear_fc2",
"model.visual.blocks.15.attn.proj",
"model.visual.blocks.15.attn.qkv",
"model.visual.blocks.15.mlp.linear_fc1",
"model.visual.blocks.15.mlp.linear_fc2",
"model.visual.blocks.16.attn.proj",
"model.visual.blocks.16.attn.qkv",
"model.visual.blocks.16.mlp.linear_fc1",
"model.visual.blocks.16.mlp.linear_fc2",
"model.visual.blocks.17.attn.proj",
"model.visual.blocks.17.attn.qkv",
"model.visual.blocks.17.mlp.linear_fc1",
"model.visual.blocks.17.mlp.linear_fc2",
"model.visual.blocks.18.attn.proj",
"model.visual.blocks.18.attn.qkv",
"model.visual.blocks.18.mlp.linear_fc1",
"model.visual.blocks.18.mlp.linear_fc2",
"model.visual.blocks.19.attn.proj",
"model.visual.blocks.19.attn.qkv",
"model.visual.blocks.19.mlp.linear_fc1",
"model.visual.blocks.19.mlp.linear_fc2",
"model.visual.blocks.2.attn.proj",
"model.visual.blocks.2.attn.qkv",
"model.visual.blocks.2.mlp.linear_fc1",
"model.visual.blocks.2.mlp.linear_fc2",
"model.visual.blocks.20.attn.proj",
"model.visual.blocks.20.attn.qkv",
"model.visual.blocks.20.mlp.linear_fc1",
"model.visual.blocks.20.mlp.linear_fc2",
"model.visual.blocks.21.attn.proj",
"model.visual.blocks.21.attn.qkv",
"model.visual.blocks.21.mlp.linear_fc1",
"model.visual.blocks.21.mlp.linear_fc2",
"model.visual.blocks.22.attn.proj",
"model.visual.blocks.22.attn.qkv",
"model.visual.blocks.22.mlp.linear_fc1",
"model.visual.blocks.22.mlp.linear_fc2",
"model.visual.blocks.23.attn.proj",
"model.visual.blocks.23.attn.qkv",
"model.visual.blocks.23.mlp.linear_fc1",
"model.visual.blocks.23.mlp.linear_fc2",
"model.visual.blocks.24.attn.proj",
"model.visual.blocks.24.attn.qkv",
"model.visual.blocks.24.mlp.linear_fc1",
"model.visual.blocks.24.mlp.linear_fc2",
"model.visual.blocks.25.attn.proj",
"model.visual.blocks.25.attn.qkv",
"model.visual.blocks.25.mlp.linear_fc1",
"model.visual.blocks.25.mlp.linear_fc2",
"model.visual.blocks.26.attn.proj",
"model.visual.blocks.26.attn.qkv",
"model.visual.blocks.26.mlp.linear_fc1",
"model.visual.blocks.26.mlp.linear_fc2",
"model.visual.blocks.3.attn.proj",
"model.visual.blocks.3.attn.qkv",
"model.visual.blocks.3.mlp.linear_fc1",
"model.visual.blocks.3.mlp.linear_fc2",
"model.visual.blocks.4.attn.proj",
"model.visual.blocks.4.attn.qkv",
"model.visual.blocks.4.mlp.linear_fc1",
"model.visual.blocks.4.mlp.linear_fc2",
"model.visual.blocks.5.attn.proj",
"model.visual.blocks.5.attn.qkv",
"model.visual.blocks.5.mlp.linear_fc1",
"model.visual.blocks.5.mlp.linear_fc2",
"model.visual.blocks.6.attn.proj",
"model.visual.blocks.6.attn.qkv",
"model.visual.blocks.6.mlp.linear_fc1",
"model.visual.blocks.6.mlp.linear_fc2",
"model.visual.blocks.7.attn.proj",
"model.visual.blocks.7.attn.qkv",
"model.visual.blocks.7.mlp.linear_fc1",
"model.visual.blocks.7.mlp.linear_fc2",
"model.visual.blocks.8.attn.proj",
"model.visual.blocks.8.attn.qkv",
"model.visual.blocks.8.mlp.linear_fc1",
"model.visual.blocks.8.mlp.linear_fc2",
"model.visual.blocks.9.attn.proj",
"model.visual.blocks.9.attn.qkv",
"model.visual.blocks.9.mlp.linear_fc1",
"model.visual.blocks.9.mlp.linear_fc2",
"model.visual.merger.linear_fc1",
"model.visual.merger.linear_fc2",
"model.visual.patch_embed.proj",
"model.visual.pos_embed",
"mtp.fc_embedding",
"mtp.fc_hidden",
"mtp.hyper_connection_mixer.input_mix_weight_down",
"mtp.hyper_connection_mixer.input_mix_weight_up",
"mtp.layers.0.attn_hyper_connection.block_inject_weight",
"mtp.layers.0.attn_hyper_connection.input_mix_weight_down",
"mtp.layers.0.attn_hyper_connection.input_mix_weight_up",
"mtp.layers.0.mlp.gate",
"mtp.layers.0.mlp.shared_expert.down_proj",
"mtp.layers.0.mlp.shared_expert.gate_proj",
"mtp.layers.0.mlp.shared_expert.up_proj",
"mtp.layers.0.mlp.shared_expert_gate",
"mtp.layers.0.mlp_hyper_connection.block_inject_weight",
"mtp.layers.0.mlp_hyper_connection.input_mix_weight_down",
"mtp.layers.0.mlp_hyper_connection.input_mix_weight_up",
"mtp.layers.0.self_attn.indexer.index_qk_proj",
"mtp.layers.0.self_attn.k_proj",
"mtp.layers.0.self_attn.o_proj",
"mtp.layers.0.self_attn.q_proj",
"mtp.layers.0.self_attn.v_proj"
],
"quant_method": "fp8"
},
"tokenizer_config": {
"bos_token": null,
"chat_template": "{%- set image_count = namespace(value=0) %}\n{%- set video_count = namespace(value=0) %}\n{%- macro render_content(content, do_vision_count, is_system_content=false) %}\n {%- if content is string %}\n {{- content }}\n {%- elif content is iterable and content is not mapping %}\n {%- for item in content %}\n {%- if 'image' in item or 'image_url' in item or item.type == 'image' %}\n {%- if is_system_content %}\n {{- raise_exception('System message cannot contain images.') }}\n {%- endif %}\n {%- if do_vision_count %}\n {%- set image_count.value = image_count.value + 1 %}\n {%- endif %}\n {%- if add_vision_id %}\n {{- 'Picture ' ~ image_count.value ~ ': ' }}\n {%- endif %}\n {{- '<|vision_start|><|image_pad|><|vision_end|>' }}\n {%- elif 'video' in item or item.type == 'video' %}\n {%- if is_system_content %}\n {{- raise_exception('System message cannot contain videos.') }}\n {%- endif %}\n {%- if do_vision_count %}\n {%- set video_count.value = video_count.value + 1 %}\n {%- endif %}\n {%- if add_vision_id %}\n {{- 'Video ' ~ video_count.value ~ ': ' }}\n {%- endif %}\n {{- '<|vision_start|><|video_pad|><|vision_end|>' }}\n {%- elif 'text' in item %}\n {{- item.text }}\n {%- else %}\n {{- raise_exception('Unexpected item type in content.') }}\n {%- endif %}\n {%- endfor %}\n {%- elif content is none or content is undefined %}\n {{- '' }}\n {%- else %}\n {{- raise_exception('Unexpected content type.') }}\n {%- endif %}\n{%- endmacro %}\n{%- if not messages %}\n {{- raise_exception('No messages provided.') }}\n{%- endif %}\n{%- set reasoning_instructions = '' %}\n{%- if enable_thinking is undefined or enable_thinking is true %}\n {%- set resolved_reasoning_effort = reasoning_effort|default('xhigh') %}\n {%- if resolved_reasoning_effort not in ('xhigh', 'medium', 'low') %}\n {{- raise_exception('Unexpected reasoning effort ' ~ reasoning_effort ~ '. Supported types are xhigh (default), medium, and low.') }}\n {%- endif %}\n {%- if resolved_reasoning_effort == 'xhigh' %}\n {%- set reasoning_instructions = 'Reasoning effort is set to xhigh. Please think carefully through the task, validate key assumptions, consider plausible alternatives, and prioritize correctness, consistency, and clarity in the final answer.' %}\n {%- elif resolved_reasoning_effort == 'low' %}\n {%- set reasoning_instructions = 'Reasoning effort is set to low. Keep your thinking brief and focused, moving directly to the conclusion without unnecessary elaboration.' %}\n {%- endif %}\n{%- endif %}\n{%- if tools and tools is iterable and tools is not mapping %}\n {{- '<|im_start|>system\\n' }}\n {%- if reasoning_instructions %}\n {{- reasoning_instructions + '\\n\\n' }}\n {%- endif %}\n {{- \"# Tools\\n\\nYou have access to the following functions:\\n\\n<tools>\" }}\n {%- for tool in tools %}\n {{- \"\\n\" }}\n {{- tool | tojson }}\n {%- endfor %}\n {{- \"\\n</tools>\" }}\n {{- '\\n\\nIf you choose to call a function ONLY reply in the following format with NO suffix:\\n\\n<tool_call>\\n<function=example_function_name>\\n<parameter=example_parameter_1>\\nvalue_1\\n</parameter>\\n<parameter=example_parameter_2>\\nThis is the value for the second parameter\\nthat can span\\nmultiple lines\\n</parameter>\\n</function>\\n</tool_call>\\n\\n<IMPORTANT>\\nReminder:\\n- Function calls MUST follow the specified format: an inner <function=...></function> block must be nested within <tool_call></tool_call> XML tags\\n- Required parameters MUST be specified\\n- You may provide optional reasoning for your function call in natural language BEFORE the function call, but NOT after\\n- If there is no function call available, answer the question like normal with your current knowledge and do not tell the user about function calls\\n</IMPORTANT>' }}\n {%- if messages[0].role == 'system' %}\n {%- set content = render_content(messages[0].content, false, true)|trim %}\n {%- if content %}\n {{- '\\n\\n' + content }}\n {%- endif %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n{%- else %}\n {%- if messages[0].role == 'system' %}\n {%- set content = render_content(messages[0].content, false, true)|trim %}\n {%- if content %}\n {{- '<|im_start|>system\\n' + (reasoning_instructions + '\\n\\n' if reasoning_instructions else '') + content + '<|im_end|>\\n' }}\n {%- elif reasoning_instructions %}\n {{- '<|im_start|>system\\n' + reasoning_instructions + '<|im_end|>\\n' }}\n {%- endif %}\n {%- elif reasoning_instructions %}\n {{- '<|im_start|>system\\n' + reasoning_instructions + '<|im_end|>\\n' }}\n {%- endif %}\n{%- endif %}\n{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}\n{%- for message in messages[::-1] %}\n {%- set index = (messages|length - 1) - loop.index0 %}\n {%- if ns.multi_step_tool and message.role == \"user\" %}\n {%- set content = render_content(message.content, false)|trim %}\n {%- if not(content.startswith('<tool_response>') and content.endswith('</tool_response>')) %}\n {%- set ns.multi_step_tool = false %}\n {%- set ns.last_query_index = index %}\n {%- endif %}\n {%- endif %}\n{%- endfor %}\n{%- if ns.multi_step_tool %}\n {{- raise_exception('No user query found in messages.') }}\n{%- endif %}\n{%- for message in messages %}\n {%- set content = render_content(message.content, true)|trim %}\n {%- if message.role == \"system\" %}\n {%- if not loop.first %}\n {{- raise_exception('System message must be at the beginning.') }}\n {%- endif %}\n {%- elif message.role == \"user\" %}\n {{- '<|im_start|>' + message.role + '\\n' + content + '<|im_end|>' + '\\n' }}\n {%- elif message.role == \"assistant\" %}\n {%- set reasoning_content = '' %}\n {%- if message.reasoning_content is string %}\n {%- set reasoning_content = message.reasoning_content %}\n {%- endif %}\n {%- set reasoning_content = reasoning_content|trim %}\n {%- if preserve_thinking is undefined or preserve_thinking is true or loop.index0 > ns.last_query_index %}\n {{- '<|im_start|>' + message.role + '\\n<think>\\n' + reasoning_content + '\\n</think>\\n\\n' + content }}\n {%- else %}\n {{- '<|im_start|>' + message.role + '\\n' + content }}\n {%- endif %}\n {%- if message.tool_calls and message.tool_calls is iterable and message.tool_calls is not mapping %}\n {%- for tool_call in message.tool_calls %}\n {%- if tool_call.function is defined %}\n {%- set tool_call = tool_call.function %}\n {%- endif %}\n {%- if loop.first %}\n {%- if content|trim %}\n {{- '\\n\\n<tool_call>\\n<function=' + tool_call.name + '>\\n' }}\n {%- else %}\n {{- '<tool_call>\\n<function=' + tool_call.name + '>\\n' }}\n {%- endif %}\n {%- else %}\n {{- '\\n<tool_call>\\n<function=' + tool_call.name + '>\\n' }}\n {%- endif %}\n {%- if tool_call.arguments is defined and tool_call.arguments != '' %}\n {%- for args_name, args_value in tool_call.arguments|items %}\n {{- '<parameter=' + args_name + '>\\n' }}\n {%- set args_value = args_value | string if args_value is string else args_value | tojson | safe %}\n {{- args_value }}\n {{- '\\n</parameter>\\n' }}\n {%- endfor %}\n {%- endif %}\n {{- '</function>\\n</tool_call>' }}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"tool\" %}\n {%- if loop.previtem and loop.previtem.role != \"tool\" %}\n {{- '<|im_start|>user' }}\n {%- endif %}\n {{- '\\n<tool_response>\\n' }}\n {{- content }}\n {{- '\\n</tool_response>' }}\n {%- if not loop.last and loop.nextitem.role != \"tool\" %}\n {{- '<|im_end|>\\n' }}\n {%- elif loop.last %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n {%- else %}\n {{- raise_exception('Unexpected message role.') }}\n {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n {{- '<|im_start|>assistant\\n' }}\n {%- if enable_thinking is defined and enable_thinking is false %}\n {{- '<think>\\n\\n</think>\\n\\n' }}\n {%- else %}\n {{- '<think>\\n' }}\n {%- endif %}\n{%- endif %}",
"eos_token": "<|im_end|>",
"pad_token": "<|endoftext|>",
"unk_token": null
}
},
"createdAt": "2026-08-27T03:44:28.000Z",
"disabled": false,
"downloads": 1166,
"gated": false,
"id": "dealignai/Qwen3.8-Flash-Next-UNCENSORED-FP8",
"lastModified": "2026-09-05T23:11:32.000Z",
"likes": 29,
"model-index": null,
"modelId": "dealignai/Qwen3.8-Flash-Next-UNCENSORED-FP8",
"pipeline_tag": "text-generation",
"private": false,
"safetensors": {
"parameters": {
"BF16": 5487198064,
"F8_E4M3": 174512783360,
"I64": 35
},
"total": 179999981459
},
"sha": "0df192cfd5b20fcd109fb63a5e1f663afa0341d8",
"siblings": [
{
"rfilename": ".gitattributes"
},
{
"rfilename": "LICENSE"
},
{
"rfilename": "README.md"
},
{
"rfilename": "chat_template.jinja"
},
{
"rfilename": "config.json"
},
{
"rfilename": "dealign_logo.png"
},
{
"rfilename": "dealign_mascot.png"
},
{
"rfilename": "generation_config.json"
},
{
"rfilename": "merges.txt"
},
{
"rfilename": "model-00001-of-00131.safetensors"
},
{
"rfilename": "model-00002-of-00131.safetensors"
},
{
"rfilename": "model-00003-of-00131.safetensors"
},
{
"rfilename": "model-00004-of-00131.safetensors"
},
{
"rfilename": "model-00005-of-00131.safetensors"
},
{
"rfilename": "model-00006-of-00131.safetensors"
},
{
"rfilename": "model-00007-of-00131.safetensors"
},
{
"rfilename": "model-00008-of-00131.safetensors"
},
{
"rfilename": "model-00009-of-00131.safetensors"
},
{
"rfilename": "model-00010-of-00131.safetensors"
},
{
"rfilename": "model-00011-of-00131.safetensors"
},
{
"rfilename": "model-00012-of-00131.safetensors"
},
{
"rfilename": "model-00013-of-00131.safetensors"
},
{
"rfilename": "model-00014-of-00131.safetensors"
},
{
"rfilename": "model-00015-of-00131.safetensors"
},
{
"rfilename": "model-00016-of-00131.safetensors"
},
{
"rfilename": "model-00017-of-00131.safetensors"
},
{
"rfilename": "model-00018-of-00131.safetensors"
},
{
"rfilename": "model-00019-of-00131.safetensors"
},
{
"rfilename": "model-00020-of-00131.safetensors"
},
{
"rfilename": "model-00021-of-00131.safetensors"
},
{
"rfilename": "model-00022-of-00131.safetensors"
},
{
"rfilename": "model-00023-of-00131.safetensors"
},
{
"rfilename": "model-00024-of-00131.safetensors"
},
{
"rfilename": "model-00025-of-00131.safetensors"
},
{
"rfilename": "model-00026-of-00131.safetensors"
},
{
"rfilename": "model-00027-of-00131.safetensors"
},
{
"rfilename": "model-00028-of-00131.safetensors"
},
{
"rfilename": "model-00029-of-00131.safetensors"
},
{
"rfilename": "model-00030-of-00131.safetensors"
},
{
"rfilename": "model-00031-of-00131.safetensors"
},
{
"rfilename": "model-00032-of-00131.safetensors"
},
{
"rfilename": "model-00033-of-00131.safetensors"
},
{
"rfilename": "model-00034-of-00131.safetensors"
},
{
"rfilename": "model-00035-of-00131.safetensors"
},
{
"rfilename": "model-00036-of-00131.safetensors"
},
{
"rfilename": "model-00037-of-00131.safetensors"
},
{
"rfilename": "model-00038-of-00131.safetensors"
},
{
"rfilename": "model-00039-of-00131.safetensors"
},
{
"rfilename": "model-00040-of-00131.safetensors"
},
{
"rfilename": "model-00041-of-00131.safetensors"
},
{
"rfilename": "model-00042-of-00131.safetensors"
},
{
"rfilename": "model-00043-of-00131.safetensors"
},
{
"rfilename": "model-00044-of-00131.safetensors"
},
{
"rfilename": "model-00045-of-00131.safetensors"
},
{
"rfilename": "model-00046-of-00131.safetensors"
},
{
"rfilename": "model-00047-of-00131.safetensors"
},
{
"rfilename": "model-00048-of-00131.safetensors"
},
{
"rfilename": "model-00049-of-00131.safetensors"
},
{
"rfilename": "model-00050-of-00131.safetensors"
},
{
"rfilename": "model-00051-of-00131.safetensors"
},
{
"rfilename": "model-00052-of-00131.safetensors"
},
{
"rfilename": "model-00053-of-00131.safetensors"
},
{
"rfilename": "model-00054-of-00131.safetensors"
},
{
"rfilename": "model-00055-of-00131.safetensors"
},
{
"rfilename": "model-00056-of-00131.safetensors"
},
{
"rfilename": "model-00057-of-00131.safetensors"
},
{
"rfilename": "model-00058-of-00131.safetensors"
},
{
"rfilename": "model-00059-of-00131.safetensors"
},
{
"rfilename": "model-00060-of-00131.safetensors"
},
{
"rfilename": "model-00061-of-00131.safetensors"
},
{
"rfilename": "model-00062-of-00131.safetensors"
},
{
"rfilename": "model-00063-of-00131.safetensors"
},
{
"rfilename": "model-00064-of-00131.safetensors"
},
{
"rfilename": "model-00065-of-00131.safetensors"
},
{
"rfilename": "model-00066-of-00131.safetensors"
},
{
"rfilename": "model-00067-of-00131.safetensors"
},
{
"rfilename": "model-00068-of-00131.safetensors"
},
{
"rfilename": "model-00069-of-00131.safetensors"
},
{
"rfilename": "model-00070-of-00131.safetensors"
},
{
"rfilename": "model-00071-of-00131.safetensors"
},
{
"rfilename": "model-00072-of-00131.safetensors"
},
{
"rfilename": "model-00073-of-00131.safetensors"
},
{
"rfilename": "model-00074-of-00131.safetensors"
},
{
"rfilename": "model-00075-of-00131.safetensors"
},
{
"rfilename": "model-00076-of-00131.safetensors"
},
{
"rfilename": "model-00077-of-00131.safetensors"
},
{
"rfilename": "model-00078-of-00131.safetensors"
},
{
"rfilename": "model-00079-of-00131.safetensors"
},
{
"rfilename": "model-00080-of-00131.safetensors"
},
{
"rfilename": "model-00081-of-00131.safetensors"
},
{
"rfilename": "model-00082-of-00131.safetensors"
},
{
"rfilename": "model-00083-of-00131.safetensors"
},
{
"rfilename": "model-00084-of-00131.safetensors"
},
{
"rfilename": "model-00085-of-00131.safetensors"
},
{
"rfilename": "model-00086-of-00131.safetensors"
},
{
"rfilename": "model-00087-of-00131.safetensors"
},
{
"rfilename": "model-00088-of-00131.safetensors"
},
{
"rfilename": "model-00089-of-00131.safetensors"
},
{
"rfilename": "model-00090-of-00131.safetensors"
},
{
"rfilename": "model-00091-of-00131.safetensors"
},
{
"rfilename": "model-00092-of-00131.safetensors"
},
{
"rfilename": "model-00093-of-00131.safetensors"
},
{
"rfilename": "model-00094-of-00131.safetensors"
},
{
"rfilename": "model-00095-of-00131.safetensors"
},
{
"rfilename": "model-00096-of-00131.safetensors"
},
{
"rfilename": "model-00097-of-00131.safetensors"
},
{
"rfilename": "model-00098-of-00131.safetensors"
},
{
"rfilename": "model-00099-of-00131.safetensors"
},
{
"rfilename": "model-00100-of-00131.safetensors"
},
{
"rfilename": "model-00101-of-00131.safetensors"
},
{
"rfilename": "model-00102-of-00131.safetensors"
},
{
"rfilename": "model-00103-of-00131.safetensors"
},
{
"rfilename": "model-00104-of-00131.safetensors"
},
{
"rfilename": "model-00105-of-00131.safetensors"
},
{
"rfilename": "model-00106-of-00131.safetensors"
},
{
"rfilename": "model-00107-of-00131.safetensors"
},
{
"rfilename": "model-00108-of-00131.safetensors"
},
{
"rfilename": "model-00109-of-00131.safetensors"
},
{
"rfilename": "model-00110-of-00131.safetensors"
},
{
"rfilename": "model-00111-of-00131.safetensors"
},
{
"rfilename": "model-00112-of-00131.safetensors"
},
{
"rfilename": "model-00113-of-00131.safetensors"
},
{
"rfilename": "model-00114-of-00131.safetensors"
},
{
"rfilename": "model-00115-of-00131.safetensors"
},
{
"rfilename": "model-00116-of-00131.safetensors"
},
{
"rfilename": "model-00117-of-00131.safetensors"
},
{
"rfilename": "model-00118-of-00131.safetensors"
},
{
"rfilename": "model-00119-of-00131.safetensors"
},
{
"rfilename": "model-00120-of-00131.safetensors"
},
{
"rfilename": "model-00121-of-00131.safetensors"
},
{
"rfilename": "model-00122-of-00131.safetensors"
},
{
"rfilename": "model-00123-of-00131.safetensors"
},
{
"rfilename": "model-00124-of-00131.safetensors"
},
{
"rfilename": "model-00125-of-00131.safetensors"
},
{
"rfilename": "model-00126-of-00131.safetensors"
},
{
"rfilename": "model-00127-of-00131.safetensors"
},
{
"rfilename": "model-00128-of-00131.safetensors"
},
{
"rfilename": "model-00129-of-00131.safetensors"
},
{
"rfilename": "model-00130-of-00131.safetensors"
},
{
"rfilename": "model-00131-of-00131.safetensors"
},
{
"rfilename": "model.safetensors.index.json"
},
{
"rfilename": "preprocessor_config.json"
},
{
"rfilename": "tokenizer.json"
},
{
"rfilename": "tokenizer_config.json"
},
{
"rfilename": "video_preprocessor_config.json"
},
{
"rfilename": "vocab.json"
}
],
"spaces": [
"tardellirs/model-pulse",
"aquanode/gpu-vram-calculator"
],
"tags": [
"safetensors",
"qwen4_exp",
"qwen",
"qwen3.8",
"flash-next",
"fp8",
"uncensored",
"moe",
"text-generation",
"vision",
"vision-language",
"multi-token-prediction",
"conversational",
"base_model:Qwen/Qwen3.8-Flash-Next-FP8",
"base_model:quantized:Qwen/Qwen3.8-Flash-Next-FP8",
"license:apache-2.0",
"region:us"
],
"usedStorage": 262047797522,
"widgetData": [
{
"text": "Hi, what can you help me with?"
},
{
"text": "What is 84 * 3 / 2?"
},
{
"text": "Tell me an interesting fact about the universe!"
},
{
"text": "Explain quantum computing in simple terms."
}
]
} | — | ||||||||
| Downloads downloads not compared | 1503receipt
This source has not kept a receipt for this claim yet. The next update that reads it will. | — | |||||||||
| Gated gated | Hugging Face models | falsereceipt
This source has not kept a receipt for this claim yet. The next update that reads it will. | — | ||||||||
| Licence licence conflict | GGUF quantisations | otherreceipt
What the source handed over{
"_id": "6a93ec390927cf9636c9f574",
"author": "BattleGhost",
"cardData": {
"base_model": "dealignai/Qwen3.8-Flash-Next-UNCENSORED-FP8",
"library_name": "llama.cpp",
"license": "other",
"license_link": "https://huggingface.co/dealignai/Qwen3.8-Flash-Next-UNCENSORED-FP8/blob/main/LICENSE",
"license_name": "qwen-community-license-1.0",
"pipeline_tag": "text-generation",
"tags": [
"gguf",
"qwen",
"qwen4_exp",
"iq2_xxs",
"uncensored",
"abliterated"
]
},
"createdAt": "2026-08-30T08:39:21.000Z",
"downloads": 32460,
"gated": false,
"id": "BattleGhost/Qwen3.8-Flash-Next-UNCENSORED-IQ2_XXS-GGUF",
"lastModified": "2026-08-30T08:52:54.000Z",
"library_name": "llama.cpp",
"likes": 2,
"modelId": "BattleGhost/Qwen3.8-Flash-Next-UNCENSORED-IQ2_XXS-GGUF",
"pipeline_tag": "text-generation",
"private": false,
"sha": "40517194425692dd2eee02ab166fdec57ec759bf",
"siblings": [
{
"rfilename": ".gitattributes"
},
{
"rfilename": "Qwen3.8-Flash-Next-UNCENSORED-IQ2_XXS.gguf"
},
{
"rfilename": "README.md"
}
],
"tags": [
"llama.cpp",
"gguf",
"qwen",
"qwen4_exp",
"iq2_xxs",
"uncensored",
"abliterated",
"text-generation",
"base_model:dealignai/Qwen3.8-Flash-Next-UNCENSORED-FP8",
"base_model:quantized:dealignai/Qwen3.8-Flash-Next-UNCENSORED-FP8",
"license:other",
"endpoints_compatible",
"region:us",
"imatrix",
"conversational"
]
} | — | ||||||||
| Licence licence conflict | Hugging Face models | apache-2.0receipt
This source has not kept a receipt for this claim yet. The next update that reads it will. | — | ||||||||
| Likes likes not compared | GGUF quantisations | 0receipt
What the source handed over{
"_id": "6a93cecb729422ce6c88b315",
"author": "BattleGhost",
"cardData": {
"base_model": "dealignai/Qwen3.8-Flash-Next-UNCENSORED-FP8",
"library_name": "llama.cpp",
"license": "other",
"license_link": "https://huggingface.co/dealignai/Qwen3.8-Flash-Next-UNCENSORED-FP8/blob/main/LICENSE",
"license_name": "qwen-community-license-1.0",
"pipeline_tag": "text-generation",
"tags": [
"gguf",
"qwen",
"qwen4_exp",
"bf16",
"uncensored",
"abliterated"
]
},
"createdAt": "2026-08-30T06:33:47.000Z",
"downloads": 1111,
"gated": false,
"id": "BattleGhost/Qwen3.8-Flash-Next-UNCENSORED-BF16-GGUF",
"lastModified": "2026-08-30T07:10:57.000Z",
"library_name": "llama.cpp",
"likes": 0,
"modelId": "BattleGhost/Qwen3.8-Flash-Next-UNCENSORED-BF16-GGUF",
"pipeline_tag": "text-generation",
"private": false,
"sha": "972429acc83771b7e44837c7d04e50f7694817c7",
"siblings": [
{
"rfilename": ".gitattributes"
},
{
"rfilename": "Qwen3.8-Flash-Next-UNCENSORED-BF16-00001-of-00008.gguf"
},
{
"rfilename": "Qwen3.8-Flash-Next-UNCENSORED-BF16-00002-of-00008.gguf"
},
{
"rfilename": "Qwen3.8-Flash-Next-UNCENSORED-BF16-00003-of-00008.gguf"
},
{
"rfilename": "Qwen3.8-Flash-Next-UNCENSORED-BF16-00004-of-00008.gguf"
},
{
"rfilename": "Qwen3.8-Flash-Next-UNCENSORED-BF16-00005-of-00008.gguf"
},
{
"rfilename": "Qwen3.8-Flash-Next-UNCENSORED-BF16-00006-of-00008.gguf"
},
{
"rfilename": "Qwen3.8-Flash-Next-UNCENSORED-BF16-00007-of-00008.gguf"
},
{
"rfilename": "Qwen3.8-Flash-Next-UNCENSORED-BF16-00008-of-00008.gguf"
},
{
"rfilename": "README.md"
}
],
"tags": [
"llama.cpp",
"gguf",
"qwen",
"qwen4_exp",
"bf16",
"uncensored",
"abliterated",
"text-generation",
"base_model:dealignai/Qwen3.8-Flash-Next-UNCENSORED-FP8",
"base_model:quantized:dealignai/Qwen3.8-Flash-Next-UNCENSORED-FP8",
"license:other",
"endpoints_compatible",
"region:us",
"conversational"
]
} | — | ||||||||
| Likes likes not compared | 2receipt
What the source handed over{
"_id": "6a93ec390927cf9636c9f574",
"author": "BattleGhost",
"cardData": {
"base_model": "dealignai/Qwen3.8-Flash-Next-UNCENSORED-FP8",
"library_name": "llama.cpp",
"license": "other",
"license_link": "https://huggingface.co/dealignai/Qwen3.8-Flash-Next-UNCENSORED-FP8/blob/main/LICENSE",
"license_name": "qwen-community-license-1.0",
"pipeline_tag": "text-generation",
"tags": [
"gguf",
"qwen",
"qwen4_exp",
"iq2_xxs",
"uncensored",
"abliterated"
]
},
"createdAt": "2026-08-30T08:39:21.000Z",
"downloads": 32460,
"gated": false,
"id": "BattleGhost/Qwen3.8-Flash-Next-UNCENSORED-IQ2_XXS-GGUF",
"lastModified": "2026-08-30T08:52:54.000Z",
"library_name": "llama.cpp",
"likes": 2,
"modelId": "BattleGhost/Qwen3.8-Flash-Next-UNCENSORED-IQ2_XXS-GGUF",
"pipeline_tag": "text-generation",
"private": false,
"sha": "40517194425692dd2eee02ab166fdec57ec759bf",
"siblings": [
{
"rfilename": ".gitattributes"
},
{
"rfilename": "Qwen3.8-Flash-Next-UNCENSORED-IQ2_XXS.gguf"
},
{
"rfilename": "README.md"
}
],
"tags": [
"llama.cpp",
"gguf",
"qwen",
"qwen4_exp",
"iq2_xxs",
"uncensored",
"abliterated",
"text-generation",
"base_model:dealignai/Qwen3.8-Flash-Next-UNCENSORED-FP8",
"base_model:quantized:dealignai/Qwen3.8-Flash-Next-UNCENSORED-FP8",
"license:other",
"endpoints_compatible",
"region:us",
"imatrix",
"conversational"
]
} | — | |||||||||
| Likes likes not compared | Hugging Face models | 24receipt
This source has not kept a receipt for this claim yet. The next update that reads it will. | — | ||||||||
| Likes likes not compared | 29receipt
What the source handed over{
"_asked": "dealignai/Qwen3.8-Flash-Next-UNCENSORED-FP8",
"_id": "6a8fb29c94a3c738db5e513e",
"author": "dealignai",
"cardData": {
"base_model": "Qwen/Qwen3.8-Flash-Next-FP8",
"license": "apache-2.0",
"pipeline_tag": "text-generation",
"tags": [
"qwen",
"qwen3.8",
"flash-next",
"fp8",
"uncensored",
"moe",
"text-generation",
"vision",
"vision-language",
"multi-token-prediction"
]
},
"config": {
"architectures": [
"Qwen4ExpForConditionalGeneration"
],
"chat_template_jinja": "{%- set image_count = namespace(value=0) %}\n{%- set video_count = namespace(value=0) %}\n{%- macro render_content(content, do_vision_count, is_system_content=false) %}\n {%- if content is string %}\n {{- content }}\n {%- elif content is iterable and content is not mapping %}\n {%- for item in content %}\n {%- if 'image' in item or 'image_url' in item or item.type == 'image' %}\n {%- if is_system_content %}\n {{- raise_exception('System message cannot contain images.') }}\n {%- endif %}\n {%- if do_vision_count %}\n {%- set image_count.value = image_count.value + 1 %}\n {%- endif %}\n {%- if add_vision_id %}\n {{- 'Picture ' ~ image_count.value ~ ': ' }}\n {%- endif %}\n {{- '<|vision_start|><|image_pad|><|vision_end|>' }}\n {%- elif 'video' in item or item.type == 'video' %}\n {%- if is_system_content %}\n {{- raise_exception('System message cannot contain videos.') }}\n {%- endif %}\n {%- if do_vision_count %}\n {%- set video_count.value = video_count.value + 1 %}\n {%- endif %}\n {%- if add_vision_id %}\n {{- 'Video ' ~ video_count.value ~ ': ' }}\n {%- endif %}\n {{- '<|vision_start|><|video_pad|><|vision_end|>' }}\n {%- elif 'text' in item %}\n {{- item.text }}\n {%- else %}\n {{- raise_exception('Unexpected item type in content.') }}\n {%- endif %}\n {%- endfor %}\n {%- elif content is none or content is undefined %}\n {{- '' }}\n {%- else %}\n {{- raise_exception('Unexpected content type.') }}\n {%- endif %}\n{%- endmacro %}\n{%- if not messages %}\n {{- raise_exception('No messages provided.') }}\n{%- endif %}\n{%- set reasoning_instructions = '' %}\n{%- if enable_thinking is undefined or enable_thinking is true %}\n {%- set resolved_reasoning_effort = reasoning_effort|default('xhigh') %}\n {%- if resolved_reasoning_effort not in ('xhigh', 'medium', 'low') %}\n {{- raise_exception('Unexpected reasoning effort ' ~ reasoning_effort ~ '. Supported types are xhigh (default), medium, and low.') }}\n {%- endif %}\n {%- if resolved_reasoning_effort == 'xhigh' %}\n {%- set reasoning_instructions = 'Reasoning effort is set to xhigh. Please think carefully through the task, validate key assumptions, consider plausible alternatives, and prioritize correctness, consistency, and clarity in the final answer.' %}\n {%- elif resolved_reasoning_effort == 'low' %}\n {%- set reasoning_instructions = 'Reasoning effort is set to low. Keep your thinking brief and focused, moving directly to the conclusion without unnecessary elaboration.' %}\n {%- endif %}\n{%- endif %}\n{%- if tools and tools is iterable and tools is not mapping %}\n {{- '<|im_start|>system\\n' }}\n {%- if reasoning_instructions %}\n {{- reasoning_instructions + '\\n\\n' }}\n {%- endif %}\n {{- \"# Tools\\n\\nYou have access to the following functions:\\n\\n<tools>\" }}\n {%- for tool in tools %}\n {{- \"\\n\" }}\n {{- tool | tojson }}\n {%- endfor %}\n {{- \"\\n</tools>\" }}\n {{- '\\n\\nIf you choose to call a function ONLY reply in the following format with NO suffix:\\n\\n<tool_call>\\n<function=example_function_name>\\n<parameter=example_parameter_1>\\nvalue_1\\n</parameter>\\n<parameter=example_parameter_2>\\nThis is the value for the second parameter\\nthat can span\\nmultiple lines\\n</parameter>\\n</function>\\n</tool_call>\\n\\n<IMPORTANT>\\nReminder:\\n- Function calls MUST follow the specified format: an inner <function=...></function> block must be nested within <tool_call></tool_call> XML tags\\n- Required parameters MUST be specified\\n- You may provide optional reasoning for your function call in natural language BEFORE the function call, but NOT after\\n- If there is no function call available, answer the question like normal with your current knowledge and do not tell the user about function calls\\n</IMPORTANT>' }}\n {%- if messages[0].role == 'system' %}\n {%- set content = render_content(messages[0].content, false, true)|trim %}\n {%- if content %}\n {{- '\\n\\n' + content }}\n {%- endif %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n{%- else %}\n {%- if messages[0].role == 'system' %}\n {%- set content = render_content(messages[0].content, false, true)|trim %}\n {%- if content %}\n {{- '<|im_start|>system\\n' + (reasoning_instructions + '\\n\\n' if reasoning_instructions else '') + content + '<|im_end|>\\n' }}\n {%- elif reasoning_instructions %}\n {{- '<|im_start|>system\\n' + reasoning_instructions + '<|im_end|>\\n' }}\n {%- endif %}\n {%- elif reasoning_instructions %}\n {{- '<|im_start|>system\\n' + reasoning_instructions + '<|im_end|>\\n' }}\n {%- endif %}\n{%- endif %}\n{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}\n{%- for message in messages[::-1] %}\n {%- set index = (messages|length - 1) - loop.index0 %}\n {%- if ns.multi_step_tool and message.role == \"user\" %}\n {%- set content = render_content(message.content, false)|trim %}\n {%- if not(content.startswith('<tool_response>') and content.endswith('</tool_response>')) %}\n {%- set ns.multi_step_tool = false %}\n {%- set ns.last_query_index = index %}\n {%- endif %}\n {%- endif %}\n{%- endfor %}\n{%- if ns.multi_step_tool %}\n {{- raise_exception('No user query found in messages.') }}\n{%- endif %}\n{%- for message in messages %}\n {%- set content = render_content(message.content, true)|trim %}\n {%- if message.role == \"system\" %}\n {%- if not loop.first %}\n {{- raise_exception('System message must be at the beginning.') }}\n {%- endif %}\n {%- elif message.role == \"user\" %}\n {{- '<|im_start|>' + message.role + '\\n' + content + '<|im_end|>' + '\\n' }}\n {%- elif message.role == \"assistant\" %}\n {%- set reasoning_content = '' %}\n {%- if message.reasoning_content is string %}\n {%- set reasoning_content = message.reasoning_content %}\n {%- endif %}\n {%- set reasoning_content = reasoning_content|trim %}\n {%- if preserve_thinking is undefined or preserve_thinking is true or loop.index0 > ns.last_query_index %}\n {{- '<|im_start|>' + message.role + '\\n<think>\\n' + reasoning_content + '\\n</think>\\n\\n' + content }}\n {%- else %}\n {{- '<|im_start|>' + message.role + '\\n' + content }}\n {%- endif %}\n {%- if message.tool_calls and message.tool_calls is iterable and message.tool_calls is not mapping %}\n {%- for tool_call in message.tool_calls %}\n {%- if tool_call.function is defined %}\n {%- set tool_call = tool_call.function %}\n {%- endif %}\n {%- if loop.first %}\n {%- if content|trim %}\n {{- '\\n\\n<tool_call>\\n<function=' + tool_call.name + '>\\n' }}\n {%- else %}\n {{- '<tool_call>\\n<function=' + tool_call.name + '>\\n' }}\n {%- endif %}\n {%- else %}\n {{- '\\n<tool_call>\\n<function=' + tool_call.name + '>\\n' }}\n {%- endif %}\n {%- if tool_call.arguments is defined and tool_call.arguments != '' %}\n {%- for args_name, args_value in tool_call.arguments|items %}\n {{- '<parameter=' + args_name + '>\\n' }}\n {%- set args_value = args_value | string if args_value is string else args_value | tojson | safe %}\n {{- args_value }}\n {{- '\\n</parameter>\\n' }}\n {%- endfor %}\n {%- endif %}\n {{- '</function>\\n</tool_call>' }}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"tool\" %}\n {%- if loop.previtem and loop.previtem.role != \"tool\" %}\n {{- '<|im_start|>user' }}\n {%- endif %}\n {{- '\\n<tool_response>\\n' }}\n {{- content }}\n {{- '\\n</tool_response>' }}\n {%- if not loop.last and loop.nextitem.role != \"tool\" %}\n {{- '<|im_end|>\\n' }}\n {%- elif loop.last %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n {%- else %}\n {{- raise_exception('Unexpected message role.') }}\n {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n {{- '<|im_start|>assistant\\n' }}\n {%- if enable_thinking is defined and enable_thinking is false %}\n {{- '<think>\\n\\n</think>\\n\\n' }}\n {%- else %}\n {{- '<think>\\n' }}\n {%- endif %}\n{%- endif %}",
"model_type": "qwen4_exp",
"quantization_config": {
"modules_to_not_convert": [
"lm_head",
"model.language_model.embed_tokens",
"model.language_model.hyper_connection_mixer.input_mix_weight_down",
"model.language_model.hyper_connection_mixer.input_mix_weight_up",
"model.language_model.layers.0.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.0.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.0.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.0.linear_attn.conv1d",
"model.language_model.layers.0.linear_attn.in_proj_a",
"model.language_model.layers.0.linear_attn.in_proj_b",
"model.language_model.layers.0.linear_attn.in_proj_qkv",
"model.language_model.layers.0.linear_attn.in_proj_z",
"model.language_model.layers.0.linear_attn.out_proj",
"model.language_model.layers.0.mlp.gate",
"model.language_model.layers.0.mlp.shared_expert.down_proj",
"model.language_model.layers.0.mlp.shared_expert.gate_proj",
"model.language_model.layers.0.mlp.shared_expert.up_proj",
"model.language_model.layers.0.mlp.shared_expert_gate",
"model.language_model.layers.0.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.0.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.0.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.1.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.1.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.1.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.1.linear_attn.conv1d",
"model.language_model.layers.1.linear_attn.in_proj_a",
"model.language_model.layers.1.linear_attn.in_proj_b",
"model.language_model.layers.1.linear_attn.in_proj_qkv",
"model.language_model.layers.1.linear_attn.in_proj_z",
"model.language_model.layers.1.linear_attn.out_proj",
"model.language_model.layers.1.mlp.gate",
"model.language_model.layers.1.mlp.shared_expert.down_proj",
"model.language_model.layers.1.mlp.shared_expert.gate_proj",
"model.language_model.layers.1.mlp.shared_expert.up_proj",
"model.language_model.layers.1.mlp.shared_expert_gate",
"model.language_model.layers.1.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.1.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.1.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.1.ple.conv1d",
"model.language_model.layers.1.ple.key_proj",
"model.language_model.layers.1.ple.value_proj",
"model.language_model.layers.10.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.10.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.10.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.10.linear_attn.conv1d",
"model.language_model.layers.10.linear_attn.in_proj_a",
"model.language_model.layers.10.linear_attn.in_proj_b",
"model.language_model.layers.10.linear_attn.in_proj_qkv",
"model.language_model.layers.10.linear_attn.in_proj_z",
"model.language_model.layers.10.linear_attn.out_proj",
"model.language_model.layers.10.mlp.gate",
"model.language_model.layers.10.mlp.shared_expert.down_proj",
"model.language_model.layers.10.mlp.shared_expert.gate_proj",
"model.language_model.layers.10.mlp.shared_expert.up_proj",
"model.language_model.layers.10.mlp.shared_expert_gate",
"model.language_model.layers.10.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.10.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.10.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.11.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.11.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.11.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.11.mlp.gate",
"model.language_model.layers.11.mlp.shared_expert.down_proj",
"model.language_model.layers.11.mlp.shared_expert.gate_proj",
"model.language_model.layers.11.mlp.shared_expert.up_proj",
"model.language_model.layers.11.mlp.shared_expert_gate",
"model.language_model.layers.11.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.11.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.11.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.11.self_attn.indexer.index_qk_proj",
"model.language_model.layers.11.self_attn.k_proj",
"model.language_model.layers.11.self_attn.o_proj",
"model.language_model.layers.11.self_attn.q_proj",
"model.language_model.layers.11.self_attn.v_proj",
"model.language_model.layers.12.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.12.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.12.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.12.linear_attn.conv1d",
"model.language_model.layers.12.linear_attn.in_proj_a",
"model.language_model.layers.12.linear_attn.in_proj_b",
"model.language_model.layers.12.linear_attn.in_proj_qkv",
"model.language_model.layers.12.linear_attn.in_proj_z",
"model.language_model.layers.12.linear_attn.out_proj",
"model.language_model.layers.12.mlp.gate",
"model.language_model.layers.12.mlp.shared_expert.down_proj",
"model.language_model.layers.12.mlp.shared_expert.gate_proj",
"model.language_model.layers.12.mlp.shared_expert.up_proj",
"model.language_model.layers.12.mlp.shared_expert_gate",
"model.language_model.layers.12.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.12.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.12.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.13.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.13.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.13.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.13.linear_attn.conv1d",
"model.language_model.layers.13.linear_attn.in_proj_a",
"model.language_model.layers.13.linear_attn.in_proj_b",
"model.language_model.layers.13.linear_attn.in_proj_qkv",
"model.language_model.layers.13.linear_attn.in_proj_z",
"model.language_model.layers.13.linear_attn.out_proj",
"model.language_model.layers.13.mlp.gate",
"model.language_model.layers.13.mlp.shared_expert.down_proj",
"model.language_model.layers.13.mlp.shared_expert.gate_proj",
"model.language_model.layers.13.mlp.shared_expert.up_proj",
"model.language_model.layers.13.mlp.shared_expert_gate",
"model.language_model.layers.13.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.13.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.13.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.14.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.14.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.14.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.14.linear_attn.conv1d",
"model.language_model.layers.14.linear_attn.in_proj_a",
"model.language_model.layers.14.linear_attn.in_proj_b",
"model.language_model.layers.14.linear_attn.in_proj_qkv",
"model.language_model.layers.14.linear_attn.in_proj_z",
"model.language_model.layers.14.linear_attn.out_proj",
"model.language_model.layers.14.mlp.gate",
"model.language_model.layers.14.mlp.shared_expert.down_proj",
"model.language_model.layers.14.mlp.shared_expert.gate_proj",
"model.language_model.layers.14.mlp.shared_expert.up_proj",
"model.language_model.layers.14.mlp.shared_expert_gate",
"model.language_model.layers.14.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.14.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.14.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.15.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.15.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.15.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.15.mlp.gate",
"model.language_model.layers.15.mlp.shared_expert.down_proj",
"model.language_model.layers.15.mlp.shared_expert.gate_proj",
"model.language_model.layers.15.mlp.shared_expert.up_proj",
"model.language_model.layers.15.mlp.shared_expert_gate",
"model.language_model.layers.15.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.15.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.15.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.15.self_attn.indexer.index_qk_proj",
"model.language_model.layers.15.self_attn.k_proj",
"model.language_model.layers.15.self_attn.o_proj",
"model.language_model.layers.15.self_attn.q_proj",
"model.language_model.layers.15.self_attn.v_proj",
"model.language_model.layers.16.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.16.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.16.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.16.linear_attn.conv1d",
"model.language_model.layers.16.linear_attn.in_proj_a",
"model.language_model.layers.16.linear_attn.in_proj_b",
"model.language_model.layers.16.linear_attn.in_proj_qkv",
"model.language_model.layers.16.linear_attn.in_proj_z",
"model.language_model.layers.16.linear_attn.out_proj",
"model.language_model.layers.16.mlp.gate",
"model.language_model.layers.16.mlp.shared_expert.down_proj",
"model.language_model.layers.16.mlp.shared_expert.gate_proj",
"model.language_model.layers.16.mlp.shared_expert.up_proj",
"model.language_model.layers.16.mlp.shared_expert_gate",
"model.language_model.layers.16.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.16.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.16.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.17.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.17.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.17.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.17.linear_attn.conv1d",
"model.language_model.layers.17.linear_attn.in_proj_a",
"model.language_model.layers.17.linear_attn.in_proj_b",
"model.language_model.layers.17.linear_attn.in_proj_qkv",
"model.language_model.layers.17.linear_attn.in_proj_z",
"model.language_model.layers.17.linear_attn.out_proj",
"model.language_model.layers.17.mlp.gate",
"model.language_model.layers.17.mlp.shared_expert.down_proj",
"model.language_model.layers.17.mlp.shared_expert.gate_proj",
"model.language_model.layers.17.mlp.shared_expert.up_proj",
"model.language_model.layers.17.mlp.shared_expert_gate",
"model.language_model.layers.17.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.17.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.17.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.18.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.18.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.18.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.18.linear_attn.conv1d",
"model.language_model.layers.18.linear_attn.in_proj_a",
"model.language_model.layers.18.linear_attn.in_proj_b",
"model.language_model.layers.18.linear_attn.in_proj_qkv",
"model.language_model.layers.18.linear_attn.in_proj_z",
"model.language_model.layers.18.linear_attn.out_proj",
"model.language_model.layers.18.mlp.gate",
"model.language_model.layers.18.mlp.shared_expert.down_proj",
"model.language_model.layers.18.mlp.shared_expert.gate_proj",
"model.language_model.layers.18.mlp.shared_expert.up_proj",
"model.language_model.layers.18.mlp.shared_expert_gate",
"model.language_model.layers.18.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.18.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.18.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.19.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.19.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.19.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.19.mlp.gate",
"model.language_model.layers.19.mlp.shared_expert.down_proj",
"model.language_model.layers.19.mlp.shared_expert.gate_proj",
"model.language_model.layers.19.mlp.shared_expert.up_proj",
"model.language_model.layers.19.mlp.shared_expert_gate",
"model.language_model.layers.19.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.19.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.19.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.19.self_attn.indexer.index_qk_proj",
"model.language_model.layers.19.self_attn.k_proj",
"model.language_model.layers.19.self_attn.o_proj",
"model.language_model.layers.19.self_attn.q_proj",
"model.language_model.layers.19.self_attn.v_proj",
"model.language_model.layers.2.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.2.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.2.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.2.linear_attn.conv1d",
"model.language_model.layers.2.linear_attn.in_proj_a",
"model.language_model.layers.2.linear_attn.in_proj_b",
"model.language_model.layers.2.linear_attn.in_proj_qkv",
"model.language_model.layers.2.linear_attn.in_proj_z",
"model.language_model.layers.2.linear_attn.out_proj",
"model.language_model.layers.2.mlp.gate",
"model.language_model.layers.2.mlp.shared_expert.down_proj",
"model.language_model.layers.2.mlp.shared_expert.gate_proj",
"model.language_model.layers.2.mlp.shared_expert.up_proj",
"model.language_model.layers.2.mlp.shared_expert_gate",
"model.language_model.layers.2.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.2.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.2.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.20.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.20.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.20.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.20.linear_attn.conv1d",
"model.language_model.layers.20.linear_attn.in_proj_a",
"model.language_model.layers.20.linear_attn.in_proj_b",
"model.language_model.layers.20.linear_attn.in_proj_qkv",
"model.language_model.layers.20.linear_attn.in_proj_z",
"model.language_model.layers.20.linear_attn.out_proj",
"model.language_model.layers.20.mlp.gate",
"model.language_model.layers.20.mlp.shared_expert.down_proj",
"model.language_model.layers.20.mlp.shared_expert.gate_proj",
"model.language_model.layers.20.mlp.shared_expert.up_proj",
"model.language_model.layers.20.mlp.shared_expert_gate",
"model.language_model.layers.20.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.20.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.20.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.21.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.21.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.21.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.21.linear_attn.conv1d",
"model.language_model.layers.21.linear_attn.in_proj_a",
"model.language_model.layers.21.linear_attn.in_proj_b",
"model.language_model.layers.21.linear_attn.in_proj_qkv",
"model.language_model.layers.21.linear_attn.in_proj_z",
"model.language_model.layers.21.linear_attn.out_proj",
"model.language_model.layers.21.mlp.gate",
"model.language_model.layers.21.mlp.shared_expert.down_proj",
"model.language_model.layers.21.mlp.shared_expert.gate_proj",
"model.language_model.layers.21.mlp.shared_expert.up_proj",
"model.language_model.layers.21.mlp.shared_expert_gate",
"model.language_model.layers.21.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.21.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.21.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.22.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.22.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.22.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.22.linear_attn.conv1d",
"model.language_model.layers.22.linear_attn.in_proj_a",
"model.language_model.layers.22.linear_attn.in_proj_b",
"model.language_model.layers.22.linear_attn.in_proj_qkv",
"model.language_model.layers.22.linear_attn.in_proj_z",
"model.language_model.layers.22.linear_attn.out_proj",
"model.language_model.layers.22.mlp.gate",
"model.language_model.layers.22.mlp.shared_expert.down_proj",
"model.language_model.layers.22.mlp.shared_expert.gate_proj",
"model.language_model.layers.22.mlp.shared_expert.up_proj",
"model.language_model.layers.22.mlp.shared_expert_gate",
"model.language_model.layers.22.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.22.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.22.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.23.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.23.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.23.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.23.mlp.gate",
"model.language_model.layers.23.mlp.shared_expert.down_proj",
"model.language_model.layers.23.mlp.shared_expert.gate_proj",
"model.language_model.layers.23.mlp.shared_expert.up_proj",
"model.language_model.layers.23.mlp.shared_expert_gate",
"model.language_model.layers.23.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.23.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.23.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.23.self_attn.indexer.index_qk_proj",
"model.language_model.layers.23.self_attn.k_proj",
"model.language_model.layers.23.self_attn.o_proj",
"model.language_model.layers.23.self_attn.q_proj",
"model.language_model.layers.23.self_attn.v_proj",
"model.language_model.layers.24.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.24.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.24.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.24.linear_attn.conv1d",
"model.language_model.layers.24.linear_attn.in_proj_a",
"model.language_model.layers.24.linear_attn.in_proj_b",
"model.language_model.layers.24.linear_attn.in_proj_qkv",
"model.language_model.layers.24.linear_attn.in_proj_z",
"model.language_model.layers.24.linear_attn.out_proj",
"model.language_model.layers.24.mlp.gate",
"model.language_model.layers.24.mlp.shared_expert.down_proj",
"model.language_model.layers.24.mlp.shared_expert.gate_proj",
"model.language_model.layers.24.mlp.shared_expert.up_proj",
"model.language_model.layers.24.mlp.shared_expert_gate",
"model.language_model.layers.24.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.24.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.24.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.25.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.25.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.25.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.25.linear_attn.conv1d",
"model.language_model.layers.25.linear_attn.in_proj_a",
"model.language_model.layers.25.linear_attn.in_proj_b",
"model.language_model.layers.25.linear_attn.in_proj_qkv",
"model.language_model.layers.25.linear_attn.in_proj_z",
"model.language_model.layers.25.linear_attn.out_proj",
"model.language_model.layers.25.mlp.gate",
"model.language_model.layers.25.mlp.shared_expert.down_proj",
"model.language_model.layers.25.mlp.shared_expert.gate_proj",
"model.language_model.layers.25.mlp.shared_expert.up_proj",
"model.language_model.layers.25.mlp.shared_expert_gate",
"model.language_model.layers.25.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.25.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.25.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.26.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.26.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.26.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.26.linear_attn.conv1d",
"model.language_model.layers.26.linear_attn.in_proj_a",
"model.language_model.layers.26.linear_attn.in_proj_b",
"model.language_model.layers.26.linear_attn.in_proj_qkv",
"model.language_model.layers.26.linear_attn.in_proj_z",
"model.language_model.layers.26.linear_attn.out_proj",
"model.language_model.layers.26.mlp.gate",
"model.language_model.layers.26.mlp.shared_expert.down_proj",
"model.language_model.layers.26.mlp.shared_expert.gate_proj",
"model.language_model.layers.26.mlp.shared_expert.up_proj",
"model.language_model.layers.26.mlp.shared_expert_gate",
"model.language_model.layers.26.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.26.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.26.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.27.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.27.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.27.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.27.mlp.gate",
"model.language_model.layers.27.mlp.shared_expert.down_proj",
"model.language_model.layers.27.mlp.shared_expert.gate_proj",
"model.language_model.layers.27.mlp.shared_expert.up_proj",
"model.language_model.layers.27.mlp.shared_expert_gate",
"model.language_model.layers.27.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.27.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.27.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.27.self_attn.indexer.index_qk_proj",
"model.language_model.layers.27.self_attn.k_proj",
"model.language_model.layers.27.self_attn.o_proj",
"model.language_model.layers.27.self_attn.q_proj",
"model.language_model.layers.27.self_attn.v_proj",
"model.language_model.layers.28.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.28.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.28.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.28.linear_attn.conv1d",
"model.language_model.layers.28.linear_attn.in_proj_a",
"model.language_model.layers.28.linear_attn.in_proj_b",
"model.language_model.layers.28.linear_attn.in_proj_qkv",
"model.language_model.layers.28.linear_attn.in_proj_z",
"model.language_model.layers.28.linear_attn.out_proj",
"model.language_model.layers.28.mlp.gate",
"model.language_model.layers.28.mlp.shared_expert.down_proj",
"model.language_model.layers.28.mlp.shared_expert.gate_proj",
"model.language_model.layers.28.mlp.shared_expert.up_proj",
"model.language_model.layers.28.mlp.shared_expert_gate",
"model.language_model.layers.28.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.28.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.28.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.29.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.29.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.29.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.29.linear_attn.conv1d",
"model.language_model.layers.29.linear_attn.in_proj_a",
"model.language_model.layers.29.linear_attn.in_proj_b",
"model.language_model.layers.29.linear_attn.in_proj_qkv",
"model.language_model.layers.29.linear_attn.in_proj_z",
"model.language_model.layers.29.linear_attn.out_proj",
"model.language_model.layers.29.mlp.gate",
"model.language_model.layers.29.mlp.shared_expert.down_proj",
"model.language_model.layers.29.mlp.shared_expert.gate_proj",
"model.language_model.layers.29.mlp.shared_expert.up_proj",
"model.language_model.layers.29.mlp.shared_expert_gate",
"model.language_model.layers.29.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.29.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.29.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.3.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.3.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.3.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.3.mlp.gate",
"model.language_model.layers.3.mlp.shared_expert.down_proj",
"model.language_model.layers.3.mlp.shared_expert.gate_proj",
"model.language_model.layers.3.mlp.shared_expert.up_proj",
"model.language_model.layers.3.mlp.shared_expert_gate",
"model.language_model.layers.3.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.3.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.3.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.3.self_attn.indexer.index_qk_proj",
"model.language_model.layers.3.self_attn.k_proj",
"model.language_model.layers.3.self_attn.o_proj",
"model.language_model.layers.3.self_attn.q_proj",
"model.language_model.layers.3.self_attn.v_proj",
"model.language_model.layers.30.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.30.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.30.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.30.linear_attn.conv1d",
"model.language_model.layers.30.linear_attn.in_proj_a",
"model.language_model.layers.30.linear_attn.in_proj_b",
"model.language_model.layers.30.linear_attn.in_proj_qkv",
"model.language_model.layers.30.linear_attn.in_proj_z",
"model.language_model.layers.30.linear_attn.out_proj",
"model.language_model.layers.30.mlp.gate",
"model.language_model.layers.30.mlp.shared_expert.down_proj",
"model.language_model.layers.30.mlp.shared_expert.gate_proj",
"model.language_model.layers.30.mlp.shared_expert.up_proj",
"model.language_model.layers.30.mlp.shared_expert_gate",
"model.language_model.layers.30.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.30.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.30.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.31.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.31.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.31.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.31.mlp.gate",
"model.language_model.layers.31.mlp.shared_expert.down_proj",
"model.language_model.layers.31.mlp.shared_expert.gate_proj",
"model.language_model.layers.31.mlp.shared_expert.up_proj",
"model.language_model.layers.31.mlp.shared_expert_gate",
"model.language_model.layers.31.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.31.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.31.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.31.self_attn.indexer.index_qk_proj",
"model.language_model.layers.31.self_attn.k_proj",
"model.language_model.layers.31.self_attn.o_proj",
"model.language_model.layers.31.self_attn.q_proj",
"model.language_model.layers.31.self_attn.v_proj",
"model.language_model.layers.32.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.32.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.32.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.32.linear_attn.conv1d",
"model.language_model.layers.32.linear_attn.in_proj_a",
"model.language_model.layers.32.linear_attn.in_proj_b",
"model.language_model.layers.32.linear_attn.in_proj_qkv",
"model.language_model.layers.32.linear_attn.in_proj_z",
"model.language_model.layers.32.linear_attn.out_proj",
"model.language_model.layers.32.mlp.gate",
"model.language_model.layers.32.mlp.shared_expert.down_proj",
"model.language_model.layers.32.mlp.shared_expert.gate_proj",
"model.language_model.layers.32.mlp.shared_expert.up_proj",
"model.language_model.layers.32.mlp.shared_expert_gate",
"model.language_model.layers.32.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.32.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.32.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.33.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.33.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.33.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.33.linear_attn.conv1d",
"model.language_model.layers.33.linear_attn.in_proj_a",
"model.language_model.layers.33.linear_attn.in_proj_b",
"model.language_model.layers.33.linear_attn.in_proj_qkv",
"model.language_model.layers.33.linear_attn.in_proj_z",
"model.language_model.layers.33.linear_attn.out_proj",
"model.language_model.layers.33.mlp.gate",
"model.language_model.layers.33.mlp.shared_expert.down_proj",
"model.language_model.layers.33.mlp.shared_expert.gate_proj",
"model.language_model.layers.33.mlp.shared_expert.up_proj",
"model.language_model.layers.33.mlp.shared_expert_gate",
"model.language_model.layers.33.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.33.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.33.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.34.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.34.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.34.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.34.linear_attn.conv1d",
"model.language_model.layers.34.linear_attn.in_proj_a",
"model.language_model.layers.34.linear_attn.in_proj_b",
"model.language_model.layers.34.linear_attn.in_proj_qkv",
"model.language_model.layers.34.linear_attn.in_proj_z",
"model.language_model.layers.34.linear_attn.out_proj",
"model.language_model.layers.34.mlp.gate",
"model.language_model.layers.34.mlp.shared_expert.down_proj",
"model.language_model.layers.34.mlp.shared_expert.gate_proj",
"model.language_model.layers.34.mlp.shared_expert.up_proj",
"model.language_model.layers.34.mlp.shared_expert_gate",
"model.language_model.layers.34.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.34.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.34.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.35.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.35.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.35.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.35.mlp.gate",
"model.language_model.layers.35.mlp.shared_expert.down_proj",
"model.language_model.layers.35.mlp.shared_expert.gate_proj",
"model.language_model.layers.35.mlp.shared_expert.up_proj",
"model.language_model.layers.35.mlp.shared_expert_gate",
"model.language_model.layers.35.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.35.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.35.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.35.self_attn.indexer.index_qk_proj",
"model.language_model.layers.35.self_attn.k_proj",
"model.language_model.layers.35.self_attn.o_proj",
"model.language_model.layers.35.self_attn.q_proj",
"model.language_model.layers.35.self_attn.v_proj",
"model.language_model.layers.36.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.36.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.36.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.36.linear_attn.conv1d",
"model.language_model.layers.36.linear_attn.in_proj_a",
"model.language_model.layers.36.linear_attn.in_proj_b",
"model.language_model.layers.36.linear_attn.in_proj_qkv",
"model.language_model.layers.36.linear_attn.in_proj_z",
"model.language_model.layers.36.linear_attn.out_proj",
"model.language_model.layers.36.mlp.gate",
"model.language_model.layers.36.mlp.shared_expert.down_proj",
"model.language_model.layers.36.mlp.shared_expert.gate_proj",
"model.language_model.layers.36.mlp.shared_expert.up_proj",
"model.language_model.layers.36.mlp.shared_expert_gate",
"model.language_model.layers.36.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.36.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.36.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.37.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.37.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.37.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.37.linear_attn.conv1d",
"model.language_model.layers.37.linear_attn.in_proj_a",
"model.language_model.layers.37.linear_attn.in_proj_b",
"model.language_model.layers.37.linear_attn.in_proj_qkv",
"model.language_model.layers.37.linear_attn.in_proj_z",
"model.language_model.layers.37.linear_attn.out_proj",
"model.language_model.layers.37.mlp.gate",
"model.language_model.layers.37.mlp.shared_expert.down_proj",
"model.language_model.layers.37.mlp.shared_expert.gate_proj",
"model.language_model.layers.37.mlp.shared_expert.up_proj",
"model.language_model.layers.37.mlp.shared_expert_gate",
"model.language_model.layers.37.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.37.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.37.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.38.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.38.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.38.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.38.linear_attn.conv1d",
"model.language_model.layers.38.linear_attn.in_proj_a",
"model.language_model.layers.38.linear_attn.in_proj_b",
"model.language_model.layers.38.linear_attn.in_proj_qkv",
"model.language_model.layers.38.linear_attn.in_proj_z",
"model.language_model.layers.38.linear_attn.out_proj",
"model.language_model.layers.38.mlp.gate",
"model.language_model.layers.38.mlp.shared_expert.down_proj",
"model.language_model.layers.38.mlp.shared_expert.gate_proj",
"model.language_model.layers.38.mlp.shared_expert.up_proj",
"model.language_model.layers.38.mlp.shared_expert_gate",
"model.language_model.layers.38.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.38.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.38.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.39.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.39.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.39.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.39.mlp.gate",
"model.language_model.layers.39.mlp.shared_expert.down_proj",
"model.language_model.layers.39.mlp.shared_expert.gate_proj",
"model.language_model.layers.39.mlp.shared_expert.up_proj",
"model.language_model.layers.39.mlp.shared_expert_gate",
"model.language_model.layers.39.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.39.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.39.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.39.self_attn.indexer.index_qk_proj",
"model.language_model.layers.39.self_attn.k_proj",
"model.language_model.layers.39.self_attn.o_proj",
"model.language_model.layers.39.self_attn.q_proj",
"model.language_model.layers.39.self_attn.v_proj",
"model.language_model.layers.4.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.4.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.4.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.4.linear_attn.conv1d",
"model.language_model.layers.4.linear_attn.in_proj_a",
"model.language_model.layers.4.linear_attn.in_proj_b",
"model.language_model.layers.4.linear_attn.in_proj_qkv",
"model.language_model.layers.4.linear_attn.in_proj_z",
"model.language_model.layers.4.linear_attn.out_proj",
"model.language_model.layers.4.mlp.gate",
"model.language_model.layers.4.mlp.shared_expert.down_proj",
"model.language_model.layers.4.mlp.shared_expert.gate_proj",
"model.language_model.layers.4.mlp.shared_expert.up_proj",
"model.language_model.layers.4.mlp.shared_expert_gate",
"model.language_model.layers.4.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.4.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.4.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.40.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.40.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.40.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.40.linear_attn.conv1d",
"model.language_model.layers.40.linear_attn.in_proj_a",
"model.language_model.layers.40.linear_attn.in_proj_b",
"model.language_model.layers.40.linear_attn.in_proj_qkv",
"model.language_model.layers.40.linear_attn.in_proj_z",
"model.language_model.layers.40.linear_attn.out_proj",
"model.language_model.layers.40.mlp.gate",
"model.language_model.layers.40.mlp.shared_expert.down_proj",
"model.language_model.layers.40.mlp.shared_expert.gate_proj",
"model.language_model.layers.40.mlp.shared_expert.up_proj",
"model.language_model.layers.40.mlp.shared_expert_gate",
"model.language_model.layers.40.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.40.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.40.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.41.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.41.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.41.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.41.linear_attn.conv1d",
"model.language_model.layers.41.linear_attn.in_proj_a",
"model.language_model.layers.41.linear_attn.in_proj_b",
"model.language_model.layers.41.linear_attn.in_proj_qkv",
"model.language_model.layers.41.linear_attn.in_proj_z",
"model.language_model.layers.41.linear_attn.out_proj",
"model.language_model.layers.41.mlp.gate",
"model.language_model.layers.41.mlp.shared_expert.down_proj",
"model.language_model.layers.41.mlp.shared_expert.gate_proj",
"model.language_model.layers.41.mlp.shared_expert.up_proj",
"model.language_model.layers.41.mlp.shared_expert_gate",
"model.language_model.layers.41.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.41.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.41.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.42.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.42.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.42.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.42.linear_attn.conv1d",
"model.language_model.layers.42.linear_attn.in_proj_a",
"model.language_model.layers.42.linear_attn.in_proj_b",
"model.language_model.layers.42.linear_attn.in_proj_qkv",
"model.language_model.layers.42.linear_attn.in_proj_z",
"model.language_model.layers.42.linear_attn.out_proj",
"model.language_model.layers.42.mlp.gate",
"model.language_model.layers.42.mlp.shared_expert.down_proj",
"model.language_model.layers.42.mlp.shared_expert.gate_proj",
"model.language_model.layers.42.mlp.shared_expert.up_proj",
"model.language_model.layers.42.mlp.shared_expert_gate",
"model.language_model.layers.42.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.42.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.42.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.43.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.43.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.43.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.43.mlp.gate",
"model.language_model.layers.43.mlp.shared_expert.down_proj",
"model.language_model.layers.43.mlp.shared_expert.gate_proj",
"model.language_model.layers.43.mlp.shared_expert.up_proj",
"model.language_model.layers.43.mlp.shared_expert_gate",
"model.language_model.layers.43.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.43.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.43.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.43.self_attn.indexer.index_qk_proj",
"model.language_model.layers.43.self_attn.k_proj",
"model.language_model.layers.43.self_attn.o_proj",
"model.language_model.layers.43.self_attn.q_proj",
"model.language_model.layers.43.self_attn.v_proj",
"model.language_model.layers.44.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.44.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.44.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.44.linear_attn.conv1d",
"model.language_model.layers.44.linear_attn.in_proj_a",
"model.language_model.layers.44.linear_attn.in_proj_b",
"model.language_model.layers.44.linear_attn.in_proj_qkv",
"model.language_model.layers.44.linear_attn.in_proj_z",
"model.language_model.layers.44.linear_attn.out_proj",
"model.language_model.layers.44.mlp.gate",
"model.language_model.layers.44.mlp.shared_expert.down_proj",
"model.language_model.layers.44.mlp.shared_expert.gate_proj",
"model.language_model.layers.44.mlp.shared_expert.up_proj",
"model.language_model.layers.44.mlp.shared_expert_gate",
"model.language_model.layers.44.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.44.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.44.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.45.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.45.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.45.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.45.linear_attn.conv1d",
"model.language_model.layers.45.linear_attn.in_proj_a",
"model.language_model.layers.45.linear_attn.in_proj_b",
"model.language_model.layers.45.linear_attn.in_proj_qkv",
"model.language_model.layers.45.linear_attn.in_proj_z",
"model.language_model.layers.45.linear_attn.out_proj",
"model.language_model.layers.45.mlp.gate",
"model.language_model.layers.45.mlp.shared_expert.down_proj",
"model.language_model.layers.45.mlp.shared_expert.gate_proj",
"model.language_model.layers.45.mlp.shared_expert.up_proj",
"model.language_model.layers.45.mlp.shared_expert_gate",
"model.language_model.layers.45.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.45.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.45.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.46.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.46.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.46.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.46.linear_attn.conv1d",
"model.language_model.layers.46.linear_attn.in_proj_a",
"model.language_model.layers.46.linear_attn.in_proj_b",
"model.language_model.layers.46.linear_attn.in_proj_qkv",
"model.language_model.layers.46.linear_attn.in_proj_z",
"model.language_model.layers.46.linear_attn.out_proj",
"model.language_model.layers.46.mlp.gate",
"model.language_model.layers.46.mlp.shared_expert.down_proj",
"model.language_model.layers.46.mlp.shared_expert.gate_proj",
"model.language_model.layers.46.mlp.shared_expert.up_proj",
"model.language_model.layers.46.mlp.shared_expert_gate",
"model.language_model.layers.46.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.46.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.46.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.47.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.47.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.47.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.47.mlp.gate",
"model.language_model.layers.47.mlp.shared_expert.down_proj",
"model.language_model.layers.47.mlp.shared_expert.gate_proj",
"model.language_model.layers.47.mlp.shared_expert.up_proj",
"model.language_model.layers.47.mlp.shared_expert_gate",
"model.language_model.layers.47.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.47.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.47.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.47.self_attn.indexer.index_qk_proj",
"model.language_model.layers.47.self_attn.k_proj",
"model.language_model.layers.47.self_attn.o_proj",
"model.language_model.layers.47.self_attn.q_proj",
"model.language_model.layers.47.self_attn.v_proj",
"model.language_model.layers.5.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.5.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.5.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.5.linear_attn.conv1d",
"model.language_model.layers.5.linear_attn.in_proj_a",
"model.language_model.layers.5.linear_attn.in_proj_b",
"model.language_model.layers.5.linear_attn.in_proj_qkv",
"model.language_model.layers.5.linear_attn.in_proj_z",
"model.language_model.layers.5.linear_attn.out_proj",
"model.language_model.layers.5.mlp.gate",
"model.language_model.layers.5.mlp.shared_expert.down_proj",
"model.language_model.layers.5.mlp.shared_expert.gate_proj",
"model.language_model.layers.5.mlp.shared_expert.up_proj",
"model.language_model.layers.5.mlp.shared_expert_gate",
"model.language_model.layers.5.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.5.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.5.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.6.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.6.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.6.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.6.linear_attn.conv1d",
"model.language_model.layers.6.linear_attn.in_proj_a",
"model.language_model.layers.6.linear_attn.in_proj_b",
"model.language_model.layers.6.linear_attn.in_proj_qkv",
"model.language_model.layers.6.linear_attn.in_proj_z",
"model.language_model.layers.6.linear_attn.out_proj",
"model.language_model.layers.6.mlp.gate",
"model.language_model.layers.6.mlp.shared_expert.down_proj",
"model.language_model.layers.6.mlp.shared_expert.gate_proj",
"model.language_model.layers.6.mlp.shared_expert.up_proj",
"model.language_model.layers.6.mlp.shared_expert_gate",
"model.language_model.layers.6.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.6.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.6.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.7.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.7.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.7.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.7.mlp.gate",
"model.language_model.layers.7.mlp.shared_expert.down_proj",
"model.language_model.layers.7.mlp.shared_expert.gate_proj",
"model.language_model.layers.7.mlp.shared_expert.up_proj",
"model.language_model.layers.7.mlp.shared_expert_gate",
"model.language_model.layers.7.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.7.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.7.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.7.self_attn.indexer.index_qk_proj",
"model.language_model.layers.7.self_attn.k_proj",
"model.language_model.layers.7.self_attn.o_proj",
"model.language_model.layers.7.self_attn.q_proj",
"model.language_model.layers.7.self_attn.v_proj",
"model.language_model.layers.8.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.8.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.8.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.8.linear_attn.conv1d",
"model.language_model.layers.8.linear_attn.in_proj_a",
"model.language_model.layers.8.linear_attn.in_proj_b",
"model.language_model.layers.8.linear_attn.in_proj_qkv",
"model.language_model.layers.8.linear_attn.in_proj_z",
"model.language_model.layers.8.linear_attn.out_proj",
"model.language_model.layers.8.mlp.gate",
"model.language_model.layers.8.mlp.shared_expert.down_proj",
"model.language_model.layers.8.mlp.shared_expert.gate_proj",
"model.language_model.layers.8.mlp.shared_expert.up_proj",
"model.language_model.layers.8.mlp.shared_expert_gate",
"model.language_model.layers.8.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.8.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.8.mlp_hyper_connection.input_mix_weight_up",
"model.language_model.layers.9.attn_hyper_connection.block_inject_weight",
"model.language_model.layers.9.attn_hyper_connection.input_mix_weight_down",
"model.language_model.layers.9.attn_hyper_connection.input_mix_weight_up",
"model.language_model.layers.9.linear_attn.conv1d",
"model.language_model.layers.9.linear_attn.in_proj_a",
"model.language_model.layers.9.linear_attn.in_proj_b",
"model.language_model.layers.9.linear_attn.in_proj_qkv",
"model.language_model.layers.9.linear_attn.in_proj_z",
"model.language_model.layers.9.linear_attn.out_proj",
"model.language_model.layers.9.mlp.gate",
"model.language_model.layers.9.mlp.shared_expert.down_proj",
"model.language_model.layers.9.mlp.shared_expert.gate_proj",
"model.language_model.layers.9.mlp.shared_expert.up_proj",
"model.language_model.layers.9.mlp.shared_expert_gate",
"model.language_model.layers.9.mlp_hyper_connection.block_inject_weight",
"model.language_model.layers.9.mlp_hyper_connection.input_mix_weight_down",
"model.language_model.layers.9.mlp_hyper_connection.input_mix_weight_up",
"model.visual.blocks.0.attn.proj",
"model.visual.blocks.0.attn.qkv",
"model.visual.blocks.0.mlp.linear_fc1",
"model.visual.blocks.0.mlp.linear_fc2",
"model.visual.blocks.1.attn.proj",
"model.visual.blocks.1.attn.qkv",
"model.visual.blocks.1.mlp.linear_fc1",
"model.visual.blocks.1.mlp.linear_fc2",
"model.visual.blocks.10.attn.proj",
"model.visual.blocks.10.attn.qkv",
"model.visual.blocks.10.mlp.linear_fc1",
"model.visual.blocks.10.mlp.linear_fc2",
"model.visual.blocks.11.attn.proj",
"model.visual.blocks.11.attn.qkv",
"model.visual.blocks.11.mlp.linear_fc1",
"model.visual.blocks.11.mlp.linear_fc2",
"model.visual.blocks.12.attn.proj",
"model.visual.blocks.12.attn.qkv",
"model.visual.blocks.12.mlp.linear_fc1",
"model.visual.blocks.12.mlp.linear_fc2",
"model.visual.blocks.13.attn.proj",
"model.visual.blocks.13.attn.qkv",
"model.visual.blocks.13.mlp.linear_fc1",
"model.visual.blocks.13.mlp.linear_fc2",
"model.visual.blocks.14.attn.proj",
"model.visual.blocks.14.attn.qkv",
"model.visual.blocks.14.mlp.linear_fc1",
"model.visual.blocks.14.mlp.linear_fc2",
"model.visual.blocks.15.attn.proj",
"model.visual.blocks.15.attn.qkv",
"model.visual.blocks.15.mlp.linear_fc1",
"model.visual.blocks.15.mlp.linear_fc2",
"model.visual.blocks.16.attn.proj",
"model.visual.blocks.16.attn.qkv",
"model.visual.blocks.16.mlp.linear_fc1",
"model.visual.blocks.16.mlp.linear_fc2",
"model.visual.blocks.17.attn.proj",
"model.visual.blocks.17.attn.qkv",
"model.visual.blocks.17.mlp.linear_fc1",
"model.visual.blocks.17.mlp.linear_fc2",
"model.visual.blocks.18.attn.proj",
"model.visual.blocks.18.attn.qkv",
"model.visual.blocks.18.mlp.linear_fc1",
"model.visual.blocks.18.mlp.linear_fc2",
"model.visual.blocks.19.attn.proj",
"model.visual.blocks.19.attn.qkv",
"model.visual.blocks.19.mlp.linear_fc1",
"model.visual.blocks.19.mlp.linear_fc2",
"model.visual.blocks.2.attn.proj",
"model.visual.blocks.2.attn.qkv",
"model.visual.blocks.2.mlp.linear_fc1",
"model.visual.blocks.2.mlp.linear_fc2",
"model.visual.blocks.20.attn.proj",
"model.visual.blocks.20.attn.qkv",
"model.visual.blocks.20.mlp.linear_fc1",
"model.visual.blocks.20.mlp.linear_fc2",
"model.visual.blocks.21.attn.proj",
"model.visual.blocks.21.attn.qkv",
"model.visual.blocks.21.mlp.linear_fc1",
"model.visual.blocks.21.mlp.linear_fc2",
"model.visual.blocks.22.attn.proj",
"model.visual.blocks.22.attn.qkv",
"model.visual.blocks.22.mlp.linear_fc1",
"model.visual.blocks.22.mlp.linear_fc2",
"model.visual.blocks.23.attn.proj",
"model.visual.blocks.23.attn.qkv",
"model.visual.blocks.23.mlp.linear_fc1",
"model.visual.blocks.23.mlp.linear_fc2",
"model.visual.blocks.24.attn.proj",
"model.visual.blocks.24.attn.qkv",
"model.visual.blocks.24.mlp.linear_fc1",
"model.visual.blocks.24.mlp.linear_fc2",
"model.visual.blocks.25.attn.proj",
"model.visual.blocks.25.attn.qkv",
"model.visual.blocks.25.mlp.linear_fc1",
"model.visual.blocks.25.mlp.linear_fc2",
"model.visual.blocks.26.attn.proj",
"model.visual.blocks.26.attn.qkv",
"model.visual.blocks.26.mlp.linear_fc1",
"model.visual.blocks.26.mlp.linear_fc2",
"model.visual.blocks.3.attn.proj",
"model.visual.blocks.3.attn.qkv",
"model.visual.blocks.3.mlp.linear_fc1",
"model.visual.blocks.3.mlp.linear_fc2",
"model.visual.blocks.4.attn.proj",
"model.visual.blocks.4.attn.qkv",
"model.visual.blocks.4.mlp.linear_fc1",
"model.visual.blocks.4.mlp.linear_fc2",
"model.visual.blocks.5.attn.proj",
"model.visual.blocks.5.attn.qkv",
"model.visual.blocks.5.mlp.linear_fc1",
"model.visual.blocks.5.mlp.linear_fc2",
"model.visual.blocks.6.attn.proj",
"model.visual.blocks.6.attn.qkv",
"model.visual.blocks.6.mlp.linear_fc1",
"model.visual.blocks.6.mlp.linear_fc2",
"model.visual.blocks.7.attn.proj",
"model.visual.blocks.7.attn.qkv",
"model.visual.blocks.7.mlp.linear_fc1",
"model.visual.blocks.7.mlp.linear_fc2",
"model.visual.blocks.8.attn.proj",
"model.visual.blocks.8.attn.qkv",
"model.visual.blocks.8.mlp.linear_fc1",
"model.visual.blocks.8.mlp.linear_fc2",
"model.visual.blocks.9.attn.proj",
"model.visual.blocks.9.attn.qkv",
"model.visual.blocks.9.mlp.linear_fc1",
"model.visual.blocks.9.mlp.linear_fc2",
"model.visual.merger.linear_fc1",
"model.visual.merger.linear_fc2",
"model.visual.patch_embed.proj",
"model.visual.pos_embed",
"mtp.fc_embedding",
"mtp.fc_hidden",
"mtp.hyper_connection_mixer.input_mix_weight_down",
"mtp.hyper_connection_mixer.input_mix_weight_up",
"mtp.layers.0.attn_hyper_connection.block_inject_weight",
"mtp.layers.0.attn_hyper_connection.input_mix_weight_down",
"mtp.layers.0.attn_hyper_connection.input_mix_weight_up",
"mtp.layers.0.mlp.gate",
"mtp.layers.0.mlp.shared_expert.down_proj",
"mtp.layers.0.mlp.shared_expert.gate_proj",
"mtp.layers.0.mlp.shared_expert.up_proj",
"mtp.layers.0.mlp.shared_expert_gate",
"mtp.layers.0.mlp_hyper_connection.block_inject_weight",
"mtp.layers.0.mlp_hyper_connection.input_mix_weight_down",
"mtp.layers.0.mlp_hyper_connection.input_mix_weight_up",
"mtp.layers.0.self_attn.indexer.index_qk_proj",
"mtp.layers.0.self_attn.k_proj",
"mtp.layers.0.self_attn.o_proj",
"mtp.layers.0.self_attn.q_proj",
"mtp.layers.0.self_attn.v_proj"
],
"quant_method": "fp8"
},
"tokenizer_config": {
"bos_token": null,
"chat_template": "{%- set image_count = namespace(value=0) %}\n{%- set video_count = namespace(value=0) %}\n{%- macro render_content(content, do_vision_count, is_system_content=false) %}\n {%- if content is string %}\n {{- content }}\n {%- elif content is iterable and content is not mapping %}\n {%- for item in content %}\n {%- if 'image' in item or 'image_url' in item or item.type == 'image' %}\n {%- if is_system_content %}\n {{- raise_exception('System message cannot contain images.') }}\n {%- endif %}\n {%- if do_vision_count %}\n {%- set image_count.value = image_count.value + 1 %}\n {%- endif %}\n {%- if add_vision_id %}\n {{- 'Picture ' ~ image_count.value ~ ': ' }}\n {%- endif %}\n {{- '<|vision_start|><|image_pad|><|vision_end|>' }}\n {%- elif 'video' in item or item.type == 'video' %}\n {%- if is_system_content %}\n {{- raise_exception('System message cannot contain videos.') }}\n {%- endif %}\n {%- if do_vision_count %}\n {%- set video_count.value = video_count.value + 1 %}\n {%- endif %}\n {%- if add_vision_id %}\n {{- 'Video ' ~ video_count.value ~ ': ' }}\n {%- endif %}\n {{- '<|vision_start|><|video_pad|><|vision_end|>' }}\n {%- elif 'text' in item %}\n {{- item.text }}\n {%- else %}\n {{- raise_exception('Unexpected item type in content.') }}\n {%- endif %}\n {%- endfor %}\n {%- elif content is none or content is undefined %}\n {{- '' }}\n {%- else %}\n {{- raise_exception('Unexpected content type.') }}\n {%- endif %}\n{%- endmacro %}\n{%- if not messages %}\n {{- raise_exception('No messages provided.') }}\n{%- endif %}\n{%- set reasoning_instructions = '' %}\n{%- if enable_thinking is undefined or enable_thinking is true %}\n {%- set resolved_reasoning_effort = reasoning_effort|default('xhigh') %}\n {%- if resolved_reasoning_effort not in ('xhigh', 'medium', 'low') %}\n {{- raise_exception('Unexpected reasoning effort ' ~ reasoning_effort ~ '. Supported types are xhigh (default), medium, and low.') }}\n {%- endif %}\n {%- if resolved_reasoning_effort == 'xhigh' %}\n {%- set reasoning_instructions = 'Reasoning effort is set to xhigh. Please think carefully through the task, validate key assumptions, consider plausible alternatives, and prioritize correctness, consistency, and clarity in the final answer.' %}\n {%- elif resolved_reasoning_effort == 'low' %}\n {%- set reasoning_instructions = 'Reasoning effort is set to low. Keep your thinking brief and focused, moving directly to the conclusion without unnecessary elaboration.' %}\n {%- endif %}\n{%- endif %}\n{%- if tools and tools is iterable and tools is not mapping %}\n {{- '<|im_start|>system\\n' }}\n {%- if reasoning_instructions %}\n {{- reasoning_instructions + '\\n\\n' }}\n {%- endif %}\n {{- \"# Tools\\n\\nYou have access to the following functions:\\n\\n<tools>\" }}\n {%- for tool in tools %}\n {{- \"\\n\" }}\n {{- tool | tojson }}\n {%- endfor %}\n {{- \"\\n</tools>\" }}\n {{- '\\n\\nIf you choose to call a function ONLY reply in the following format with NO suffix:\\n\\n<tool_call>\\n<function=example_function_name>\\n<parameter=example_parameter_1>\\nvalue_1\\n</parameter>\\n<parameter=example_parameter_2>\\nThis is the value for the second parameter\\nthat can span\\nmultiple lines\\n</parameter>\\n</function>\\n</tool_call>\\n\\n<IMPORTANT>\\nReminder:\\n- Function calls MUST follow the specified format: an inner <function=...></function> block must be nested within <tool_call></tool_call> XML tags\\n- Required parameters MUST be specified\\n- You may provide optional reasoning for your function call in natural language BEFORE the function call, but NOT after\\n- If there is no function call available, answer the question like normal with your current knowledge and do not tell the user about function calls\\n</IMPORTANT>' }}\n {%- if messages[0].role == 'system' %}\n {%- set content = render_content(messages[0].content, false, true)|trim %}\n {%- if content %}\n {{- '\\n\\n' + content }}\n {%- endif %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n{%- else %}\n {%- if messages[0].role == 'system' %}\n {%- set content = render_content(messages[0].content, false, true)|trim %}\n {%- if content %}\n {{- '<|im_start|>system\\n' + (reasoning_instructions + '\\n\\n' if reasoning_instructions else '') + content + '<|im_end|>\\n' }}\n {%- elif reasoning_instructions %}\n {{- '<|im_start|>system\\n' + reasoning_instructions + '<|im_end|>\\n' }}\n {%- endif %}\n {%- elif reasoning_instructions %}\n {{- '<|im_start|>system\\n' + reasoning_instructions + '<|im_end|>\\n' }}\n {%- endif %}\n{%- endif %}\n{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}\n{%- for message in messages[::-1] %}\n {%- set index = (messages|length - 1) - loop.index0 %}\n {%- if ns.multi_step_tool and message.role == \"user\" %}\n {%- set content = render_content(message.content, false)|trim %}\n {%- if not(content.startswith('<tool_response>') and content.endswith('</tool_response>')) %}\n {%- set ns.multi_step_tool = false %}\n {%- set ns.last_query_index = index %}\n {%- endif %}\n {%- endif %}\n{%- endfor %}\n{%- if ns.multi_step_tool %}\n {{- raise_exception('No user query found in messages.') }}\n{%- endif %}\n{%- for message in messages %}\n {%- set content = render_content(message.content, true)|trim %}\n {%- if message.role == \"system\" %}\n {%- if not loop.first %}\n {{- raise_exception('System message must be at the beginning.') }}\n {%- endif %}\n {%- elif message.role == \"user\" %}\n {{- '<|im_start|>' + message.role + '\\n' + content + '<|im_end|>' + '\\n' }}\n {%- elif message.role == \"assistant\" %}\n {%- set reasoning_content = '' %}\n {%- if message.reasoning_content is string %}\n {%- set reasoning_content = message.reasoning_content %}\n {%- endif %}\n {%- set reasoning_content = reasoning_content|trim %}\n {%- if preserve_thinking is undefined or preserve_thinking is true or loop.index0 > ns.last_query_index %}\n {{- '<|im_start|>' + message.role + '\\n<think>\\n' + reasoning_content + '\\n</think>\\n\\n' + content }}\n {%- else %}\n {{- '<|im_start|>' + message.role + '\\n' + content }}\n {%- endif %}\n {%- if message.tool_calls and message.tool_calls is iterable and message.tool_calls is not mapping %}\n {%- for tool_call in message.tool_calls %}\n {%- if tool_call.function is defined %}\n {%- set tool_call = tool_call.function %}\n {%- endif %}\n {%- if loop.first %}\n {%- if content|trim %}\n {{- '\\n\\n<tool_call>\\n<function=' + tool_call.name + '>\\n' }}\n {%- else %}\n {{- '<tool_call>\\n<function=' + tool_call.name + '>\\n' }}\n {%- endif %}\n {%- else %}\n {{- '\\n<tool_call>\\n<function=' + tool_call.name + '>\\n' }}\n {%- endif %}\n {%- if tool_call.arguments is defined and tool_call.arguments != '' %}\n {%- for args_name, args_value in tool_call.arguments|items %}\n {{- '<parameter=' + args_name + '>\\n' }}\n {%- set args_value = args_value | string if args_value is string else args_value | tojson | safe %}\n {{- args_value }}\n {{- '\\n</parameter>\\n' }}\n {%- endfor %}\n {%- endif %}\n {{- '</function>\\n</tool_call>' }}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"tool\" %}\n {%- if loop.previtem and loop.previtem.role != \"tool\" %}\n {{- '<|im_start|>user' }}\n {%- endif %}\n {{- '\\n<tool_response>\\n' }}\n {{- content }}\n {{- '\\n</tool_response>' }}\n {%- if not loop.last and loop.nextitem.role != \"tool\" %}\n {{- '<|im_end|>\\n' }}\n {%- elif loop.last %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n {%- else %}\n {{- raise_exception('Unexpected message role.') }}\n {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n {{- '<|im_start|>assistant\\n' }}\n {%- if enable_thinking is defined and enable_thinking is false %}\n {{- '<think>\\n\\n</think>\\n\\n' }}\n {%- else %}\n {{- '<think>\\n' }}\n {%- endif %}\n{%- endif %}",
"eos_token": "<|im_end|>",
"pad_token": "<|endoftext|>",
"unk_token": null
}
},
"createdAt": "2026-08-27T03:44:28.000Z",
"disabled": false,
"downloads": 1166,
"gated": false,
"id": "dealignai/Qwen3.8-Flash-Next-UNCENSORED-FP8",
"lastModified": "2026-09-05T23:11:32.000Z",
"likes": 29,
"model-index": null,
"modelId": "dealignai/Qwen3.8-Flash-Next-UNCENSORED-FP8",
"pipeline_tag": "text-generation",
"private": false,
"safetensors": {
"parameters": {
"BF16": 5487198064,
"F8_E4M3": 174512783360,
"I64": 35
},
"total": 179999981459
},
"sha": "0df192cfd5b20fcd109fb63a5e1f663afa0341d8",
"siblings": [
{
"rfilename": ".gitattributes"
},
{
"rfilename": "LICENSE"
},
{
"rfilename": "README.md"
},
{
"rfilename": "chat_template.jinja"
},
{
"rfilename": "config.json"
},
{
"rfilename": "dealign_logo.png"
},
{
"rfilename": "dealign_mascot.png"
},
{
"rfilename": "generation_config.json"
},
{
"rfilename": "merges.txt"
},
{
"rfilename": "model-00001-of-00131.safetensors"
},
{
"rfilename": "model-00002-of-00131.safetensors"
},
{
"rfilename": "model-00003-of-00131.safetensors"
},
{
"rfilename": "model-00004-of-00131.safetensors"
},
{
"rfilename": "model-00005-of-00131.safetensors"
},
{
"rfilename": "model-00006-of-00131.safetensors"
},
{
"rfilename": "model-00007-of-00131.safetensors"
},
{
"rfilename": "model-00008-of-00131.safetensors"
},
{
"rfilename": "model-00009-of-00131.safetensors"
},
{
"rfilename": "model-00010-of-00131.safetensors"
},
{
"rfilename": "model-00011-of-00131.safetensors"
},
{
"rfilename": "model-00012-of-00131.safetensors"
},
{
"rfilename": "model-00013-of-00131.safetensors"
},
{
"rfilename": "model-00014-of-00131.safetensors"
},
{
"rfilename": "model-00015-of-00131.safetensors"
},
{
"rfilename": "model-00016-of-00131.safetensors"
},
{
"rfilename": "model-00017-of-00131.safetensors"
},
{
"rfilename": "model-00018-of-00131.safetensors"
},
{
"rfilename": "model-00019-of-00131.safetensors"
},
{
"rfilename": "model-00020-of-00131.safetensors"
},
{
"rfilename": "model-00021-of-00131.safetensors"
},
{
"rfilename": "model-00022-of-00131.safetensors"
},
{
"rfilename": "model-00023-of-00131.safetensors"
},
{
"rfilename": "model-00024-of-00131.safetensors"
},
{
"rfilename": "model-00025-of-00131.safetensors"
},
{
"rfilename": "model-00026-of-00131.safetensors"
},
{
"rfilename": "model-00027-of-00131.safetensors"
},
{
"rfilename": "model-00028-of-00131.safetensors"
},
{
"rfilename": "model-00029-of-00131.safetensors"
},
{
"rfilename": "model-00030-of-00131.safetensors"
},
{
"rfilename": "model-00031-of-00131.safetensors"
},
{
"rfilename": "model-00032-of-00131.safetensors"
},
{
"rfilename": "model-00033-of-00131.safetensors"
},
{
"rfilename": "model-00034-of-00131.safetensors"
},
{
"rfilename": "model-00035-of-00131.safetensors"
},
{
"rfilename": "model-00036-of-00131.safetensors"
},
{
"rfilename": "model-00037-of-00131.safetensors"
},
{
"rfilename": "model-00038-of-00131.safetensors"
},
{
"rfilename": "model-00039-of-00131.safetensors"
},
{
"rfilename": "model-00040-of-00131.safetensors"
},
{
"rfilename": "model-00041-of-00131.safetensors"
},
{
"rfilename": "model-00042-of-00131.safetensors"
},
{
"rfilename": "model-00043-of-00131.safetensors"
},
{
"rfilename": "model-00044-of-00131.safetensors"
},
{
"rfilename": "model-00045-of-00131.safetensors"
},
{
"rfilename": "model-00046-of-00131.safetensors"
},
{
"rfilename": "model-00047-of-00131.safetensors"
},
{
"rfilename": "model-00048-of-00131.safetensors"
},
{
"rfilename": "model-00049-of-00131.safetensors"
},
{
"rfilename": "model-00050-of-00131.safetensors"
},
{
"rfilename": "model-00051-of-00131.safetensors"
},
{
"rfilename": "model-00052-of-00131.safetensors"
},
{
"rfilename": "model-00053-of-00131.safetensors"
},
{
"rfilename": "model-00054-of-00131.safetensors"
},
{
"rfilename": "model-00055-of-00131.safetensors"
},
{
"rfilename": "model-00056-of-00131.safetensors"
},
{
"rfilename": "model-00057-of-00131.safetensors"
},
{
"rfilename": "model-00058-of-00131.safetensors"
},
{
"rfilename": "model-00059-of-00131.safetensors"
},
{
"rfilename": "model-00060-of-00131.safetensors"
},
{
"rfilename": "model-00061-of-00131.safetensors"
},
{
"rfilename": "model-00062-of-00131.safetensors"
},
{
"rfilename": "model-00063-of-00131.safetensors"
},
{
"rfilename": "model-00064-of-00131.safetensors"
},
{
"rfilename": "model-00065-of-00131.safetensors"
},
{
"rfilename": "model-00066-of-00131.safetensors"
},
{
"rfilename": "model-00067-of-00131.safetensors"
},
{
"rfilename": "model-00068-of-00131.safetensors"
},
{
"rfilename": "model-00069-of-00131.safetensors"
},
{
"rfilename": "model-00070-of-00131.safetensors"
},
{
"rfilename": "model-00071-of-00131.safetensors"
},
{
"rfilename": "model-00072-of-00131.safetensors"
},
{
"rfilename": "model-00073-of-00131.safetensors"
},
{
"rfilename": "model-00074-of-00131.safetensors"
},
{
"rfilename": "model-00075-of-00131.safetensors"
},
{
"rfilename": "model-00076-of-00131.safetensors"
},
{
"rfilename": "model-00077-of-00131.safetensors"
},
{
"rfilename": "model-00078-of-00131.safetensors"
},
{
"rfilename": "model-00079-of-00131.safetensors"
},
{
"rfilename": "model-00080-of-00131.safetensors"
},
{
"rfilename": "model-00081-of-00131.safetensors"
},
{
"rfilename": "model-00082-of-00131.safetensors"
},
{
"rfilename": "model-00083-of-00131.safetensors"
},
{
"rfilename": "model-00084-of-00131.safetensors"
},
{
"rfilename": "model-00085-of-00131.safetensors"
},
{
"rfilename": "model-00086-of-00131.safetensors"
},
{
"rfilename": "model-00087-of-00131.safetensors"
},
{
"rfilename": "model-00088-of-00131.safetensors"
},
{
"rfilename": "model-00089-of-00131.safetensors"
},
{
"rfilename": "model-00090-of-00131.safetensors"
},
{
"rfilename": "model-00091-of-00131.safetensors"
},
{
"rfilename": "model-00092-of-00131.safetensors"
},
{
"rfilename": "model-00093-of-00131.safetensors"
},
{
"rfilename": "model-00094-of-00131.safetensors"
},
{
"rfilename": "model-00095-of-00131.safetensors"
},
{
"rfilename": "model-00096-of-00131.safetensors"
},
{
"rfilename": "model-00097-of-00131.safetensors"
},
{
"rfilename": "model-00098-of-00131.safetensors"
},
{
"rfilename": "model-00099-of-00131.safetensors"
},
{
"rfilename": "model-00100-of-00131.safetensors"
},
{
"rfilename": "model-00101-of-00131.safetensors"
},
{
"rfilename": "model-00102-of-00131.safetensors"
},
{
"rfilename": "model-00103-of-00131.safetensors"
},
{
"rfilename": "model-00104-of-00131.safetensors"
},
{
"rfilename": "model-00105-of-00131.safetensors"
},
{
"rfilename": "model-00106-of-00131.safetensors"
},
{
"rfilename": "model-00107-of-00131.safetensors"
},
{
"rfilename": "model-00108-of-00131.safetensors"
},
{
"rfilename": "model-00109-of-00131.safetensors"
},
{
"rfilename": "model-00110-of-00131.safetensors"
},
{
"rfilename": "model-00111-of-00131.safetensors"
},
{
"rfilename": "model-00112-of-00131.safetensors"
},
{
"rfilename": "model-00113-of-00131.safetensors"
},
{
"rfilename": "model-00114-of-00131.safetensors"
},
{
"rfilename": "model-00115-of-00131.safetensors"
},
{
"rfilename": "model-00116-of-00131.safetensors"
},
{
"rfilename": "model-00117-of-00131.safetensors"
},
{
"rfilename": "model-00118-of-00131.safetensors"
},
{
"rfilename": "model-00119-of-00131.safetensors"
},
{
"rfilename": "model-00120-of-00131.safetensors"
},
{
"rfilename": "model-00121-of-00131.safetensors"
},
{
"rfilename": "model-00122-of-00131.safetensors"
},
{
"rfilename": "model-00123-of-00131.safetensors"
},
{
"rfilename": "model-00124-of-00131.safetensors"
},
{
"rfilename": "model-00125-of-00131.safetensors"
},
{
"rfilename": "model-00126-of-00131.safetensors"
},
{
"rfilename": "model-00127-of-00131.safetensors"
},
{
"rfilename": "model-00128-of-00131.safetensors"
},
{
"rfilename": "model-00129-of-00131.safetensors"
},
{
"rfilename": "model-00130-of-00131.safetensors"
},
{
"rfilename": "model-00131-of-00131.safetensors"
},
{
"rfilename": "model.safetensors.index.json"
},
{
"rfilename": "preprocessor_config.json"
},
{
"rfilename": "tokenizer.json"
},
{
"rfilename": "tokenizer_config.json"
},
{
"rfilename": "video_preprocessor_config.json"
},
{
"rfilename": "vocab.json"
}
],
"spaces": [
"tardellirs/model-pulse",
"aquanode/gpu-vram-calculator"
],
"tags": [
"safetensors",
"qwen4_exp",
"qwen",
"qwen3.8",
"flash-next",
"fp8",
"uncensored",
"moe",
"text-generation",
"vision",
"vision-language",
"multi-token-prediction",
"conversational",
"base_model:Qwen/Qwen3.8-Flash-Next-FP8",
"base_model:quantized:Qwen/Qwen3.8-Flash-Next-FP8",
"license:apache-2.0",
"region:us"
],
"usedStorage": 262047797522,
"widgetData": [
{
"text": "Hi, what can you help me with?"
},
{
"text": "What is 84 * 3 / 2?"
},
{
"text": "Tell me an interesting fact about the universe!"
},
{
"text": "Explain quantum computing in simple terms."
}
]
} | — | |||||||||
| Task task | Hugging Face models | text-generationreceipt
This source has not kept a receipt for this claim yet. The next update that reads it will. | — |
model
| dealignai/Qwen3.8-Flash-Next-UNCENSORED-FP8 zetlyn/models-hf · 2026-08-27 | author dealignai downloads 1503 gated false licence apache-2.0 likes 24 task text-generation | source |
| dealignai/Qwen3.8-Flash-Next-UNCENSORED-FP8 zetlyn/models-hf · 2026-08-27 | author dealignai downloads 1166 gated false licence apache-2.0 likes 29 task text-generation | source |
quantisation
| BattleGhost/Qwen3.8-Flash-Next-UNCENSORED-IQ2_XXS-GGUF zetlyn/models-gguf · 2026-08-30 | author BattleGhost base dealignai/Qwen3.8-Flash-Next-UNCENSORED-FP8 downloads 32460 licence other likes 2 | source |
| BattleGhost/Qwen3.8-Flash-Next-UNCENSORED-BF16-GGUF zetlyn/models-gguf · 2026-08-30 | author BattleGhost base dealignai/Qwen3.8-Flash-Next-UNCENSORED-FP8 downloads 1111 licence other likes 0 | source |