NVIDIA
diff --git a/‎examples/speculative_decoding/eagle_config.json‎
Lines changed: 2 additions & 1 deletion b/‎examples/speculative_decoding/eagle_config.json‎
Lines changed: 2 additions & 1 deletion
@@ -6,5 +6,6 @@
         "original_max_position_embeddings": 8192,
         "rope_type": "llama3"
     },
-    "initializer_range": 0.02
+    "initializer_range": 0.02,
+    "_attn_implementation": "sdpa"
 }
Original file line number	Diff line number	Diff line change
`@@ -6,5 +6,6 @@`
`6`	`6`	`"original_max_position_embeddings": 8192,`
`7`	`7`	`"rope_type": "llama3"`
`8`	`8`	`},`
`9`		`- "initializer_range": 0.02`
	`9`	`+ "initializer_range": 0.02,`
	`10`	`+ "_attn_implementation": "sdpa"`
`10`	`11`	`}`