Upload folder using huggingface_hub

Arch-Function-1.5B-Q2_K.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:42859bdeb67fb6d2ef6ec5ccce209ae105689d215eb43bd1a3be612297af3c8c
+oid sha256:0cc39b21072d02d21eea8d5b11aad3d66613a0c0f65d6217bd60d2b56ef15e90
 size 676304416

Arch-Function-1.5B-Q3_K_L.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:7c932f5151fa3bfb6af77f23daa2f87483bf88fc852e7b4d52e445fc3b0016c8
+oid sha256:4df42c00654843b76609d4284c249ec67744bfe2e5702fe8f0000c3e5e955015
 size 880162336

Arch-Function-1.5B-Q3_K_M.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:222a47626c8c249869019848dc662c9664c940e7ddb7f0759724ca99781d44ba
+oid sha256:17f7e5e5e12b8d90ef2c7513d5827faec80c1f480e6e1fa6d64e47487ca5421c
 size 824178208

Arch-Function-1.5B-Q3_K_S.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:188a88cb7537468742bb7460cf58f8426d78aae479d5505ca0d1f4fa57a46617
+oid sha256:b98968512040c2366bd629415110ad98aaab73ddccb201adc188d85a4d9f809f
 size 760944160

Arch-Function-1.5B-Q4_K_M.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:d40892b0d81cb3916c014b44cfd4ed8f2ec61d1b0d540ea5e72cb8734ba90766
+oid sha256:ed26fc87e55c6137264f42daa9432f0c1869b91c43b26025aff64de6715665c9
 size 986048032

Arch-Function-1.5B-Q4_K_S.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f604e86d4efd9c6615a71e34cea5870daf0b3a5811737596177869374ac88b68
+oid sha256:f3b1241887517cca6834ae51a1ce60261da6caf9d763ed5a61083f12c3069362
 size 940312096

Arch-Function-1.5B-Q5_K_M.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:18bf2bdd6fc1d0808de809f840a39fb7ee1a37bea88e3dea719fc92ae8afee66
+oid sha256:d15c198191ef55842d058d50b90df536708fafffa02305aa5a934189903b79ea
 size 1125049888

Arch-Function-1.5B-Q5_K_S.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:1a0e5c5d979e38420052a187c92ba3ca410f2903549bfe01a7b0e4e4440147ae
+oid sha256:b031d28ffabdf6b81a113d2f43bcf797b2d1c141974784a370b2b90ee8598109
 size 1098728992

Arch-Function-1.5B-Q6_K.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:1ca023f9941db426e57ce52246a924aa1265f5e7d4271db41b9f89b766dc12e8
+oid sha256:df78e221af40189a9bee2f6ab837b54d7bf224903b335df0ec8c95fdb239c8ca
 size 1272739360

Arch-Function-1.5B.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:02d3465a3bdcd81ddd370f034b16ca6319c180dbf2ee0b9cf3038db097ad6624
+oid sha256:ccaf7823ba19ecf3fcf5b04debcb886cd2f4b8f2c27e7c1cc8f7248bd10e1bac
 size 3093668896

README.md

@@ -2,7 +2,7 @@
 license: other
 license_name: katanemo-research
 license_link: >-
-  https://huggingface.co/katanemolabs/Arch-Function-1.5B.gguf/blob/main/LICENSE
+  https://huggingface.co/katanemolabs/Arch-Function-1.5B/blob/main/LICENSE
 base_model:
 - Qwen/Qwen2.5-1.5B-Instruct
 language:
@@ -22,7 +22,7 @@ In summary, the Katanemo Arch-Function collection demonstrates:
 - **High generalization** across multiple function calling use cases, from API interactions to automated backend tasks.
 - Optimized **low-latency, high-throughput** performance, making it suitable for real-time, production environments.
 
-Arch-Function is the core LLM used in then open source [Arch Gateway](https://github.com/katanemo/arch) to seamlessly integrate user prompts with developers APIs.
+Arch-Function is the core LLM used in then open source [Arch Gateway](https://github.com/katanemo/arch) to seamlessly integrate user prompts with developers APIs
 
 ## Key Features
 <table>
@@ -54,7 +54,7 @@ Katanemo Arch-Function collection is built on top of the [Qwen 2.5](https://hugg
 
 
 ## Performance Benchmarks
-We evaluate Katanemo Arch-Function series on the [Berkeley Function-Calling Leaderboard (BFCL)](https://gorilla.cs.berkeley.edu/leaderboard.html#leaderboard). For each model family, we select the one with the highest rank. The results are shwon below:
+We evaluate Katanemo Arch-Function series on the [Berkeley Function-Calling Leaderboard (BFCL)](https://gorilla.cs.berkeley.edu/leaderboard.html#leaderboard). For each model family, we select the one with the highest rank. The results (as of Oct 21st, 2024) are shwon below:
 
 <table>
   <tr style="text-align: center; vertical-align: middle; font-weight: bold;">
@@ -75,103 +75,180 @@ We evaluate Katanemo Arch-Function series on the [Berkeley Function-Calling Lead
   </tr>
   <tr style="text-align: center; vertical-align: middle;">
     <td>1</td>
-    <td>GPT-4-turbo-2024-04-09</td>
-    <td>59.49%</td>
-    <td>82.65%</td>
-    <td>83.80%</td>
-    <td>73.39%</td>
-    <td>21.62%</td>
+    <td>GPT-4o-2024-08-06 (FC)</td>
+    <td>62.19%</td>
+    <td>85.90%</td>
+    <td>85.64%</td>
+    <td>75.43%</td>
+    <td>25.00%</td>
+    <td>63.41%</td>
+    <td>82.93%</td>
+  </tr>
+  <tr style="text-align: center; vertical-align: middle;">
+    <td>2</td>
+    <td>Functionary-Medium-v3.1 (FC)</td>
+    <td>62.02%</td>
+    <td>89.52%</td>
+    <td>89.77%</td>
+    <td>73.48%</td>
+    <td>23.50%</td>
     <td>70.73%</td>
-    <td>79.79%</td>
+    <td>73.32%</td>
   </tr>
   <tr style="text-align: center; vertical-align: middle;">
-    <td>3</td>
-    <td>xLAM-8x22b-r</td>
-    <td>59.13%</td>
-    <td>89.75%</td>
-    <td>89.32%</td>
-    <td>72.81%</td>
-    <td>15.62%</td>
-    <td>97.56%</td>
-    <td>75.23%</td>
+    <td>5</td>
+    <td>ToolACE-8B (FC)</td>
+    <td>60.44%</td>
+    <td>87.06%</td>
+    <td>89.52%</td>
+    <td>74.99%</td>
+    <td>17.38%</td>
+    <td>80.49%</td>
+    <td>85.71%</td>
+  </tr>
+  <tr style="text-align: center; vertical-align: middle;">
+    <td>6</td>
+    <td>o1-preview-2024-09-12 (Prompt)</td>
+    <td>59.27%</td>
+    <td>86.42%</td>
+    <td>88.88%</td>
+    <td>73.08%</td>
+    <td>17.62%</td>
+    <td>73.17%</td>
+    <td>74.60%</td>
   </tr>
   <tr style="text-align: center; vertical-align: middle; font-weight: bold;">
     <td> </td>
     <td>Arch-Function-7B</td>
-    <td>57.48%</td>
-    <td>87.50%</td>
-    <td>86.80%</td>
-    <td>72.19%</td>
-    <td>13.75%</td>
-    <td>82.93%</td>
-    <td>79.54%</td>
+    <td>58.44%</td>
+    <td>85.58%</td>
+    <td>88.14%</td>
+    <td>69.08%</td>
+    <td>20.50%</td>
+    <td>92.68%</td>
+    <td>74.05%</td>
+  </tr>
+  <tr style="text-align: center; vertical-align: middle; ">
+    <td>8</td>
+    <td>xLAM-8x22b-r (FC)</td>
+    <td>57.99%</td>
+    <td>88.15%</td>
+    <td>90.11%</td>
+    <td>71.97%</td>
+    <td>14.50%</td>
+    <td>85.37%</td>
+    <td>67.29%</td>
+  </tr>
+  <tr style="text-align: center; vertical-align: middle; ">
+    <td>9</td>
+    <td>Gemini-1.5-Flash-002 (Prompt)</td>
+    <td>57.92%</td>
+    <td>86.58%</td>
+    <td>89.48%</td>
+    <td>76.28%</td>
+    <td>9.88%</td>
+    <td>85.37%</td>
+    <td>78.54%</td>
+  </tr>
+  <tr style="text-align: center; vertical-align: middle; ">
+    <td>10</td>
+    <td>Hammer2.0-7b (FC)</td>
+    <td>57.69%</td>
+    <td>90.27%</td>
+    <td>89.25%</td>
+    <td>69.79%</td>
+    <td>14.75%</td>
+    <td>95.12%</td>
+    <td>68.46%</td>
+  </tr>
+  <tr style="text-align: center; vertical-align: middle; ">
+    <td>12</td>
+    <td>Claude-3.5-Sonnet-20240620 (FC)</td>
+    <td>57.42%</td>
+    <td>70.04%</td>
+    <td>66.27%</td>
+    <td>74.68%</td>
+    <td>28.38%</td>
+    <td>68.29%</td>
+    <td>74.58%</td>
+  </tr>
+  <tr style="text-align: center; vertical-align: middle; ">
+    <td>13</td>
+    <td>mistral-large-2407 (FC)</td>
+    <td>56.80%</td>
+    <td>86.62%</td>
+    <td>84.57%</td>
+    <td>68.37%</td>
+    <td>20.62%</td>
+    <td>75.61%</td>
+    <td>49.44%</td>
   </tr>
   <tr style="text-align: center; vertical-align: middle; font-weight: bold;">
     <td> </td>
     <td>Arch-Function-3B</td>
-    <td>56.23%</td>
-    <td>85.10%</td>
-    <td>89.16%</td>
-    <td>70.72%</td>
-    <td>12.28%</td>
-    <td>90.24%</td>
-    <td>73.98%</td>
-  </tr>
-  <tr style="text-align: center; vertical-align: middle;">
-    <td>7</td>
-    <td>mistral-large-2407</td>
-    <td>55.82%</td>
-    <td>84.12%</td>
-    <td>83.09%</td>
-    <td>67.17%</td>
-    <td>20.50%</td>
-    <td>78.05%</td>
-    <td>48.93%</td>
-  </tr>
-  <tr style="text-align: center; vertical-align: middle;">
-    <td>9</td>
-    <td>Claude-3.5-Sonnet-20240620</td>
-    <td>54.83%</td>
-    <td>70.35%</td>
-    <td>66.34%</td>
-    <td>71.39%</td>
-    <td>23.5%</td>
-    <td>63.41%</td>
-    <td>75.91%</td>
+    <td>56.57%</td>
+    <td>83.62%</td>
+    <td>85.36%</td>
+    <td>66.90%</td>
+    <td>19.50%</td>
+    <td>97.56%</td>
+    <td>70.99%</td>
   </tr>
   </tr>
   <tr style="text-align: center; vertical-align: middle; font-weight: bold;">
     <td> </td>
     <td>Arch-Function-1.5B</td>
-    <td>53.61%</td>
-    <td>82.60%</td>
-    <td>87.36%</td>
-    <td>68.19%</td>
-    <td>8.62%</td>
-    <td>87.80%</td>
-    <td>75.90%</td>
+    <td>54.52%</td>
+    <td>80.31%</td>
+    <td>82.04%</td>
+    <td>66.19%</td>
+    <td>17.25%</td>
+    <td>97.56%</td>
+    <td>69.95%</td>
   </tr>
-  <tr style="text-align: center; vertical-align: middle;">
-    <td>11</td>
-    <td>o1-mini-2024-09-12</td>
-    <td>53.43%</td>
-    <td>75.48%</td>
-    <td>76.86%</td>
-    <td>71.17%</td>
-    <td>11.00%</td>
-    <td>46.34%</td>
-    <td>88.07%</td>
+  <tr style="text-align: center; vertical-align: middle; ">
+    <td>19</td>
+    <td>xLAM-7b-r (FC)</td>
+    <td>54.41%</td>
+    <td>81.40%</td>
+    <td>83.46%</td>
+    <td>67.88%</td>
+    <td>14.50%</td>
+    <td>97.56%</td>
+    <td>64.05%</td>
   </tr>
-  <tr style="text-align: center; vertical-align: middle;">
-    <td>12</td>
-    <td>Gemini-1.5-Flash-Preview-0514</td>
-    <td>53.01%</td>
-    <td>77.10%</td>
-    <td>71.23%</td>
-    <td>71.17%</td>
-    <td>13.12%</td>
-    <td>60.98%</td>
-    <td>76.15%</td>
+  <tr style="text-align: center; vertical-align: middle; ">
+    <td>20</td>
+    <td>Qwen2.5-7B-Instruct (Prompt)</td>
+    <td>54.27%</td>
+    <td>85.79%</td>
+    <td>88.13%</td>
+    <td>65.97%</td>
+    <td>11.25%</td>
+    <td>92.68%</td>
+    <td>64.95%</td>
+  </tr>
+  <tr style="text-align: center; vertical-align: middle; ">
+    <td>21</td>
+    <td>Llama-3.1-70B-Instruct (Prompt)</td>
+    <td>53.67%</td>
+    <td>88.90%</td>
+    <td>89.34%</td>
+    <td>61.13%</td>
+    <td>12.38%</td>
+    <td>92.68%</td>
+    <td>58.38%</td>
+  </tr>
+  <tr style="text-align: center; vertical-align: middle; ">
+    <td>22</td>
+    <td>Gemma-2-27b-it (Prompt)</td>
+    <td>53.66%</td>
+    <td>88.52%</td>
+    <td>87.89%</td>
+    <td>69.48%</td>
+    <td>4.12%</td>
+    <td>87.8%</td>
+    <td>68.76%</td>
   </tr>
 </table>
 
@@ -332,4 +409,4 @@ The current temperature in Seattle is 62 degrees in Fahrenheit.
 
 
 # License
-Katanemo Arch-Function collection is distributed under the [Katanemo license](https://huggingface.co/katanemolabs/Arch-Function-1.5B.gguf/blob/main/LICENSE).
+Katanemo Arch-Function collection is distributed under the [Katanemo license](https://huggingface.co/katanemolabs/Arch-Function-1.5B/blob/main/LICENSE).