VALUTAZIONE ROUTER — Intent Classification Metodo: Leave-one-out cross-validation k=15, Embedding=paraphrase-multilingual-MiniLM-L12-v2 Totale query: 3696 ACCURACY 5 classi: 0.9424 (94.24%) 2 macro: 0.9743 (97.43%) CLASSIFICATION REPORT — 5 Classi precision recall f1-score support account 0.9134 0.9415 0.9273 650 bugs 0.9690 0.9137 0.9405 649 product 0.9531 0.9775 0.9652 935 sales 0.9338 0.9373 0.9355 813 support 0.9421 0.9276 0.9348 649 accuracy 0.9424 3696 macro avg 0.9423 0.9395 0.9407 3696 weighted avg 0.9427 0.9424 0.9423 3696 CLASSIFICATION REPORT — 2 Macro-Gruppi precision recall f1-score support prodotto 0.9688 0.9771 0.9729 1748 supporto 0.9793 0.9718 0.9755 1948 accuracy 0.9743 3696 macro avg 0.9741 0.9744 0.9742 3696 weighted avg 0.9743 0.9743 0.9743 3696 ERRORI MACRO-GRUPPO (95 totali) [ support -> sales] "What are your store hours?" [ sales -> account] "What payment methods do you accept?" [ sales -> support] "Is there free shipping on orders over a certain amount?" [ support -> product] "Do you have size guides for clothing?" [ sales -> support] "Can I reserve an item for pickup later?" [ sales -> sales] "Can I put items on layaway?" [ support -> sales] "What's your policy on price adjustments?" [ support -> sales] "What's your policy on opened software returns?" [ sales -> support] "What's your return policy during holiday season?" [ support -> sales] "Do you offer gift wrapping services?" [ support -> sales] "Can I get a rain check if an item goes out of stock during a sale?" [ sales -> support] "whats your return policy during holiday season" [ support -> sales] "whats your policy on price matching other stores" [ support -> product] "what size should i get for 6 foot tall person" [ sales -> support] "whats your policy on price drops after i buy something" [ support -> sales] "do you have size exchange program for clothing" [ sales -> support] "whats the return policy on opened software" [ sales -> sales] "whats the best way to get notified about restocks" [ support -> sales] "whats your policy on price matching other online stores" [ sales -> support] "whats return policy on opened software and digital products" [ sales -> support] "whats your policy partial orders backorders split shipments" [ bugs -> product] "responsive design breaking certain screen sizes mobile tablet" [ support -> support] "quick question can i return this thing if my kid doesnt like it for his birthday" [ support -> support] "if i buy something today how fast can u get it to me i live in florida" [ support -> sales] "how do i know if something will work with my 2018 honda civic" [ support -> sales] "do you price match other online stores like best buy" [ sales -> support] "whats the return policy on opened software" [ account -> sales] "loyalty points" [ support -> sales] "price match" [ bugs -> product] "progress bar" [ sales -> support] "price drop" [ sales -> account] "partial orders" [ account -> product] "work computer" [ support -> sales] "price drops" [ support -> sales] "same day" [ support -> sales] "pickup times" [ sales -> account] "corporate accounts" [ sales -> sales] "store credit max" [ sales -> support] "refurbished laptops currently available with warranty and return policy same as new products or different terms" [ bugs -> product] "footer links" [ support -> sales] "assembly furniture" [ product -> account] "smart lock" [ bugs -> product] "mobile keyboard" [ account -> sales] "referral credits" [ account -> sales] "personal business" [ bugs -> product] "screen sizes" [ bugs -> product] "unreadable garbled" [ support -> sales] "price significantly" [ sales -> support] "do you guys have any kind of price protection program where if an item i buy goes on sale within like 30 days you guys will refund me the difference" [ support -> sales] "cousins graduation" [ support -> sales] "kids birthday" [ product -> bugs] "hate apple" [ sales -> bugs] "since forever" [ product -> sales] "million dollars" [ account -> sales] "moving week" [ product -> product] "my kids" [ bugs -> sales] "start over" [ account -> sales] "month ago" [ sales -> product] "come out" [ bugs -> product] "file big" [ bugs -> product] "narrow anything" [ support -> product] "front porch" [ sales -> support] "pickup today" [ sales -> support] "refurbished stuff" [ bugs -> sales] "out stock" [ sales -> account] "the year" [ bugs -> product] "any sound" [ product -> product] "regular documents" [ product -> product] "and use" [ account -> product] "telling me" [ sales -> account] "this month" [ support -> sales] "best buy" [ account -> product] "anywhere" [ support -> product] "a review" [ product -> product] "the fastest" [ account -> sales] "a week" [ sales -> account] "with points" [ product -> support] "editing work" [ sales -> support] "opened software" [ support -> sales] "buy electronics" [ bugs -> product] "in usa" [ support -> product] "im home" [ product -> bugs] "8 hours" [ support -> support] "original box" [ sales -> support] "do you offer price matching with local brick and mortar stores in addition to online retailers" [ sales -> support] "do you have any open box deals on electronics that come with the same warranty as brand new items" [ sales -> support] "do you offer special holiday gift wrapping services and expedited shipping combinations" [ bugs -> sales] "the shopping cart doesnt properly apply promotional codes when multiple discounts are available" [ sales -> support] "are there any loyalty programs that offer free extended warranties for frequent purchasers" [ sales -> sales] "do you offer seasonal payment deferral options for customers with irregular income schedules" [ support -> sales] "Do you provide free shipping on all orders?" [ support -> sales] "Do you offer gift exchanges?" [ support -> sales] "Is there a minimum spend for free shipping?" [ support -> sales] "How do I know if my order qualifies for free shipping?" [ account -> sales] "Can I set preferences for promotional communications?"