Server overloading due to filters usage
The support doesn work on Saturdays and Sundays, so some Friday requests can be answered on Monday. If you have problems with registration ask help on contact us page pleaseIf you not got email within 24~36 business hours, firstly check your spam box, and if no any email from the support there - back to the forum and read answer here. DO NOT ANSWER ON EMAILS [noreply@pluginus.net] FROM THE FORUM!! Emails are just for your info, all answers should be published only here.
The support doesn work on Saturdays and Sundays, so some Friday requests can be answered on Monday.
Hi again, im putting this in a new ticket because it seems unrelated to the previous, Its been two days that a new issue has atarted with the husky filters. We have been using the filters in the site for the last two weeks and in the last four days, ive been working on the plugin, adding new filters and testing features (im not sure if i have changed some specific setting that causes it.)
So two days ago our server started experiencing huge spikes and maxing out. After contacting the hosting company they pointed out that the filters add the query parameters making those pages unable to be cached and so they use more PHP workers. Their proposal was to add this to the wprocket plugin that we use so that those pages will be cached
Cache Query String(s)
swoof
really_curr_tax
filter
filter1
pa_*
min_price
max_price
----
I also added this in htaccess by myself
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteCond %{QUERY_STRING} (^|&)(utm_[^=&]+|gclid|gbraid|wbraid|gad_source|gad_campaignid|ttclid|mc_(cid|eid)|fbclid|fb_source|srsltid|_gl|ref)(=|&|$) [NC]
RewriteRule ^ %{REQUEST_URI}? [R=301,L]
</IfModule>
-------------
Unfortunately, these changes hasnt changed anything.
Keep in mind that our website traffic is almost steady for the past 2 weeks but i noticed that the key events have spiked.
Also, our server is 6 CPU cores • 8GB RAM just to have a perspective.
Lastly, in order to pinpoint the issue, i disabled the husky plugin for a few hours and you can see that thats obviously the issue.
steady traffic https://ibb.co/zHTQGdJF
spike in key events https://ibb.co/m57dKV3n
server cpu usage with husky in use vs husky deactivated https://ibb.co/yBWxZTJ7
server usage in the last 7 days before this issue https://ibb.co/RkSpKbPW
note i tested the Turbo mode but there seems to be a compatibility issue with my site bc it doesnt load the filter at all. The thing is that we love the husky plugin and it seemed to be working fine for a few days but at some point it does this.
Have you heard of such issues before? What do you propose?
Thank you in advance.
For reference, im adding this from the server slow log that logs functions over 5sec (you can check in ftp i provided in the previous ticket in home/mrphoneg/logs access.log and slow.log)
After reading these three posts about the same issue
https://pluginus.net/support/topic/database-requests-crashing-server/
https://pluginus.net/support/topic/woof-filters-plugin-crashes-website-server/
https://pluginus.net/support/topic/extremely-high-number-of-sql-queries-from-husky-plugin/
Ive concluded that these features: empty values and dynamic recount along with the big number of filter options is what cause the problem. Can you help me with the questions below
1 From what i can see, the"Hide empty terms" is connected with"Dynamic recount". For us, the"Hide empty terms" feature is the reason we chose the Husky plugin so we need it, but for the"Show count" feature, if we keep it disabled, does it make any difference in the server load or these are calculated anyway in order to hide the empty terms ?
2 In Andvanced Options i see"Hide terms count text", what does this do and whats the difference to the setting"Show count" in the options page?
3 How can i check that the"Cache dynamic recount number for each item in filter" and"Cache terms" work, where are those records stored?
4 Can you provide two example functions so that in a specific page i can enable specific filters (in order to minimize the loading of unneeded attributes)?
More specifically,
in the main shop page, i want to have active only the [pa_marka] and [pa_μοντέλο-iphone]
in the https://mrphone.gr/c/axesouar-kiniton/thikes-kiniton/ show only the [pa_montelo-xiaomi]
5 Something strange, is that a few hours ago i disabled more than half of the filters but i dont see any difference in the server load, Can you explain that?
6 Lasty, being the delevoler and understanding how the plugin works, do you think that the spikes we see in the server activity is caused by the calculations done to the cached data about showing and hiding the empty items and calculating the number of each item or the server load is due to the actual queries to get the filtered products? Because after disabling the"Hide empty terms" then the server load is none.
Do you think there is any way to optimize the"Hide empty terms" feature so that its not so heavy load?
Check here another test, where the"Hide empty terms" is disabled (but the use of filters and the website traffic is steady)
Thank you in advance for the support.
Another issue im facing, is that ive disabled many of the pages where i dont need the filters to show in order to minimize server loading, one of those pages is the main shop page where i display only categories.
The issue im facing is with the form i have in the home page that redirects to the shop page. So, i need to dynamically disable the filters from the home page normally but when there is the swoof parameter in the url, the filters should be enabled.
What do you think? How is that possible?
Thanks
Sorry for the multiple messages, but im trying to resolve this as much as possible, so one more question, what is less heany, to have have one the attributes as much consolidated as possible or not? For example, if we have capacity, is it better to add the values for battery capacity and storage capacity together in one attribute or its better to have one attribute for battery capacity and another for storage capacity, does it make any difference on the resources needed?
Hello
1 Without dynamic recalculation, the plugin will not know which terms to hide.
2 If you disable Show count in the main options, this will automatically disable dynamic recalculation, which in turn will disable hiding empty terms. In advanced settings it will simply hide the numbers
3 You can check it in DB : woof_query_cache
4 You can use front builder - https://products-filter.com/video#dqGQgzcb5yw OR try - https://wordpress.org/plugins/woof-by-category/
5 If you disabled filters that have a minimum number of terms, there is nothing strange about this.
6 Our plugin doesn't have a cache warmup feature (if that's what you're asking). Therefore, these are most likely real requests for filtering.
to dynamically disable the filters - You can try to use this hook - woof_disable_filter OR you can customize this function - https://share.pluginus.net/image/i20251007001314.png in -"plugins\woocommerce-products-filter\index.php"
what is less heany - Combining multiple attributes into one attribute can reduce the load, but not significantly. It is better to reduce the number of terms as much as possible. Also, filtering by metadata is a little more effective than by taxonomies.
The most effective methods:
Reduce the number of terms
Show only the necessary filters for the current categories on the page
Use plugin cache
Perhaps you will find something useful from the article - https://products-filter.com/searching-is-slow