The idea of using charts is to show some statistic about some vars, and statistic can’t show only the first page of rows of the current table. It must show the data that we are filtering but, different from the table, we are getting 2 or 3 vars, so you can reflect all rows data for the chart.
Right now using charts with table filters is not usable on server side because it gets the data of the first page only.