"Export to CSV" is working slow

[imre]

Hi,

I experienced that function "Export to CSV" is working very slow on large set of rows. We need to export data, that typically consists 40.000-50.000 rows (from a table with 10 columns). Creating and downloading the CSV file consumes 30-60 minutes in Dadabik. But if I export the (whole) table directly from the underlying postgres database it takes only 5 seconds.

Is there any option I could use to make the Dadabik CSV export faster?

Thanks for your help,
Imre

-----------------------

Your current DaDaBIK version
You are using DaDaBIK version 10.2-Manarola platinum, installed on 2020-08-27 00:44:55

System info
PHP Version: 7.3.17
postgres version: 12.3
Web server: Apache/2.4.43 (Win64) OpenSSL/1.1.1g PHP/7.3.17
Client: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/91.0.4472.106 Safari/537.36

 

[eugenio]

Hello,
directly exporting the table is a different process, when you export in dadabik there are a number of activities that are executed, including the JOIN with other tables if you have lookup fields.
More recent DaDaBIK versions have better performances in general so I suggest to upgrade.
If you don't need to sort the rows, I also suggest to set $use_sort_for_csv = 0

Best,