TOPIC:

Large Records Dataset CSV Export 2 weeks 6 days ago #280938

  • Topic Author
  • krkirk
  • Offline
  • New Member
  • New Member
  • Registered
  • Posts: 15
  • Thanks: 0
I am trying to export a large records dataset. Unfortunately the export fails at the Server with a 404 Timeout Error, since the export is so large. It is possible to slicing the data into smaller sets, but this will be very time consuming.

Is there another way to export all of the records without having to slide the data? I can manipulate the data once I have retrieved it from the server.

Thank you

Please Log in or Create an account to join the conversation.

Large Records Dataset CSV Export 2 weeks 5 days ago #280983

  • TheMuffinMan's Avatar
  • TheMuffinMan
  • Offline
  • Administrator
  • Administrator
  • Super Users
  • Posts: 10331
  • Thanks: 827
Hi,

are you able to raise your php script execution limit on your webserver?

Regards,
Markus

Please Log in or Create an account to join the conversation.

Large Records Dataset CSV Export 2 weeks 5 days ago #281037

  • Topic Author
  • krkirk
  • Offline
  • New Member
  • New Member
  • Registered
  • Posts: 15
  • Thanks: 0
Hello Marcus,
Thank you for the response. The max_execution_time is set to 120 Secs and cannot be edited.

Please Log in or Create an account to join the conversation.

Large Records Dataset CSV Export 2 weeks 4 days ago #281070

  • TheMuffinMan's Avatar
  • TheMuffinMan
  • Offline
  • Administrator
  • Administrator
  • Super Users
  • Posts: 10331
  • Thanks: 827
Hi,

I gonna try to add an auto-chunked downloader as new feature. This would be at queue #3 from the current list that I have. Is this ok for you?

Idea is that it chunks all records, stores them in cache on the client and the client itself merges the chunks.
This is highly experimental, but worth exploring. Only drawback I could see would be that if the data is getting even bigger, it will slow down the client as it will consume memory.

Regards,
Markus

Please Log in or Create an account to join the conversation.

Large Records Dataset CSV Export 2 weeks 4 days ago #281072

  • Topic Author
  • krkirk
  • Offline
  • New Member
  • New Member
  • Registered
  • Posts: 15
  • Thanks: 0
Hello Markus,

   I think it is worth a try.  For my purpose, .csv export is for analysis and trending on the data.  I would only need to make this evaluation every 6 months.  

Thanks

Please Log in or Create an account to join the conversation.

  • Page:
  • 1
Moderators: ForumSupport
Time to create page: 0.052 seconds

Support Discord

Join our Discord and enter the Crosstec channels for live-support, chat forums and directly interacting with the community!

Quick Links

Downloads

BreezingForms

ContentBuilder

BreezingCommerce

Templates

Documentation

BreezingForms

ContentBuilder

BreezingCommerce

Apprendre BreezingForms (French Community)

Apprendre et maîtriser BreezingForms par des tutoriels et exemples, le tout en français

breezingforms.eddy-vh.com

Questions et réponses sur les forums de l'AFUJ

AFUJ

Subscribe to news and updates!

Special Offer

Sale! All subscriptions at a special price!

Includes prio support, all of our current and future Joomla!® extensions and Joomla!® templates for the duration of your membership.

Get it from here

3rd Party Discount - 25% Off

We help you to keep your costs under control. If you are a new member and purchased a form building tool from a different form vendor, then you'll get a 25% discount on our subscription plans.

How to receive the discount:

Send us a quick email to sales@crosstec.org with a proof of purchase (for example a paypal receipt), await payment instructions and enjoy your membership!

Live Support Chat Opened!

Join our Discord chat here and enter the Crosstec channels to receive live support and talk directly to the team!