Jump to content

Data Merge is exceptionally slow


Recommended Posts

I am trying to create a digital planner. Using a data merge with a CSV file is exceptionally slow (hour+) or just crashes. I have seen on other threads here this is a known issue. Has there been any word from development regarding this? Has anyone had "work arounds"? Does anyone know of a program that is better served for generating 3000 page data merged projects?

I love Publisher and designing worksheets for school in the program. But, this is very frustrating.

Thank you in advance,

Brian 

Link to comment
Share on other sites

Personally I use InDesign, and for anything more complex, web based script (PHP/ASP/ASP.NET) + database (Access, MySQL, Microsoft SQL, JSON, CSV) solutions, sometimes along with PDF libraries (all operable also as local, non-cloud-based techniques), which are robust and fast methods, but likely not practical solutions either because of the cost (InDesign, or need for PDF libraries), or the schedule (web solutions; both the "engine" and the "manual", with examples, available basically free of charge, but requiring some learning).

For at least simple merges, you could try Word or LibreOffice Writer MailMerge functionality and then place the resulting merge pages as an RTF or Word .docx file in Publisher.

Or if you have 1.x version of Publisher, try if it works better there. With certain kinds of mail merges, especially ones involving thousands of records, it has been shown on this forum to work significantly better then version 2 data merge (even if still slow, compared to other similar solutions).

Link to comment
Share on other sites

On 10/16/2024 at 1:54 AM, lacerto said:

Personally I use InDesign, and for anything more complex, web based script (PHP/ASP/ASP.NET) + database (Access, MySQL, Microsoft SQL, JSON, CSV) solutions, sometimes along with PDF libraries (all operable also as local, non-cloud-based techniques), which are robust and fast methods, but likely not practical solutions either because of the cost (InDesign, or need for PDF libraries), or the schedule (web solutions; both the "engine" and the "manual", with examples, available basically free of charge, but requiring some learning).

For at least simple merges, you could try Word or LibreOffice Writer MailMerge functionality and then place the resulting merge pages as an RTF or Word .docx file in Publisher.

Or if you have 1.x version of Publisher, try if it works better there. With certain kinds of mail merges, especially ones involving thousands of records, it has been shown on this forum to work significantly better then version 2 data merge (even if still slow, compared to other similar solutions).

@lacerto

Thank you for your information and response. I have been playing around a little with InDesign. I did a data merge on blank pages with the CSV I was having issues with . InDesign was able to spit out the sheets MUCH quicker, minutes not hours. Now I just have to learn a new program. LOL. So far I am finding that laying out data fields (i.e. setting up a monthly view 7x6 grid and yearly view [7x6]x12 grid) and having it auto populate from my data source is more complicated in InDesign than Publisher. Also, I have not come across a way to have InDesign auto-generate hyperlinks and anchors from the data source. Publisher does that very easy when I set up the Master page properly. It is just slow at the execution of it. 

 

Link to comment
Share on other sites

You're welcome!

Yes, Publisher Data Merge has some very useful and powerful features, especially accepting Excel sheet as a data source can be very helpful as you can preprocess data effectively using Excel formulas (and VBA, if necessary), as can be Data Merge Layout controls to move the record pointer; likewise, ability to directly create hyperlinks and anchors can be quite useful.

Just as a hint for creating hyperlinks in InDesign, there is a batch command that allows you to convert URLs to hyperlinks within the whole document. There is also a possibility to add these kinds of features by using a script (for these purposes, it may help to mark specific fields with character styles, when defining the merge layout).

E.g., something in the line of this free script by Peter Kahrel:

https://creativepro.com/files/kahrel/indesign/index_charstyles.html

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

Loading...
×
×
  • Create New...

Important Information

Terms of Use | Privacy Policy | Guidelines | We have placed cookies on your device to help make this website better. You can adjust your cookie settings, otherwise we'll assume you're okay to continue.