Login

Who's Online

We have 1 guest online

Google








Home arrow Programmingarrow Joomla Extensionsarrow Size problem
Discussion Forum
January 09, 2009, 03:50:45 AM *
Welcome, Guest. Please login or register.

Login with username, password and session length
News: SMF - Just Installed!
 
   Home   Help Search Login Register  
Pages: [1]
  Print  
Author Topic: Size problem  (Read 771 times)
karthik085
Newbie
*
Posts: 8


View Profile Email
« on: November 29, 2007, 10:39:15 PM »

Hi,

I am trying to import a huge set of references into Joomla Bibtex - have around 19000 items. I was able to get only 6300 items imported. Others, it wouln't import at all. Is there a limitation on how many entries can be present in the database? How can I remove it?

Also, if it helps - I broke down 19000 items into small parts -  each part - 500 items.

Also, how can I increase upload filesize? I believe - it is currently set to 1M.

Thanks,
Karthik

UPDATE: Wehn I add by bibtex string, I don't get the above problem - But, I get
"Maximum execution time of 30 seconds exceeded in ..."
For a small set, entries does get added.
« Last Edit: November 29, 2007, 11:48:01 PM by karthik085 » Logged
Mark Austin
Administrator
Full Member
*****
Posts: 101



View Profile Email
« Reply #1 on: December 05, 2007, 03:06:46 PM »

There is no limit in the database.  The problem is the php timeout limit for an operation and the file upload size limit.  These are set by your server in the php.ini file.  I put a limit on the filesize because most servers have a fairly low limit on files, so you will have to change this too.  It is in the jombib.html.php file line 115, the MAX_FILE_SIZE input variable.  This is why you have a different result with the string and file uploads.  With your file upload the filesize limit prevents you from uploading.  With the string, the execution time limit is reached.  In your php.ini (on the server, make sure you edit the right one and back it up) change max_execution_time and upload_max_filesize.  I have not tested a set of references of that size, so if these solutions do not do the trick then let me know.
Logged
karthik085
Newbie
*
Posts: 8


View Profile Email
« Reply #2 on: December 05, 2007, 06:56:55 PM »

I tested on another server - where I had a full control. I increased execution time on php.ini file, keep alive timeouts on apache server and firefox browser - didn't work. :-(

The following solution worked to a good extent:
I broke down the references into sets of 500 each -> uploaded them to the server -> on administrator/components/com_jombib/jombib.php -> line 542 - where you check if input type is a file.
In that block, I commented out $filename and $origfilename statements and passed in absolute path of the filename I wanted to get added to $bibtex->loadFile. That seemed to do the trick.

I was able to do this trick for most of the references. There was 2 files - that didn't get added at all -> took at long time for the browser to go to next page -> and when it did, it went to Joomla administrator main page. I can send you the same files to your email account - if you want to replicate the errors and test it.

MAX_FILE_SIZE: Figured that out....didn't catch my eyes earlier...:-)

BTW, why does your top webpage  say it was hacked?
Logged
Mark Austin
Administrator
Full Member
*****
Posts: 101



View Profile Email
« Reply #3 on: December 05, 2007, 07:10:18 PM »

What failed on that second server?  How far did it get?  I have noticed that someone has hacked my top page but thanks for reminding me.  I'd better go and sort that out now.
Logged
karthik085
Newbie
*
Posts: 8


View Profile Email
« Reply #4 on: December 05, 2007, 09:15:58 PM »

For the 2 files that had problems - they never got added to the database. When I asked BibTex component to load the file, parse it and add it to the database -> nothing happened. I just got redirected to admin control panel main page after a while. It didn't print any errors also. No new entries got added.
Logged
Pages: [1]
  Print  
 
Jump to:  

Powered by SMF 1.1.1 | SMF © 2006, Simple Machines LLC
Joomla Bridge by JoomlaHacks.com
© 2009 Everything That I Know About