ThinkDing  

Go Back   ThinkDing > Member Forums > Pre-Sale Questions
Acceptance Mark
User Name
Password


Reply
 
Thread Tools Search this Thread
  #1  
Old 09-02-2005, 09:41 PM
minimum minimum is offline
Junior Member
 
Join Date: Sep 2005
Posts: 5
Default DB Size Questions

From your site:
Quote:
tdSearch works well on a smaller sized table. The script has also been used on a table of about 100K, but at 100K the script can show a performance hit, especially when LIKE queries are allowed. For example, using a table of about 100K and 20,000 rows, searching on two letters takes about 10 seconds, searching on three letters takes about 7 seconds, and searching on four letters takes about 4 seconds. tdSearch has the option to set the number of characters to be used in LIKE queries.

The site that I am working on will contain rather long articles.

So far I have 36 entries and my articles table is 258.1 KB.

With your software, what search times are can I expect now and as the sight grows? Are there optimizations to the software or my db that will help? Or should I assume that tdSearch will not be a good fit due to size and the time it takes to run the query?

I am looking for as turnkey a solution as possible.
Reply With Quote
  #2  
Old 09-03-2005, 10:57 PM
SoapinTrucker's Avatar
SoapinTrucker SoapinTrucker is offline
Member
 
Join Date: Jul 2005
Location: Fresno, California
Posts: 38
Thumbs up

I am not the author obviously, but for what it is worth, I have a search engine built using tdSearch, and currently it has 15,561 links (rows) in it, some containing large amounts of keywords, and/or descriptions.

Here at home, I have a cable modem ISP (Charter), and see no slow down at all in searches, unless they are complicated, using multiple words and boolean logic, even then it is minimal!

Try it yourself, and see what you think!
http://spiderweb.tayon.com/

Good luck!

Mike
Reply With Quote
  #3  
Old 09-05-2005, 06:14 PM
Winston Winston is offline
Administrator
 
Join Date: Jul 2005
Posts: 46
Default

Personally, I would hesitate in using tdSearch on min's size of a table. I haven't run tests with min's specs, but processing through 258K, even if only 36 rows, may be slow. Soap, just curious, what is the size of your search table? BTW, nice spiderweb logo.
Reply With Quote
  #4  
Old 09-05-2005, 10:33 PM
SoapinTrucker's Avatar
SoapinTrucker SoapinTrucker is offline
Member
 
Join Date: Jul 2005
Location: Fresno, California
Posts: 38
Exclamation

Hi Winston!

Thanks for the logo comment

The size of the actual file I upload to phpMyAdmin is about 7-8 meg now!!!

phpMyAdmin shows it as 13.1 meg.......................
(Data 7,699 KB, Index 5,715 KB, Total 13,414 KB)

As of a minute ago that is, and contains 22,207 rows/links!

Mike

Last edited by SoapinTrucker : 09-05-2005 at 10:47 PM. Reason: update table size info
Reply With Quote
  #5  
Old 09-05-2005, 10:52 PM
SoapinTrucker's Avatar
SoapinTrucker SoapinTrucker is offline
Member
 
Join Date: Jul 2005
Location: Fresno, California
Posts: 38
Default

Winston, does the way a db/table get indexed help the speed? (I'm guessing it does, but the point is, HOW to make an index that speedy........mine seems to be in overdrive, it is fast! (LOL ))
Reply With Quote
  #6  
Old 09-06-2005, 12:57 AM
Winston Winston is offline
Administrator
 
Join Date: Jul 2005
Posts: 46
Default

Quote:
Originally Posted by SoapinTrucker
phpMyAdmin shows it as 13.1 meg.......................
(Data 7,699 KB, Index 5,715 KB, Total 13,414 KB)

As of a minute ago that is, and contains 22,207 rows/links!

Hmm, I may have mistyped 100K, but I'm not sure what I meant, as I no longer have that data. I just searched on "a or e or i or o or u" (without quotes) on Soap's spiderweb and got 4.75, 4.68, 4.78, 4.82, and 4.54 on five searches of the same. Looks like I need to take new benchmarks.

Quote:
Originally Posted by SoapinTrucker
Winston, does the way a db/table get indexed help the speed? (I'm guessing it does, but the point is, HOW to make an index that speedy........mine seems to be in overdrive, it is fast! (LOL ))

The way content is inserted into the search table does not depend on, and I'd say (without testing indexes and such) it doesn't really affect, how tdSearch searches said table: tdSearch uses the same procedure i.e. script to search the table regardless of method used to insert table content.
Reply With Quote
  #7  
Old 09-06-2005, 03:11 AM
SoapinTrucker's Avatar
SoapinTrucker SoapinTrucker is offline
Member
 
Join Date: Jul 2005
Location: Fresno, California
Posts: 38
Default

did you type in the aeiou all at once, like this "a ?e ?i ?o ?u" (without quotes of course)? I just did, as a single search entry and it took 4.8, is that good? Didn't seem so bad here
Reply With Quote
  #8  
Old 09-06-2005, 03:44 AM
Winston Winston is offline
Administrator
 
Join Date: Jul 2005
Posts: 46
Default

Three new searches: "a or e or i or o or u" (with spaces, without quotes) => 4.72, 4.80, 4.46 seconds

Three new searches: "a ?e ?i ?o ?u" (with spaces, without quotes) => 4.52, 6.27, 4.86 seconds
Reply With Quote
  #9  
Old 09-06-2005, 08:56 AM
SoapinTrucker's Avatar
SoapinTrucker SoapinTrucker is offline
Member
 
Join Date: Jul 2005
Location: Fresno, California
Posts: 38
Default

Hmmmm.........so it IS fast, yes?

OK, I just now (5 min ago..........) updated the db, it now has:
25483 rows (links), and the table is 15MEG as reported by phpMyadmin,
Data 8,790 KB/Index 6,535 KB=Total 15,325 KB

Whooo hooo....pretty big, I'm not sure how big I can make it,
but I guess I'll find out (LOL).

Mike
Reply With Quote
  #10  
Old 09-06-2005, 06:36 PM
minimum minimum is offline
Junior Member
 
Join Date: Sep 2005
Posts: 5
Default

Quote:
Originally Posted by SoapinTrucker
Hmmmm.........so it IS fast, yes?

OK, I just now (5 min ago..........) updated the db, it now has:
25483 rows (links), and the table is 15MEG as reported by phpMyadmin,
Data 8,790 KB/Index 6,535 KB=Total 15,325 KB

Whooo hooo....pretty big, I'm not sure how big I can make it,
but I guess I'll find out (LOL).

Mike



well then...

looks encouraging! Thanks for the stat and the site to test out. It looks like I'll give it a go and see how well the package does. I'll post when I get some first impressions.

wish me luck

-m
Reply With Quote
Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Forum Jump



All times are GMT. The time now is 10:34 PM.


Powered by: vBulletin Version 3.0.7
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.
Copyright © 2001 - 2005, ThinkDing LLC. All Rights Reserved.