DB Size Questions

[minimum]

From your site:
tdSearch works well on a smaller sized table. The script has also been used on a table of about 100K, but at 100K the script can show a performance hit, especially when LIKE queries are allowed. For example, using a table of about 100K and 20,000 rows, searching on two letters takes about 10 seconds, searching on three letters takes about 7 seconds, and searching on four letters takes about 4 seconds. tdSearch has the option to set the number of characters to be used in LIKE queries.

The site that I am working on will contain rather long articles.

So far I have 36 entries and my articles table is 258.1 KB.

With your software, what search times are can I expect now and as the sight grows? Are there optimizations to the software or my db that will help? Or should I assume that tdSearch will not be a good fit due to size and the time it takes to run the query?

I am looking for as turnkey a solution as possible.

[SoapinTrucker]

I am not the author obviously, but for what it is worth, I have a search engine built using tdSearch, and currently it has 15,561 links (rows) in it, some containing large amounts of keywords, and/or descriptions.

Here at home, I have a cable modem ISP (Charter), and see no slow down at all in searches, unless they are complicated, using multiple words and boolean logic, even then it is minimal! :)

Try it yourself, and see what you think! :)
http://spiderweb.tayon.com/

Good luck!

Mike

[Winston]

Personally, I would hesitate in using tdSearch on min's size of a table. I haven't run tests with min's specs, but processing through 258K, even if only 36 rows, may be slow. Soap, just curious, what is the size of your search table? BTW, nice spiderweb logo.

[SoapinTrucker]

Hi Winston! :)

Thanks for the logo comment :)

The size of the actual file I upload to phpMyAdmin is about 7-8 meg now!!! :)

:eek: phpMyAdmin shows it as 13.1 meg.......................
(Data 7,699 KB, Index 5,715 KB, Total 13,414 KB)

As of a minute ago that is, and contains 22,207 rows/links!

Mike

[SoapinTrucker]

Winston, does the way a db/table get indexed help the speed? (I'm guessing it does, but the point is, HOW to make an index that speedy........mine seems to be in overdrive, it is fast! (LOL ))

[Winston]

:eek: phpMyAdmin shows it as 13.1 meg.......................
(Data 7,699 KB, Index 5,715 KB, Total 13,414 KB)

As of a minute ago that is, and contains 22,207 rows/links!

Hmm, I may have mistyped 100K, but I'm not sure what I meant, as I no longer have that data. I just searched on "a or e or i or o or u" (without quotes) on Soap's spiderweb and got 4.75, 4.68, 4.78, 4.82, and 4.54 on five searches of the same. Looks like I need to take new benchmarks. ;)

Winston, does the way a db/table get indexed help the speed? (I'm guessing it does, but the point is, HOW to make an index that speedy........mine seems to be in overdrive, it is fast! (LOL ))
The way content is inserted into the search table does not depend on, and I'd say (without testing indexes and such) it doesn't really affect, how tdSearch searches said table: tdSearch uses the same procedure i.e. script to search the table regardless of method used to insert table content.

[SoapinTrucker]

did you type in the aeiou all at once, like this "a ?e ?i ?o ?u" (without quotes of course)? I just did, as a single search entry and it took 4.8, is that good? Didn't seem so bad here :)

[Winston]

Three new searches: "a or e or i or o or u" (with spaces, without quotes) => 4.72, 4.80, 4.46 seconds

Three new searches: "a ?e ?i ?o ?u" (with spaces, without quotes) => 4.52, 6.27, 4.86 seconds

[SoapinTrucker]

Hmmmm.........so it IS fast, yes?

OK, I just now (5 min ago..........) updated the db, it now has:
25483 rows (links), and the table is 15MEG as reported by phpMyadmin,
Data 8,790 KB/Index 6,535 KB=Total 15,325 KB :)

Whooo hooo....pretty big, I'm not sure how big I can make it,
but I guess I'll find out (LOL).

Mike

[minimum]

Hmmmm.........so it IS fast, yes?

OK, I just now (5 min ago..........) updated the db, it now has:
25483 rows (links), and the table is 15MEG as reported by phpMyadmin,
Data 8,790 KB/Index 6,535 KB=Total 15,325 KB :)

Whooo hooo....pretty big, I'm not sure how big I can make it,
but I guess I'll find out (LOL).

Mike


well then...

looks encouraging! Thanks for the stat and the site to test out. It looks like I'll give it a go and see how well the package does. I'll post when I get some first impressions.

wish me luck

-m

[Winston]

Good luck. ;)

FYI: The tdSearch start time is right before the database connection, and the tdSearch end time is right before the HTML tag.

[SoapinTrucker]

I'm betting you will LOVE tdsearch Min once you get to know it :)

I'm also betting it works fine for ya! :)

Mike