Get WPFTS Pro today with 25% discount!

Best Practices for Implementing Full-Text Search in Large Databases ??

  • Banned

    Hello everyone,

    I am working on a project involving a database with millions of records and I need to implement an efficient full text search feature. I have been reading through the documentation here,, which has been incredibly helpful but I still have a few questions I would love to get insights on:

    What are the best indexing strategies to optimize full text search performance in large datasets: ??
    How do you handle ranking relevance for results, especially when dealing with diverse types of content: ??
    Are there any recommended libraries or frameworks that integrate seamlessly with popular DBs like PostgreSQL or MySQL for full text search: ??

    I am also curious about edge cases like handling misspellings or partial matches should these be addressed through preprocessing or are there tools that handle them natively: ??

    Looking forward to hearing your thoughts and experiences !!

    Thanks in advance !!

    With Regards,
    Marcelo


  • Hi @marcellosalass

    Actually WPFTS could be not that great for you in case you have millions of records (e.g. posts).
    The whole Wordpress could be not good for you either, because to handle such amount of data you will need to use specific optimization and caching algorithms and even clustering.

    I would like to propose you to use full-text solutions based on Apache Solr or Elastic Search - those tools are implemented in Java and work way faster than PHP+MySQL solution provided by WPFTS and they are especially good for big data.

    Alternatively you can wait until we release a new WPFTS version (in 1-2 months) that can use self-hosted Elastic Search engine to keep full-text index and uses WPFTS data collecting algorithms.

    Thank you for the question.

Suggested Topics

  • 7
  • 2
  • 1
  • 3
  • 2

Be the first to read the news!

We are always improving our products, adding new functions and fixes. Subscribe now to be the first to get the updates and stay informed about our sales! We are not spammy. Seriously.

Join Us Now!

We are a professional IT-team. Many of us have been working in a Web IT field for more than 10 years. Our advanced experience of software development has been employed in the creation of the WordPress FullText Search plugin. All solutions implemented into the plugin have been used for 5 or more years in over 60 different web-projects.

We are looking forward to your comments, requests and suggestions in relation to the current plugin and future updates.

ewm-logo-450

The forum powered by NodeBB | Contributors