Handle huge amount of data using Java EE
We have a Java EE application that support Oracle, MySQL and SQL Server vendors.
we are using a view model to view the fetched data from DB, also using pagination in the DAO model, and that’s working good so far, but now we are working with millions of records like 10 millions, that cause to us a big problem since our application performance issues become very bad. After some investigations we had make we found that the order by in the query cause a big slowness in the DB level, but we still have to use it.
The question is : is there any technique to work with this amount of data with a good performance (response time and memory issues) ?
One Solution collect form web for “Handle huge amount of data using Java EE”
If you use
ORDER BY clause frequently you should create an index on field your are ordering by. It would dramatically increase ordering performance (but of course will slightly slow down insertion).