> Also, in these fields with HDF5, you tend to write once read often
Server oriented DBMS specialized in write-once-read-many workflow do exist.
However, you are right: research have completely different data consumption model than web service.
And in HPC, it is:
- Much more efficient to do sub-milliseconds massive parallel data access over a parallel DFS, one network switch away than it is do it over a DBMS.
- Often much more convenient to move a flat file around to do analysis/model modifications of scientifics results on your laptop.
Server oriented DBMS specialized in write-once-read-many workflow do exist.
However, you are right: research have completely different data consumption model than web service.
And in HPC, it is: - Much more efficient to do sub-milliseconds massive parallel data access over a parallel DFS, one network switch away than it is do it over a DBMS.
- Often much more convenient to move a flat file around to do analysis/model modifications of scientifics results on your laptop.