need some uncompressed non-zip fast package format

Problems building or running the engine, queries about how to use features etc.
slapin
Bronze Sponsor
Bronze Sponsor
Posts: 401
Joined: Fri May 23, 2025 5:04 pm
x 33

need some uncompressed non-zip fast package format

Post by slapin »

Hi, all!

To make asset management easier and avoid confusion and overhead of zip format,
I'd like to know if there are some library implementing Ogre::Archive which would support
fast indexing and faster loading for game files, no compression or encryption is needed.
Is there anything like that existing?

slapin
Bronze Sponsor
Bronze Sponsor
Posts: 401
Joined: Fri May 23, 2025 5:04 pm
x 33

Re: need some uncompressed non-zip fast package format

Post by slapin »

Ping.

User avatar
Zonder
Ogre Magi
Posts: 1178
Joined: Mon Aug 04, 2008 7:51 pm
Location: Manchester - England
x 76

Re: need some uncompressed non-zip fast package format

Post by Zonder »

There was an implementation around a file system like format but in single file format, which is basically what your describing.

But it was years ago when this was created. Unfortunately I am struggling to find it but one was created.

There are 10 types of people in the world: Those who understand binary, and those who don't...
User avatar
sercero
Bronze Sponsor
Bronze Sponsor
Posts: 553
Joined: Sun Jan 18, 2015 4:20 pm
Location: Buenos Aires, Argentina
x 206

Re: need some uncompressed non-zip fast package format

Post by sercero »

Does zip really have that much overhead?

I did't look at the options but perhaps you can set the compression to minimal to reduce the overhead.

slapin
Bronze Sponsor
Bronze Sponsor
Posts: 401
Joined: Fri May 23, 2025 5:04 pm
x 33

Re: need some uncompressed non-zip fast package format

Post by slapin »

sercero wrote: Sat Jun 20, 2026 1:20 pm

Does zip really have that much overhead?

I did't look at the options but perhaps you can set the compression to minimal to reduce the overhead.

No, zip was never intended as real time storage, It is very slow for many small files...

slapin
Bronze Sponsor
Bronze Sponsor
Posts: 401
Joined: Fri May 23, 2025 5:04 pm
x 33

Re: need some uncompressed non-zip fast package format

Post by slapin »

PhysFS I remember from old days I was using it, is it still alive? Yes, it is! I guess Ogre plugin should exist for it, right?
I did my custom ad-hoc implementation for very primitive requirements, will later try OfsFileSystem and PhysFS.

slapin
Bronze Sponsor
Bronze Sponsor
Posts: 401
Joined: Fri May 23, 2025 5:04 pm
x 33

Re: need some uncompressed non-zip fast package format

Post by slapin »

Also as I see, Ogre .scene is just an XML for Ogre to create nodes, it does not store meshes and other data,
so custom archive oriented for speedy lookups and data access and making easy to package all the mess into one file is still a thing.
So my custom .package thing is still standing until I see benefits of PhysicsFS above that...

User avatar
Zonder
Ogre Magi
Posts: 1178
Joined: Mon Aug 04, 2008 7:51 pm
Location: Manchester - England
x 76

Re: need some uncompressed non-zip fast package format

Post by Zonder »

This was indeed what I was thinking of just couldn't remember (and shows I commented on that thread for it)

There are 10 types of people in the world: Those who understand binary, and those who don't...