• Login
  • Register
  • Dolphin Forums
  • Home
  • FAQ
  • Download
  • Wiki
  • Code


Dolphin, the GameCube and Wii emulator - Forums › Game Modifications › Custom Texture Projects v
1 2 3 4 5 ... 12 Next »

Custom Texture Tool PS v50.1
View New Posts | View Today's Posts

Pages (117): « Previous 1 ... 43 44 45 46 47 ... 117 Next »
Jump to page 
Thread Rating:
  • 8 Vote(s) - 4.88 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Thread Modes
Custom Texture Tool PS v50.1
11-04-2017, 03:58 AM
#441
Bighead Offline
Oversized Cranium
*******
Posts: 1,985
Threads: 15
Joined: Aug 2011
I unfortunately have no more ideas on what the issue could be. My only remaining guess is that VirtualBox is not flawless with how it handles memory using a windows guest on a linux host. This is most likely treading into new territory where few have gone, you may be the first person to ever install a windows VM on linux for the purpose of creating BC7 textures. I don't think there's anything I can do about it, the script is just a fancy way of picking options to feed into the programs, and the programs themselves are the culprit here (which one is questionable, my guess is VirtualBox and not TexConv). I highly doubt the script is corrupting the textures, the only thing it does that any of the programs do not do is splice together mipmap textures. This can cause corruption if done incorrectly, but not the type of corruption you are seeing (it will only affect lower mipmaps), and I have long nailed down that issue.

I can throw out one last chain of ideas.

- Maybe it's a problem with that specific OS, as in VirtualBox does not like Windows 10. Perhaps you would have better luck with Windows 7 or Windows 8, they have been around a lot longer so I can only assume support is better. Windows 7 uses PowerShell v2, which my script supports, but can also be updated. There are a few near useless features that won't be missed by using this version of PS. I have never tested Windows 10 as a guest because my main OS is windows 10. The only operating systems I've installed as guests are Windows 7, 8, and linux Ubuntu (just to try it out).

- Maybe it's an actual memory management bug in VirtualBox, in this case it might be worth making a post on their support forum. The people there are probably far better in dealing with this issue than I am. Like I said before, this might only be a bug when using Linux host and windows guest, or more specifically, Windows 10 guest.

- Maybe you do actually have a bad stick of RAM that passes memory tests. There was a time I had a stick of G.Skill DDR3 1600Mhz that passed MemTest86, and multiple hours of torture tests. But, I would randomly get blue screens while doing heavy tasks every couple of days. This nightmare took weeks to figure out the issue. I thought it was my overclock being unstable, but it persisted at stock settings. It wasn't until I started pulling RAM did I find the problem.

- Perhaps you'll have better luck with a different VM altogether. I only have experience with VirtualBox, so I can't make any solid suggestions there. The unfortunate thing about others is they can cost a lot of money. VMware for example can go for over 200 dollars.

- Maybe there is software that exists natively for linux that can create BC7 (BPTC) textures. I don't use linux and know very little about it, so I haven't really looked too hard. It probably won't offer any of the features of my script (most importantly separating normal images from mipmap images), but it could be a solution to just simply wanting to create BC7 textures. The entire "DDS" format and the various types of block compression used in DDS is mostly a Microsoft/Direct-X thing, so it's hard to find anything outside of windows.

- The last suggestion I can offer is to scrap the whole VM idea and use a dedicated Windows PC/laptop, or dual boot with your current rig.
Donate - Custom Texture Tool - Xenoblade Chronicles HD - New Super Mario Bros. Wii HD - Paper Mario: TTYD HD (Contributor) - Skies of Arcadia HD
Website Find
Reply
11-04-2017, 04:56 AM
#442
Techie Android Away
Member
***
Posts: 219
Threads: 1
Joined: Dec 2015
(11-04-2017, 03:58 AM)Bighead Wrote: I unfortunately have no more ideas on what the issue could be. My only remaining guess is that VirtualBox is not flawless with how it handles memory using a windows guest on a linux host. This is most likely treading into new territory where few have gone, you may be the first person to ever install a windows VM on linux for the purpose of creating BC7 textures. I don't think there's anything I can do about it, the script is just a fancy way of picking options to feed into the programs, and the programs themselves are the culprit here (which one is questionable, my guess is VirtualBox and not TexConv). I highly doubt the script is corrupting the textures, the only thing it does that any of the programs do not do is splice together mipmap textures. This can cause corruption if done incorrectly, but not the type of corruption you are seeing (it will only affect lower mipmaps), and I have long nailed down that issue.

I can throw out one last chain of ideas.

- Maybe it's a problem with that specific OS, as in VirtualBox does not like Windows 10. Perhaps you would have better luck with Windows 7 or Windows 8, they have been around a lot longer so I can only assume support is better. Windows 7 uses PowerShell v2, which my script supports, but can also be updated. There are a few near useless features that won't be missed by using this version of PS. I have never tested Windows 10 as a guest because my main OS is windows 10. The only operating systems I've installed as guests are Windows 7, 8, and linux Ubuntu (just to try it out).

- Maybe it's an actual memory management bug in VirtualBox, in this case it might be worth making a post on their support forum. The people there are probably far better in dealing with this issue than I am. Like I said before, this might only be a bug when using Linux host and windows guest, or more specifically, Windows 10 guest.

- Maybe you do actually have a bad stick of RAM that passes memory tests. There was a time I had a stick of G.Skill DDR3 1600Mhz that passed MemTest86, and multiple hours of torture tests. But, I would randomly get blue screens while doing heavy tasks every couple of days. This nightmare took weeks to figure out the issue. I thought it was my overclock being unstable, but it persisted at stock settings. It wasn't until I started pulling RAM did I find the problem.

- Perhaps you'll have better luck with a different VM altogether. I only have experience with VirtualBox, so I can't make any solid suggestions there. The unfortunate thing about others is they can cost a lot of money. VMware for example can go for over 200 dollars.

- Maybe there is software that exists natively for linux that can create BC7 (BPTC) textures. I don't use linux and know very little about it, so I haven't really looked too hard. It probably won't offer any of the features of my script (most importantly separating normal images from mipmap images), but it could be a solution to just simply wanting to create BC7 textures. The entire "DDS" format and the various types of block compression used in DDS is mostly a Microsoft/Direct-X thing, so it's hard to find anything outside of windows.

- The last suggestion I can offer is to scrap the whole VM idea and use a dedicated Windows PC/laptop, or dual boot with your current rig.

Thanks. I think I'm going to do the last option since I do have an old laptop with Windows 10 on it, let me try that.
Find
Reply
11-06-2017, 12:39 AM
#443
Techie Android Away
Member
***
Posts: 219
Threads: 1
Joined: Dec 2015
I'm going to be programming in C++ on Linux, I want to make a simple program to just convert the png textures within a folder to DDS BC7 what source code other than for Compressonator and TexConv do I need?
Find
Reply
11-06-2017, 06:03 AM
#444
Bighead Offline
Oversized Cranium
*******
Posts: 1,985
Threads: 15
Joined: Aug 2011
I honestly don't really know. Like I've said before, I'm not a programmer, it's way over my head and I never had the ambition to learn anything beyond what was needed for this script. And I only had ambition to work on this for so long because it filled the specific void of an automated texture tool for Dolphin, and made my life easier (and hopefully others). It's nice to see someone else want to take up the task though.

I did do a bit more searching for actual linux programs that can create BC7 images. Here is what I found.

Compressonator supposedly now has linux support merged as of 12 days ago. There are no public builds so you may have to build it yourself.
https://github.com/GPUOpen-Tools/Compressonator/pull/23

Nvidia Texture Tools (not the same as DDS Utilities) has a linux version. I never even knew this existed until now.
https://github.com/castano/nvidia-texture-tools/releases

Another program that looks promising. This one even builds for OS X.
https://github.com/GameTechDev/ISPCTextureCompressor

I also found this which supposedly has a linux build, but I haven't tried it out.
https://sourceforge.net/projects/texgenpack/

If any of those tools work it could maybe save you some time, then maybe a bash script could loop through your folder.

I also remember leoetlino creating something similar awhile back using libmagick (ImageMagick), but it doesn't support BC7. Maybe it will help in some way.
https://github.com/leoetlino/resize-dolphin-pack
Donate - Custom Texture Tool - Xenoblade Chronicles HD - New Super Mario Bros. Wii HD - Paper Mario: TTYD HD (Contributor) - Skies of Arcadia HD
Website Find
Reply
11-06-2017, 06:19 AM
#445
Techie Android Away
Member
***
Posts: 219
Threads: 1
Joined: Dec 2015
(11-06-2017, 06:03 AM)Bighead Wrote: I honestly don't really know. Like I've said before, I'm not a programmer, it's way over my head and I never had the ambition to learn anything beyond what was needed for this script. And I only had ambition to work on this for so long because it filled the specific void of an automated texture tool for Dolphin, and made my life easier (and hopefully others). It's nice to see someone else want to take up the task though.

I did do a bit more searching for actual linux programs that can create BC7 images. Here is what I found.

Compressonator supposedly now has linux support merged as of 12 days ago. There are no public builds so you may have to build it yourself.
https://github.com/GPUOpen-Tools/Compressonator/pull/23

Nvidia Texture Tools (not the same as DDS Utilities) has a linux version. I never even knew this existed until now.
https://github.com/castano/nvidia-texture-tools/releases

Another program that looks promising. This one even builds for OS X.
https://github.com/GameTechDev/ISPCTextureCompressor

I also found this which supposedly has a linux build, but I haven't tried it out.
https://sourceforge.net/projects/texgenpack/

If any of those tools work it could maybe save you some time, then maybe a bash script could loop through your folder.

I also remember leoetlino creating something similar awhile back using libmagick (ImageMagick), but it doesn't support BC7. Maybe it will help in some way.
https://github.com/leoetlino/resize-dolphin-pack

Okay thanks for the research (I'm positive it will come in handy soon).

I think right now I'm just trying to figure out what programs I can do without, and which I will be implementing.

I just want basic functionality right now, all I want it to do is convert from png to DDS BC7.

I know in the past you've told me both the Compressonator and TexConv are required since the Compressonator doesn't handle everything.
Find
Reply
11-22-2017, 09:19 AM (This post was last modified: 11-22-2017, 09:22 AM by Techie Android.)
#446
Techie Android Away
Member
***
Posts: 219
Threads: 1
Joined: Dec 2015
I had some free time on my hands and thought about updating my Windows build in my VM. So I opened it up and updated Windows to the latest insider build, saw that TexConv and ImageMagick also had an update so I did them as well, then saw your PS script had an update so I did it too.

Then I was curious to try something.

I took this texture of mine and converted it to DDS BC7 using both the Compressonator and TexConv, both corrupted it as happened before, but the I did DDS DXT1, DXT5 and ARGB32, they all worked!

Spoiler: (Show Spoiler)
[Image: 9uwMgZo.png]

So I've managed to narrow the issue to something about DDS BC7, I don't know how to proceed from here though. I thought you might know why that's the one and only option failing.

Do you want to run that texture through as DDS BC7 and see what it does? It will probably work for you, but you might want to try it just in case it's something on my end with the way I made the texture.
Find
Reply
11-22-2017, 09:57 AM
#447
Bighead Offline
Oversized Cranium
*******
Posts: 1,985
Threads: 15
Joined: Aug 2011
No corruption in either my Win7 or Win8 VMs.

Spoiler: (Show Spoiler)
[Image: NsldSNy.png]
[Image: NJjgTIe.png]
I don't think Compressonator works in a VM, or at least it didn't work for me last time I tried it. I did not install or test it before this post, but I will look more into this. I think selecting it would try to use it, and it will silently fail and choose TexConv. This can be verified if the script is modified on line 753 and $Debug = $true. When converting textures the script will report which programs fail and which its actually using to create textures.

Now that it's narrowed down to just BC7 I'll try to look into this more. Maybe toggling a setting for TexConv that I don't know about at the moment may work. I was also thinking about scrapping the outdated DDS Utilities support and replacing it with Nvidia Texture Tools since it can also do BC7, and I believe you can force CPU or CUDA to do the encoding. I don't know when this will be, but most likely within 1-3 days.
Donate - Custom Texture Tool - Xenoblade Chronicles HD - New Super Mario Bros. Wii HD - Paper Mario: TTYD HD (Contributor) - Skies of Arcadia HD
Website Find
Reply
11-22-2017, 10:59 AM
#448
Techie Android Away
Member
***
Posts: 219
Threads: 1
Joined: Dec 2015
(11-22-2017, 09:57 AM)Bighead Wrote: No corruption in either my Win7 or Win8 VMs.

Spoiler: (Show Spoiler)
[Image: NsldSNy.png]
[Image: NJjgTIe.png]
I don't think Compressonator works in a VM, or at least it didn't work for me last time I tried it. I did not install or test it before this post, but I will look more into this. I think selecting it would try to use it, and it will silently fail and choose TexConv. This can be verified if the script is modified on line 753 and $Debug = $true. When converting textures the script will report which programs fail and which its actually using to create textures.

Now that it's narrowed down to just BC7 I'll try to look into this more. Maybe toggling a setting for TexConv that I don't know about at the moment may work. I was also thinking about scrapping the outdated DDS Utilities support and replacing it with Nvidia Texture Tools since it can also do BC7, and I believe you can force CPU or CUDA to do the encoding. I don't know when this will be, but most likely within 1-3 days.

Okay thanks I'll do that and narrow it down as far as I can.
Find
Reply
11-22-2017, 09:39 PM
#449
Bighead Offline
Oversized Cranium
*******
Posts: 1,985
Threads: 15
Joined: Aug 2011
I have two versions you can try to test. I have not yet finished with switching DDS Utilities to Nvidia Texture Tools, so that can not be tested, but while doing so I thought why not try this stuff now. Try converting to DDS, using TexConv, and BC7 as output. Version t01 removes a flag to do exhaustive compression, and t02 forces the CPU to do conversions. If either or both of them work it will tell me a lot. If neither work, I won't know what else to try as far as TexConv is concerned.

http://www.mediafire.com/file/ht0dzhbth7z628d/Custom+Texture+Tool+PS+v27.x+VM+Tests.zip
Donate - Custom Texture Tool - Xenoblade Chronicles HD - New Super Mario Bros. Wii HD - Paper Mario: TTYD HD (Contributor) - Skies of Arcadia HD
Website Find
Reply
11-23-2017, 09:09 AM
#450
Techie Android Away
Member
***
Posts: 219
Threads: 1
Joined: Dec 2015
(11-22-2017, 09:39 PM)Bighead Wrote: I have two versions you can try to test. I have not yet finished with switching DDS Utilities to Nvidia Texture Tools, so that can not be tested, but while doing so I thought why not try this stuff now. Try converting to DDS, using TexConv, and BC7 as output. Version t01 removes a flag to do exhaustive compression, and t02 forces the CPU to do conversions. If either or both of them work it will tell me a lot. If neither work, I won't know what else to try as far as TexConv is concerned.

http://www.mediafire.com/file/ht0dzhbth7z628d/Custom+Texture+Tool+PS+v27.x+VM+Tests.zip

I just tested them both. The first PS test file made the texture corrupted like before. However the second PS test file did fine, the texture was perfect! I had a feeling having the CPU process it in the VM was the best way to go.

I can document this or send the log files if you want.

Thanks.
Find
Reply
« Next Oldest | Next Newest »
Pages (117): « Previous 1 ... 43 44 45 46 47 ... 117 Next »
Jump to page 


  • View a Printable Version
  • Subscribe to this thread
Forum Jump:


Users browsing this thread: 2 Guest(s)



Powered By MyBB | Theme by Fragma

Linear Mode
Threaded Mode