[darktable-devel] Problem opening Panasonic .RW2 files

Here are no problems anymore with Panasonic .RW2 files.
Seems to be corrected in master.

Thanks a lot!

Post by Bruce Albert
I, too, am having trouble with Panasonic .RW2 files.
Using the git version, it just hangs, and I have to kill it from a shell.
Using the version in the "unstable" repository (1:1.4+124) it does open the file,
/usr/bin/darktable
TIFFReadDirectory: Warning, Unknown field with tag 18246 (0x4746) encountered.
TIFFReadDirectory: Warning, Unknown field with tag 18249 (0x4749) encountered.
TIFFReadDirectory: Warning, Unknown field with tag 50898 (0xc6d2) encountered.
TIFFReadDirectory: Warning, Unknown field with tag 50899 (0xc6d3) encountered.
[tiff_open] 4016x2688 8bpp, 3 samples per pixel.
[rawspeed] Camera 'Panasonic' 'DMC-G2', mode '3:2' not supported, and
not allowed to guess. Sorry.
[imageio] '/home/greenman/Pictures/House-pictures/Flowers/P1000914.RW2'
blacklisted extension passed
to libraw
Note that in both cases, this is after purging all the .xmp files.
Don't know if this is relevant, I tried opening .RW2 images with Rawstudio, which I
believe uses rawspeed (though I have no idea
how up-to-date it is) and it opens and saves with no trouble.
------------------------------------------------------------------------------
WatchGuard Dimension instantly turns raw network data into actionable
security intelligence. It gives you real-time visual feedback on key
security issues and trends. Skip the complicated setup - simply import
a virtual appliance and go from zero to informed in seconds.
http://pubads.g.doubleclick.net/gampad/clk?id=123612991&iu=/4140/ostg.clktrk
_______________________________________________
darktable-devel mailing list
https://lists.sourceforge.net/lists/listinfo/darktable-devel

Bruce Albert

2014-02-01 22:56:34 UTC

Yes, I just pulled and rebuilt from the git master, and it is working, no error messages.
Sorry for the false alarm.
The version that just appeared in Pascal's "unstable" repository (1.4+133) seems to be working, but
still gives the error messages:

[rawspeed] Camera 'Panasonic' 'DMC-G2', mode '3:2' not supported, and not allowed to guess. Sorry.
[imageio] '/home/greenman/Pictures/House-pictures/Flowers/P1000919.RW2' blacklisted extension passed
to libraw

Post by thokster
Here are no problems anymore with Panasonic .RW2 files.
Seems to be corrected in master.
Thanks a lot!

------------------------------------------------------------------------------
WatchGuard Dimension instantly turns raw network data into actionable
security intelligence. It gives you real-time visual feedback on key
security issues and trends. Skip the complicated setup - simply import
a virtual appliance and go from zero to informed in seconds.
http://pubads.g.doubleclick.net/gampad/clk?id=123612991&iu=/4140/ostg.clktrk
_______________________________________________
darktable-devel mailing list
https://lists.sourceforge.net/lists/listinfo/darktable-devel

Moritz Moeller

2014-02-02 12:51:46 UTC

Post by Bruce Albert
I, too, am having trouble with Panasonic .RW2 files.

I convert all my RAWs (from my GH2) to DNG with Adobe DNG Converter
(free) on OS X/Windows or DigiKam's dngcovert on Linux.
This shrinks the data by ~25% and is completely lossless (i.e. the RAW
data is embedded-as is and compressed, all the EXIF tags are copied too).

I never had any trouble reading these. And I save 25% storage
space/bandwidth on loading.

.mm

Patrick Shanahan

2014-02-02 14:46:09 UTC

Post by Bruce Albert
I, too, am having trouble with Panasonic .RW2 files.

I convert all my RAWs (from my GH2) to DNG with Adobe DNG Converter
(free) on OS X/Windows or DigiKam's dngcovert on Linux.
This shrinks the data by ~25% and is completely lossless (i.e. the RAW
data is embedded-as is and compressed, all the EXIF tags are copied too).
I never had any trouble reading these. And I save 25% storage
space/bandwidth on loading.

May work for your RW2 files but my Nikon NEFs suffer ~200% size gain. :^(

--
(paka)Patrick Shanahan Plainfield, Indiana, USA @ptilopteri
http://en.opensuse.org openSUSE Community Member facebook/ptilopteri
http://wahoo.no-ip.org Photo Album: http://wahoo.no-ip.org/gallery2
Registered Linux User #207535 @ http://linuxcounter.net

Patrick Shanahan

2014-02-02 15:46:09 UTC

Post by Bruce Albert
I, too, am having trouble with Panasonic .RW2 files.

I convert all my RAWs (from my GH2) to DNG with Adobe DNG Converter
(free) on OS X/Windows or DigiKam's dngcovert on Linux.
This shrinks the data by ~25% and is completely lossless (i.e. the RAW
data is embedded-as is and compressed, all the EXIF tags are copied too).
I never had any trouble reading these. And I save 25% storage
space/bandwidth on loading.

May work for your RW2 files but my Nikon NEFs suffer ~200% size gain. :^(

Loading Image...

Moritz Moeller

2014-02-03 11:20:20 UTC

Post by Patrick Shanahan
May work for your RW2 files but my Nikon NEFs suffer ~200% size gain. :^(

So? The poster asked about Panasonic RAW. Not Nikon. And the solution I
offered, was, ofc, for Panasonic RW2s. Not Nikon NEFs.

.mm

P.S.: You mean your DNGs are 100% + 200% = 3 times as large as before? I
would certainly report this to Adobe.
I get a considerable size gain when I use the 'embed original RAW' but
you should not use this, for obvious reasons.

P.P.S.: a friend of mine shoots NEF with his Nikon D7100 and tells me
his DNGs are almost 50% the size of the original NEF. So something seems
fishy with the claim you make.

Patrick Shanahan

2014-02-03 13:12:52 UTC

Post by Patrick Shanahan
May work for your RW2 files but my Nikon NEFs suffer ~200% size gain. :^(

no, 200% greater size, would be +100%. Does include raw.

Not interested in adobe products or assisting them in their quest to
obtain my money.

Post by Moritz Moeller
I get a considerable size gain when I use the 'embed original RAW' but
you should not use this, for obvious reasons.
P.P.S.: a friend of mine shoots NEF with his Nikon D7100 and tells me
his DNGs are almost 50% the size of the original NEF. So something seems
fishy with the claim you make.

My sincere apologies, I was including the raw. w/o the included raw, I do
get slightly greater than a 1% (one percent) reduction in file size. I
can provide some representative files for you to try yourself, if you
cannot accept my figures.

Bruce Albert

2014-02-03 14:13:03 UTC

Ditto. Absolute zero interest in dng and adobe.
I could use dcraw to convert to tiff (as I do with Fuji RAF) if it comes to it.
But it does appear that it is fixed in git.

Post by Patrick Shanahan
May work for your RW2 files but my Nikon NEFs suffer ~200% size gain. :^(

no, 200% greater size, would be +100%. Does include raw.
Not interested in adobe products or assisting them in their quest to
obtain my money.

Moritz Moeller

2014-02-03 15:06:37 UTC

Post by Bruce Albert
Ditto. Absolute zero interest in dng and adobe.

Your choice, ofc.
But it sounds a tad like animosity based on ignorance. ;)

In essence it seem So you rather support your camera manufacturer's
obscure/proprietary RAW format that is likely not even open?
See https://en.wikipedia.org/wiki/Raw_image_format#Drawbacks

Post by Bruce Albert
I could use dcraw to convert to tiff (as I do with Fuji RAF) if it comes to it.
But it does appear that it is fixed in git.

Who developed TIFF? Aldous. Which is now Adobe. Ooops. :D

DNG uses TIFF/EP. Or rather: it is an extension of TIFF that offers the
ability to store sensor data.

Using plain TIFF will not preserve the original sensor data.
I.e. you'll loose you the ability to de-Bayer with improved technology
at a later stage because TIFF has no official support for a subformat
that stores raw Bayer data.

That's precisely one of the reasons Adobe did extend TIFF and gave it a
new fancy name: DNG.

On that note: not only TIFF itself, but also most interesting TIFF
extensions have been developed by commercial entities or by people who
had backing from a commercial entity (see
http://fileformats.archiveteam.org/wiki/TIFF).

Furthermore, there is, unfortunately, no open, non-commercially
developed image file format to store photographic data with acceptable
accuracy & metadata support, for the target audience of DT, that ever
succeeded. *Open* format options are:

- DNG (Adobe)
- TIFF (Aldous/Adobe)
- OpenEXR (Industrial Light & Magic)
- Cineon (Kodak)
- FITS (NASA, more or less)

Of all these, only DNG and FITS support for storing undemosaiced data.
But the target application for FITSs are astrophotography. I.e. unlike
DNG, it is quite specialized.

So I totally don't get why people are so negative towards DNG.

Just because the entity who developed this TIFF extension happens to be
Adobe. DNG is still completely open, Adobe has even offered to put the
further development and governing of this standard under an independent
committee at any time.

Anyone can implement a DNG reader or writer w/o having to pay a penny to
them.

.mm

Bruce Albert

2014-02-03 16:46:39 UTC

Thanks for the info, a lot of which I didn't know.
Still, as most of my work is "print it and forget it", conversion seems like an extra and unnecessary
step.
Something to think about for stuff that needs archiving.

Post by Bruce Albert
Ditto. Absolute zero interest in dng and adobe.

Your choice, ofc.
But it sounds a tad like animosity based on ignorance. ;)
In essence it seem So you rather support your camera manufacturer's
obscure/proprietary RAW format that is likely not even open?
See https://en.wikipedia.org/wiki/Raw_image_format#Drawbacks

Post by Bruce Albert
I could use dcraw to convert to tiff (as I do with Fuji RAF) if it comes to it.
But it does appear that it is fixed in git.

Who developed TIFF? Aldous. Which is now Adobe. Ooops. :D
DNG uses TIFF/EP. Or rather: it is an extension of TIFF that offers the
ability to store sensor data.
Using plain TIFF will not preserve the original sensor data.
I.e. you'll loose you the ability to de-Bayer with improved technology
at a later stage because TIFF has no official support for a subformat
that stores raw Bayer data.
That's precisely one of the reasons Adobe did extend TIFF and gave it a
new fancy name: DNG.
On that note: not only TIFF itself, but also most interesting TIFF
extensions have been developed by commercial entities or by people who
had backing from a commercial entity (see
http://fileformats.archiveteam.org/wiki/TIFF).
Furthermore, there is, unfortunately, no open, non-commercially
developed image file format to store photographic data with acceptable
accuracy & metadata support, for the target audience of DT, that ever
- DNG (Adobe)
- TIFF (Aldous/Adobe)
- OpenEXR (Industrial Light & Magic)
- Cineon (Kodak)
- FITS (NASA, more or less)
Of all these, only DNG and FITS support for storing undemosaiced data.
But the target application for FITSs are astrophotography. I.e. unlike
DNG, it is quite specialized.
So I totally don't get why people are so negative towards DNG.
Just because the entity who developed this TIFF extension happens to be
Adobe. DNG is still completely open, Adobe has even offered to put the
further development and governing of this standard under an independent
committee at any time.
Anyone can implement a DNG reader or writer w/o having to pay a penny to
them.
.mm

Moritz Moeller

2014-02-03 17:12:08 UTC

Bruce,

Post by Bruce Albert
Thanks for the info, a lot of which I didn't know.
Still, as most of my work is "print it and forget it",
conversion seems like an extra and unnecessary step.

totally. I, too, never convert anything that I don't want to archive.

.mm

Moritz Moeller

2014-02-03 14:21:41 UTC

Post by Moritz Moeller
P.S.: You mean your DNGs are 100% + 200% = 3 times as large as before? I
would certainly report this to Adobe.

no, 200% greater size, would be +100%. Does include raw.

No, that would be 100% "greater". :) What you mean is 200% "as great as"
the original.
Sorry to be pedantic, but this subtle difference leads to many gross
exaggerations that I come across all the time. :P

Post by Patrick Shanahan
Not interested in adobe products or assisting them in their quest to
obtain my money.

DNG Converter is absolutely free. And frankly, I am thankful we have DNG
because in 20 years, who knows what software will be around to read RAWs
for camera X of maker Y (who has long gone out of business)? A common
standard increases the chances of continued media access a lot.

If you favor OSS, Digikam's DNGConverter is available, apart from
Linux/BSD on OS X and Windows too.

Post by Patrick Shanahan
My sincere apologies, I was including the raw. w/o the included raw, I do
get slightly greater than a 1% (one percent) reduction in file size. I
can provide some representative files for you to try yourself, if you
cannot accept my figures.

These numbers sound reasonable. Size improvements depend a lot on the
picture (noise, camera model, etc.). So you mileage would differ from my
friend's.

Again, this is all OT since the OP asked about a solution for Panasonic
RAWs. And size was not an issue anyway, it was purely about being able
to open their RAWs in DT.

I think we can stop here. :)

.mm

Klaus Post

2014-02-05 09:54:59 UTC

Post by Patrick Shanahan
May work for your RW2 files but my Nikon NEFs suffer ~200% size gain. :^(

Yeah - Nikon uses some lossy compression for some of their RAW formats,
which doesn't translate that well into LJPEG compression. Sony is likely to
have similar situation. However, I do believe at least Sony has an option
to switch to lossless mode, which completely disables compression. As far
as I know most Nikons also have that option - in that case you are more
likely do see compression improvements.

Regards, Klaus Post

http://www.klauspost.com

Post by Bruce Albert
I, too, am having trouble with Panasonic .RW2 files.

I convert all my RAWs (from my GH2) to DNG with Adobe DNG Converter
(free) on OS X/Windows or DigiKam's dngcovert on Linux.
This shrinks the data by ~25% and is completely lossless (i.e. the RAW
data is embedded-as is and compressed, all the EXIF tags are copied too).
I never had any trouble reading these. And I save 25% storage
space/bandwidth on loading.

May work for your RW2 files but my Nikon NEFs suffer ~200% size gain. :^(
--
http://en.opensuse.org openSUSE Community Member facebook/ptilopteri
http://wahoo.no-ip.org Photo Album: http://wahoo.no-ip.org/gallery2
------------------------------------------------------------------------------
WatchGuard Dimension instantly turns raw network data into actionable
security intelligence. It gives you real-time visual feedback on key
security issues and trends. Skip the complicated setup - simply import
a virtual appliance and go from zero to informed in seconds.
http://pubads.g.doubleclick.net/gampad/clk?id=123612991&iu=/4140/ostg.clktrk
_______________________________________________
darktable-devel mailing list
https://lists.sourceforge.net/lists/listinfo/darktable-devel

Patrick Shanahan

2014-02-05 15:24:15 UTC

Post by Bruce Albert
I, too, am having trouble with Panasonic .RW2 files.

I convert all my RAWs (from my GH2) to DNG with Adobe DNG Converter
(free) on OS X/Windows or DigiKam's dngcovert on Linux.
This shrinks the data by ~25% and is completely lossless (i.e. the RAW
data is embedded-as is and compressed, all the EXIF tags are copied too).
I never had any trouble reading these. And I save 25% storage
space/bandwidth on loading.

May work for your RW2 files but my Nikon NEFs suffer ~200% size gain. :^(

Colin Adams

2014-02-05 15:29:29 UTC

For the Nikon D300, there are 3 choices - lossy, lossless and no
compression.

Post by Bruce Albert
I, too, am having trouble with Panasonic .RW2 files.

I convert all my RAWs (from my GH2) to DNG with Adobe DNG Converter
(free) on OS X/Windows or DigiKam's dngcovert on Linux.
This shrinks the data by ~25% and is completely lossless (i.e. the

RAW

Post by Moritz Moeller
data is embedded-as is and compressed, all the EXIF tags are copied

too).