1 bit depth BMP created with ImageMagick all black using GxEPD2

@David,

How did you check the palette of this picture?

or is this wrong:

         file.seekSet(54); //palette is always @ 54

@rlightner,

the palette looks wrong, index 0 and 1 have 2 different colors, but neither black nor white:

palette values below are red green blue

Loading image 'betty_4.bmp'
File size: 26326
Image Offset: 118
Header size: 40
Bit Depth: 4
Image size: 204x252
0 0 0
128 0 0
0 128 0
128 128 0
0 0 128
128 0 128
0 128 128
128 128 128
192 192 192
255 0 0
0 255 0
255 255 0
0 0 255
255 0 255
0 255 255
255 255 255
_PowerOn : 36727
_Update_Full : 1527816
loaded in 2842 ms
_Update_Full : 1527948

Loading image 'bb4.bmp'
File size: 206
Image Offset: 62
Header size: 40
Bit Depth: 1
Image size: 34x18
0 0 0
255 255 255
_Update_Part : 556839
loaded in 899 ms
_Update_Full : 1528333

Loading image 'output5.bmp'
File size: 6466
Image Offset: 130
Header size: 108
Bit Depth: 1
Image size: 176x264
255 0 0
0 255 0
_Update_Part : 555762
loaded in 1590 ms
_Update_Full : 1528561
GxEPD2_SD_Example done

Jean-Marc

BTW: thanks to David:

// BMP handling code extracts taken from: https://github.com/prenticedavid/MCUFRIEND_kbv/tree/master/examples/showBMP_kbv_Uno

The header size is always 54.
If there is a Palette, it follows the Header.

From IrfanView: output5.bmp has Palette 255:255:255 , 000:000:000 i.e. WHITE,BLACK

I have some x1 bitmaps e.g. truck.bmp

betty_4.bmp is a 4BPP image i.e. 16 colours.

You should be able to examine the Palette in IrfanView.
Likewise, you can take a 24BPP colour JPG, PNG, BMP and reduce it to 8BPP (256 colours) quite well.

Reducing to 4BPP or 1BPP requires a bit of skill. IrfanView does a pretty good job but 1BPP is very difficult to get the "best" look.

I suggest that you look very carefully at your Palette. I would calculate the Palette once. Then you render each pixel directly from the Palette.

David.

I'm using ImageMagick to created the bmp:

convert output.png -filter point -resize "176x264>" -dither FloydSteinberg -define dither:diffusion-amount=85% -monochrome -depth 1 output5.bmp

I'm going to read back over the messages above and try and figure out what I'm doing wrong.

Thanks again for the effort.

@David,

I just added one line of diagnostic output, to try to analyze:

       if (depth == 1) with_color = false;
        if (depth <= 8)
        {
          if (depth < 8) bitmask >>= depth;
          file.seekSet(54); //palette is always @ 54
          for (uint16_t pn = 0; pn < (1 << depth); pn++)
          {
            blue  = file.read();
            green = file.read();
            red   = file.read();
            file.read();
            Serial.print(red); Serial.print(" "); Serial.print(green); Serial.print(" "); Serial.println(blue);
            whitish = with_color ? ((red > 0x80) && (green > 0x80) && (blue > 0x80)) : ((red + green + blue) > 3 * 0x80); // whitish
            colored = (red > 0xF0) || ((green > 0xF0) && (blue > 0xF0)); // reddish or yellowish?
            if (0 == pn % 8) mono_palette_buffer[pn / 8] = 0;
            mono_palette_buffer[pn / 8] |= whitish << pn % 8;
            if (0 == pn % 8) color_palette_buffer[pn / 8] = 0;
            color_palette_buffer[pn / 8] |= colored << pn % 8;
          }
        }

Why don't I get 255 255 255 and 0 0 0, as I would expect from info of IrfanView?
but 255 0 0 and 0 255 0 instead?

Same values in IrfanView HEX view.

My apologies. I copied output5.bmp to an SD. Then displayed via an ESP8266.

It shows as Yellow graphics on a Red background.

I will check my algorithm.

I changed the Palette in IrfanView to give Blue graphics on a Cyan background.
This renders fine.

I will have to compare the file contents. But this will be later this afternoon.

Why don't I get 255 255 255 and 0 0 0, as I would expect from info of IrfanView?
but 255 0 0 and 0 255 0 instead?

Ah-ha. My display must be GREEN graphics on Red background. Not Yellow.
So the algorithm is correct. I must see why IrfanView is different to ImageMagick.

David.

Yes, the formats are different: output6.bmp was generated by IrfanView Blue/Cyan

// file:output5.bmp ID  4D42
// size 6466
// offset       130
// width        176
// height       264
// planes       1
// depth        1
// compression  0
// pixelsize    6336
// colorsused   2
// colorsimportant      2

// file:output6.bmp ID  4D42
// size 6398
// offset       62
// width        176
// height       264
// planes       1
// depth        1
// compression  0
// pixelsize    6336
// colorsused   2

Note that ImageMagick generated output5.bmp has an extra "colorsimportant" field.
The actual bitmap rendered correctly from the respective "offset"

filespec: output5.bmp
000000 42 4D 42 19 00 00 00 00 00 00 82 00 00 00 6C 00 *BMB...........l.*
000010 00 00 B0 00 00 00 08 01 00 00 01 00 01 00 00 00 *..░.............*
000020 00 00 C0 18 00 00 00 00 00 00 00 00 00 00 02 00 *..└.............*
000030 00 00 02 00 00 00 00 00 FF 00 00 FF 00 00 FF 00 *................*
000040 00 00 00 00 00 FF 42 47 52 73 00 00 00 00 00 00 *......BGRs......*
000050 00 00 00 00 00 40 00 00 00 00 00 00 00 00 00 00 *.....@..........*
000060 00 40 00 00 00 00 00 00 00 00 00 00 00 40 00 00 *.@...........@..*
000070 00 00 00 00 00 00 00 00 00 00 FF FF FF 00 00 00 *................*
000080 00 00 *..*
filespec: output6.bmp
000000 42 4D FE 18 00 00 00 00 00 00 3E 00 00 00 28 00 *BM■.......>...(.*
000010 00 00 B0 00 00 00 08 01 00 00 01 00 01 00 00 00 *..░.............*
000020 00 00 C0 18 00 00 00 00 00 00 00 00 00 00 02 00 *..└.............*
000030 00 00 00 00 00 00 FF FF 00 00 FF 00 00 00 *..............*

You can see the colorsimportant field at offset 0x0032 means that the Palette uses a different format. i.e. Palette is @ 0x007A [FF FF FF 00] [00 00 00 00] White-Black
The IrfanView Palette is @ 0x0036 [FF FF 00 00] [FF 00 00 00] Cyan-Blue

Here is a Wikipedia article that describes the BMP file format

I suspect that ImageMagick can generate both formats. I wonder whether it is worth the effort to support the extra

An OS/2 2.x OS22XBITMAPHEADER (BITMAPINFOHEADER2 in IBM's documentation) contains 24 additional bytes

David.

p.s. I have just been listening to an excellent play on the Radio about Nikolai Gogol (my hero)

@David,

yes, I once had a look at that Wikipedia article, and decided it is too complicated for my practical use, and I stay with code that is widely used for Arduino libraries, e.g. the one I found in your library.

Do you have a practical suggestion how to deal with this for users of our libraries?

I downloaded ImageMagick, but I still need some time to learn how to use it.

Users like @rlightner and others could profit from a workaround.

Thank you.

Jean-Marc

The reason why I'm doing it the way I am is that the file encoded this way is only 7 kb, but with the other way, comes out to around 138 kb. I'm trying to minimize the sending over the wire to the device. If at the end of the day I just need to take the hit, I will.

I do appreciate all the work you guys have given to the community. It's a great building block for others to create upon!

You can see the colorsimportant field at offset 0x0032 means that the Palette uses a different format.
i.e. Palette is @ 0x007A [FF FF FF 00] [00 00 00 00] White-Black
The IrfanView Palette is @ 0x0036 [FF FF 00 00] [FF 00 00 00] Cyan-Blue

So you just have to read 0x32 and if 2 you seek to 0x007A instead of 0x0036
It should not be more than two lines. e.g.

        if (bmpDepth <= PALETTEDEPTH) {   // these modes have separate palette
            bmpFile.seek(50); //colorsimportant
            bmpFile.seek(read32() ? 122 : 54); //important or regular palette

If there are ImageMagick users out there, please could you try creating BMP with different colour depths.
IrfanView recognises the colorsimportant field but does not seem to generate it.

I will post the patch on the BMP examples on the MCUFRIEND_kbv Beta.

David.

@David, thank you, now I see it clearly enough; my brain was a bit tired, it seems.

@rlightner,

I will do the change tomorrow morning after a quick test, and put it on GitHub without creating a new version for now.

Jean-Marc

I have posted the change on GitHub e.g. MCUFRIEND_kbv/examples/showBMP_kbv_Uno at master · prenticedavid/MCUFRIEND_kbv · GitHub

@rlightner,
you can edit the drawBitmapFromSpiffs() function in the sketch:

        if (depth <= 8)
        {
          if (depth < 8) bitmask >>= depth;
          //file.seek(54); //palette is always @ 54
            file.seek(50); //colorsimportant
            file.seek(read32() ? 122 : 54); //important or regular palette

Please test your existing file.

If all works ok, I would appreciate it if you go back to ImageMagick
See if you can start with a colour JPG and reduce colours to 256-colour, 16-colour, 2-colour BMP files.

It would be nice if you posted the result. e.g. attach the files in a ZIP

David.

Will do!

I have just installed ImageMagick on this Win10-64 PC

I am lost. I can't even find how to set a Path to the program or even send a simple command

 "C:\Program Files\ImageMagick-7.0.8-Q16\magick.exe" tractor10.jpg -colors 256 tractor_8.bmp

I just get Parser errors.

David.

Should have put it under your "Program Files" directory if you installed the 64 bit version.

I just downloaded the Windows installer. I assume that it knows where it wants to store stuff.

IrfanView calls itself "v4.41 64-bit" but installed itself in "/Program Files" and not "/Program Files (x86)"

David.

Correct, if your OS is 64bit, 64bit apps get installed in "/Program Files" and 32bit go in the "/Program Files (x86)" folder.

Woo-Hoo. This Win10 PC defaults to PowerShell which is horrible.
I found cmd.exe and everything works nicely.

I have created some BMP files with different color depth. I get different values in the colorsimportant field e.g. 2, 16, 256

But the result is horrible.

I have a lot of learning to do.

IrfanView tends to do this stuff for you e.g. if you ask it to reduce to 16 colours it makes the "best possible" Palette and the end result looks good.

David.

I'm executing this via a function in firebase, which has 'convert' available to the environment, so its not something I can do by hand.

this is the line that gets executed:

convert **from_filename.png** -filter point -resize "176x264>" -dither FloydSteinberg -define dither:diffusion-amount=85% -monochrome -colors 2 **output_filename.bmp**

I have made a safer calculation for MCUFRIEND_kbv examples:

        if (bmpDepth <= PALETTEDEPTH) {   // these modes have separate palette
            bmpFile.seek(bmpImageoffset - (4<<bmpDepth)); //54 for regular, diff for colorsimportant
            bitmask = 0xFF;

your edit would be:

        if (depth <= 8)
        {
          if (depth < 8) bitmask >>= depth;
            file.seek(imageOffset - (4<<depth)); //54 for regular, diff for colorsimportant
          //file.seek(54); //palette is always @ 54

Thanks for your sample command. I am struggling with ImageMagick.
I have created tractor_1.bmp tractor_4.bmp tractor_8.bmp with ImageMagick
and created tractor_11.bmp tractor_44.bmp tractor_88.bmp with IrfanView

ImageMagick creates bigger headers on all 3 files. And creates a RLE bitmap for the 256-colour file.
My programs reject the RLE flag as an unsupported format.

I have attached a ZIP.

David.

Edit. Added output6.bmp to ZIP. This was generated by Irfanview with Blue graphics and Cyan background.
Jean-Marc's program should distinguish between the two colours i.e. Cyan->WHITE and Blue->BLACK

magick tractor10.jpg -depth 1 -colors 2 tractor_1.bmp
magick tractor10.jpg -depth 4 -colors 16 tractor_4.bmp
magick tractor10.jpg -depth 8 -colors 256 tractor_8.bmp

tractors.zip (76.2 KB)

What command are you using with imagemagick to create them?