Always pass level = 0 to gegl_buffer_set(). This actually makes a difference since GEGL's level processing got some fixes.