android - 如何正确接收来自onImageAvailable 的摄像头图像？

Question

我正在尝试实现从一台安卓设备到另一台安卓设备的视频流。为此，我想从相机获取帧，通过套接字发送它们并在另一部手机的 ImageView 上显示。问题是我必须使用特定格式的 ImageReader - YUV_420_888。当我尝试基于此图像的字节创建位图时，我只能得到 ALPHA_8(其他格式导致异常，说缓冲区不够大以容纳像素)，它是黑白的 + 方向错误。我想知道是否有办法直接获得正确的版本或以某种方式转换它，以便我可以准备好适当的位图以在 ImageView 上显示。这是一些代码:

public class MainActivity extends AppCompatActivity
{
  private ImageReader mImageReader;

    @Override
    protected void onCreate(Bundle savedInstanceState)
    {
        super.onCreate(savedInstanceState);
        setContentView(R.layout.activity_main);

        this.imageView = (ImageView) findViewById(R.id.image);

        this.handler = new Handler(){
            @Override
            public void handleMessage(Message msg)
            {
                if(msg.what == Worker.PROCESSED_IMAGE)
                {
                    imageView.setImageBitmap((Bitmap) msg.obj);
                }
            }
        };
    }

    private void openCamera()
    {
        CameraManager manager = (CameraManager) getSystemService(Context.CAMERA_SERVICE);

        try
        {
            String cameraId = manager.getCameraIdList()[0];
            CameraCharacteristics characteristics = manager.getCameraCharacteristics(cameraId);
            StreamConfigurationMap map = characteristics.get(CameraCharacteristics.SCALER_STREAM_CONFIGURATION_MAP);
            mPreviewSize = map.getOutputSizes(SurfaceTexture.class)[0];
            mImageReader = ImageReader.newInstance(mPreviewSize.getWidth(), mPreviewSize.getHeight(), ImageFormat.YUV_420_888, 50);
            mImageReader.setOnImageAvailableListener(new Worker(this, this.handler, mPreviewSize.getWidth(), mPreviewSize.getHeight()), new Handler());

            manager.openCamera(cameraId, mStateCallback, null);
        }
        catch(CameraAccessException e)
        {
            e.printStackTrace();
        }

    }

}


public class Worker implements ImageReader.OnImageAvailableListener
{
    @Override
    public void onImageAvailable(ImageReader imageReader)
    {
        Image image = imageReader.acquireLatestImage();

        Image.Plane plane = image.getPlanes()[0];
        ByteBuffer buffer = plane.getBuffer();
        Bitmap bm = Bitmap.createBitmap(width, heigth, Bitmap.Config.ALPHA_8);
        bm.copyPixelsFromBuffer(buffer);
        image.close();
        handler.obtainMessage(PROCESSED_IMAGE, bm).sendToTarget();

}

Answer 1

几乎正确，请尝试改用此代码:

@Override
public void onImageAvailable(ImageReader reader) {
    Image image = null;
    try {
        image = reader.acquireLatestImage();
//        Log.d(TAG, String.format(Locale.getDefault(), "image w = %d; h = %d", image.getWidth(), image.getHeight()));
        Image.Plane[] planes = image.getPlanes();
        ByteBuffer buffer = planes[0].getBuffer();
        buffer.rewind();
        byte[] data = new byte[buffer.capacity()];
        buffer.get(data);
        Bitmap bitmap = BitmapFactory.decodeByteArray(data, 0, data.length);
//use your bitmap
    } catch (Exception e) {
        e.printStackTrace();
    }
    if (image != null) {
        image.close();
    }
}