Android下使用camera2和Surfaceview预览图像并取得YUV420p数据回调

本文主要是介绍Android下使用camera2和Surfaceview预览图像并取得YUV420p数据回调,希望对大家解决编程问题提供一定的参考价值,需要的开发者们随着小编来一起学习吧!

Android 5.0(21)之后,android.hardware.Camera被废弃(下面称为Camera1),还有一个android.graphics.Camera,这个android.graphics.Camera不是用来照相的,是用来处理图像的,可以做出3D的图像效果之类的,之前的Camera1则由android.hardware.Camera2来代替。

Camera2支持RAW输出,可以调节曝光,对焦模式,快门等,功能比原先Camera强大。

由于ImageFormat只有YUV420_888即YUV420系列,这里需要将其做一个转换,转成所需要的YUV420p:yyyyyyyyuuuuvvvv格式,参考文章:android camera2 拿到的yuv420数据到底是什么样的?

1、MainActivity.java文件:

package com.example.tongjiangsong.camera2base;import android.Manifest;
import android.content.Context;
import android.content.pm.PackageManager;
import android.graphics.Bitmap;
import android.graphics.BitmapFactory;
import android.graphics.ImageFormat;
import android.hardware.camera2.CameraAccessException;
import android.hardware.camera2.CameraCaptureSession;
import android.hardware.camera2.CameraCharacteristics;
import android.hardware.camera2.CameraDevice;
import android.hardware.camera2.CameraManager;
import android.hardware.camera2.CaptureRequest;
import android.media.Image;
import android.media.ImageReader;
import android.os.Build;
import android.os.Environment;
import android.os.Handler;
import android.os.HandlerThread;
import android.support.annotation.RequiresApi;
import android.support.v4.app.ActivityCompat;
import android.support.v7.app.AppCompatActivity;
import android.os.Bundle;
import android.util.Log;
import android.util.SparseIntArray;
import android.view.Surface;
import android.view.SurfaceHolder;
import android.view.SurfaceView;
import android.view.View;
import android.widget.Button;
import android.widget.ImageView;
import android.widget.Toast;import java.io.File;
import java.io.FileNotFoundException;
import java.io.FileOutputStream;
import java.io.IOException;
import java.nio.ByteBuffer;
import java.util.Arrays;public class MainActivity extends AppCompatActivity implements View.OnClickListener {private static final SparseIntArray ORIENTATIONS = new SparseIntArray();private static final String TAG = "mainactivity" ;///为了使照片竖直显示static {ORIENTATIONS.append(Surface.ROTATION_0, 90);ORIENTATIONS.append(Surface.ROTATION_90, 0);ORIENTATIONS.append(Surface.ROTATION_180, 270);ORIENTATIONS.append(Surface.ROTATION_270, 180);}private SurfaceView mSurfaceView;private SurfaceHolder mSurfaceHolder;private ImageView iv_show;private CameraManager mCameraManager;//摄像头管理器private Handler childHandler, mainHandler;private String mCameraID;//摄像头Id 0 为后  1 为前private ImageReader mImageReaderJPG;private ImageReader mImageReaderPreview;private CameraCaptureSession mCameraCaptureSession;private CameraDevice mCameraDevice;@Overrideprotected void onCreate(Bundle savedInstanceState) {super.onCreate(savedInstanceState);setContentView(R.layout.activity_main);Button capture_btn = (Button)findViewById(R.id.capture_btn);capture_btn.setOnClickListener(this);initVIew();}/*** 初始化*/private void initVIew() {iv_show = (ImageView) findViewById(R.id.image_preview);//mSurfaceViewmSurfaceView = (SurfaceView) findViewById(R.id.surface_view);mSurfaceView.setOnClickListener(this);mSurfaceHolder = mSurfaceView.getHolder();mSurfaceHolder.setKeepScreenOn(true);// mSurfaceView添加回调mSurfaceHolder.addCallback(new SurfaceHolder.Callback() {@Overridepublic void surfaceCreated(SurfaceHolder holder) { //SurfaceView创建// 初始化CamerainitCamera2();}@Overridepublic void surfaceChanged(SurfaceHolder holder, int format, int width, int height) {}@Overridepublic void surfaceDestroyed(SurfaceHolder holder) { //SurfaceView销毁// 释放Camera资源if (null != mCameraDevice) {mCameraDevice.close();MainActivity.this.mCameraDevice = null;}}});}/*** 初始化Camera2*/@RequiresApi(api = Build.VERSION_CODES.LOLLIPOP)private void initCamera2() {HandlerThread handlerThread = new HandlerThread("Camera2");handlerThread.start();childHandler = new Handler(handlerThread.getLooper());mainHandler = new Handler(getMainLooper());mCameraID = "" + CameraCharacteristics.LENS_FACING_FRONT;//后摄像头mImageReaderJPG = ImageReader.newInstance(1080, 1920, ImageFormat.JPEG,1);mImageReaderJPG.setOnImageAvailableListener(new ImageReader.OnImageAvailableListener() { //可以在这里处理拍照得到的临时照片 例如,写入本地@Overridepublic void onImageAvailable(ImageReader reader) {//mCameraDevice.close();//mSurfaceView.setVisibility(View.GONE);//先验证手机是否有sdcardString status = Environment.getExternalStorageState();if (!status.equals(Environment.MEDIA_MOUNTED)) {Toast.makeText(getApplicationContext(), "你的sd卡不可用。", Toast.LENGTH_SHORT).show();return;}// 获取捕获的照片数据Image image = reader.acquireNextImage();ByteBuffer buffer = image.getPlanes()[0].getBuffer();byte[] data = new byte[buffer.remaining()];buffer.get(data);//手机拍照都是存到这个路径String filePath = Environment.getExternalStorageDirectory().getPath() + "/DCIM/Camera/";String picturePath = System.currentTimeMillis() + ".jpg";File file = new File(filePath, picturePath);try {//存到本地相册FileOutputStream fileOutputStream = new FileOutputStream(file);fileOutputStream.write(data);fileOutputStream.close();iv_show.setVisibility(View.VISIBLE);//显示图片BitmapFactory.Options options = new BitmapFactory.Options();options.inSampleSize = 2;Bitmap bitmap = BitmapFactory.decodeByteArray(data, 0, data.length, options);iv_show.setImageBitmap(bitmap);} catch (FileNotFoundException e) {e.printStackTrace();} catch (IOException e) {e.printStackTrace();} finally {image.close();}}}, mainHandler);mImageReaderPreview = ImageReader.newInstance(1080, 1920, ImageFormat.YUV_420_888,1);mImageReaderPreview.setOnImageAvailableListener(new ImageReader.OnImageAvailableListener() { //可以在这里处理拍照得到的临时照片 例如,写入本地@Overridepublic void onImageAvailable(ImageReader reader) {// 获取捕获的照片数据Image image = reader.acquireNextImage();Log.i(TAG,"image format: " +image.getFormat());// 从image里获取三个planeImage.Plane[] planes = image.getPlanes();for (int i = 0; i < planes.length; i++) {ByteBuffer iBuffer = planes[i].getBuffer();int iSize = iBuffer.remaining();Log.i(TAG, "pixelStride  " + planes[i].getPixelStride());Log.i(TAG, "rowStride   " + planes[i].getRowStride());Log.i(TAG, "width  " + image.getWidth());Log.i(TAG, "height  " + image.getHeight());Log.i(TAG, "Finished reading data from plane  " + i);}int n_image_size = image.getWidth()*image.getHeight()*3/2;final byte[] yuv420pbuf = new byte[n_image_size];System.arraycopy(ImageUtil.getBytesFromImageAsType(image, 0), 0, yuv420pbuf, 0, n_image_size);image.close();}}, null);//获取摄像头管理mCameraManager = (CameraManager) getSystemService(Context.CAMERA_SERVICE);try {if (ActivityCompat.checkSelfPermission(this, Manifest.permission.CAMERA) != PackageManager.PERMISSION_GRANTED) {return;}//打开摄像头mCameraManager.openCamera(mCameraID, stateCallback, mainHandler);} catch (CameraAccessException e) {e.printStackTrace();}}/*** 摄像头创建监听*/private CameraDevice.StateCallback stateCallback = new CameraDevice.StateCallback() {@Overridepublic void onOpened(CameraDevice camera) {//打开摄像头mCameraDevice = camera;//开启预览takePreview();}@Overridepublic void onDisconnected(CameraDevice camera) {//关闭摄像头if (null != mCameraDevice) {mCameraDevice.close();MainActivity.this.mCameraDevice = null;}}@Overridepublic void onError(CameraDevice camera, int error) {//发生错误Toast.makeText(MainActivity.this, "摄像头开启失败", Toast.LENGTH_SHORT).show();}};/*** 开始预览*/private void takePreview() {try {// 创建预览需要的CaptureRequest.Builderfinal CaptureRequest.Builder previewRequestBuilder = mCameraDevice.createCaptureRequest(CameraDevice.TEMPLATE_PREVIEW);// 将SurfaceView的surface作为CaptureRequest.Builder的目标previewRequestBuilder.addTarget(mSurfaceHolder.getSurface());previewRequestBuilder.addTarget(mImageReaderPreview.getSurface());// 创建CameraCaptureSession,该对象负责管理处理预览请求和拍照请求mCameraDevice.createCaptureSession(Arrays.asList(mSurfaceHolder.getSurface(), mImageReaderPreview.getSurface()), new CameraCaptureSession.StateCallback() // ③{@Overridepublic void onConfigured(CameraCaptureSession cameraCaptureSession) {if (null == mCameraDevice) return;// 当摄像头已经准备好时,开始显示预览mCameraCaptureSession = cameraCaptureSession;try {// 自动对焦previewRequestBuilder.set(CaptureRequest.CONTROL_AF_MODE, CaptureRequest.CONTROL_AF_MODE_CONTINUOUS_PICTURE);// 打开闪光灯previewRequestBuilder.set(CaptureRequest.CONTROL_AE_MODE, CaptureRequest.CONTROL_AE_MODE_ON_AUTO_FLASH);// 显示预览CaptureRequest previewRequest = previewRequestBuilder.build();mCameraCaptureSession.setRepeatingRequest(previewRequest, null, childHandler);} catch (CameraAccessException e) {e.printStackTrace();}}@Overridepublic void onConfigureFailed(CameraCaptureSession cameraCaptureSession) {Toast.makeText(MainActivity.this, "配置失败", Toast.LENGTH_SHORT).show();}}, childHandler);} catch (CameraAccessException e) {e.printStackTrace();}}/*** 点击事件*/@Overridepublic void onClick(View v) {switch (v.getId()) {case R.id.capture_btn:takePicture();Toast.makeText(MainActivity.this, "拍照", Toast.LENGTH_SHORT).show();break;}}/*** 拍照*/private void takePicture() {if (mCameraDevice == null) return;// 创建拍照需要的CaptureRequest.Builderfinal CaptureRequest.Builder captureRequestBuilder;try {captureRequestBuilder = mCameraDevice.createCaptureRequest(CameraDevice.TEMPLATE_STILL_CAPTURE);// 将imageReader的surface作为CaptureRequest.Builder的目标captureRequestBuilder.addTarget(mImageReaderJPG.getSurface());// 自动对焦captureRequestBuilder.set(CaptureRequest.CONTROL_AF_MODE, CaptureRequest.CONTROL_AF_MODE_CONTINUOUS_PICTURE);// 自动曝光captureRequestBuilder.set(CaptureRequest.CONTROL_AE_MODE, CaptureRequest.CONTROL_AE_MODE_ON_AUTO_FLASH);// 获取手机方向int rotation = getWindowManager().getDefaultDisplay().getRotation();// 根据设备方向计算设置照片的方向captureRequestBuilder.set(CaptureRequest.JPEG_ORIENTATION, ORIENTATIONS.get(rotation));//拍照CaptureRequest mCaptureRequest = captureRequestBuilder.build();mCameraCaptureSession.capture(mCaptureRequest, null, childHandler);} catch (CameraAccessException e) {e.printStackTrace();}}
}

2、ImageUtil.java文件下

package com.example.tongjiangsong.camera2base;import android.graphics.ImageFormat;
import android.media.Image;
import android.util.Log;import java.nio.ByteBuffer;/*** yuv420p:  yyyyyyyyuuvv* yuv420sp: yyyyyyyyuvuv* nv21:     yyyyyyyyvuvu*/public class ImageUtil {public static final int YUV420P = 0;public static final int YUV420SP = 1;public static final int NV21 = 2;private static final String TAG = "ImageUtil";/**** 此方法内注释以640*480为例* 未考虑CropRect的*/public static byte[] getBytesFromImageAsType(Image image, int type) {try {//获取源数据,如果是YUV格式的数据planes.length = 3//plane[i]里面的实际数据可能存在byte[].length <= capacity (缓冲区总大小)final Image.Plane[] planes = image.getPlanes();//数据有效宽度,一般的,图片width <= rowStride,这也是导致byte[].length <= capacity的原因// 所以我们只取width部分int width = image.getWidth();int height = image.getHeight();//此处用来装填最终的YUV数据,需要1.5倍的图片大小,因为Y U V 比例为 4:1:1byte[] yuvBytes = new byte[width * height * ImageFormat.getBitsPerPixel(ImageFormat.YUV_420_888) / 8];//目标数组的装填到的位置int dstIndex = 0;//临时存储uv数据的byte uBytes[] = new byte[width * height / 4];byte vBytes[] = new byte[width * height / 4];int uIndex = 0;int vIndex = 0;int pixelsStride, rowStride;for (int i = 0; i < planes.length; i++) {pixelsStride = planes[i].getPixelStride();rowStride = planes[i].getRowStride();ByteBuffer buffer = planes[i].getBuffer();//如果pixelsStride==2,一般的Y的buffer长度=640*480,UV的长度=640*480/2-1//源数据的索引,y的数据是byte中连续的,u的数据是v向左移以为生成的,两者都是偶数位为有效数据byte[] bytes = new byte[buffer.capacity()];buffer.get(bytes);int srcIndex = 0;if (i == 0) {//直接取出来所有Y的有效区域,也可以存储成一个临时的bytes,到下一步再copyfor (int j = 0; j < height; j++) {System.arraycopy(bytes, srcIndex, yuvBytes, dstIndex, width);srcIndex += rowStride;dstIndex += width;}} else if (i == 1) {//根据pixelsStride取相应的数据for (int j = 0; j < height / 2; j++) {for (int k = 0; k < width / 2; k++) {uBytes[uIndex++] = bytes[srcIndex];srcIndex += pixelsStride;}if (pixelsStride == 2) {srcIndex += rowStride - width;} else if (pixelsStride == 1) {srcIndex += rowStride - width / 2;}}} else if (i == 2) {//根据pixelsStride取相应的数据for (int j = 0; j < height / 2; j++) {for (int k = 0; k < width / 2; k++) {vBytes[vIndex++] = bytes[srcIndex];srcIndex += pixelsStride;}if (pixelsStride == 2) {srcIndex += rowStride - width;} else if (pixelsStride == 1) {srcIndex += rowStride - width / 2;}}}}image.close();//根据要求的结果类型进行填充switch (type) {case YUV420P:System.arraycopy(uBytes, 0, yuvBytes, dstIndex, uBytes.length);System.arraycopy(vBytes, 0, yuvBytes, dstIndex + uBytes.length, vBytes.length);break;case YUV420SP:for (int i = 0; i < vBytes.length; i++) {yuvBytes[dstIndex++] = uBytes[i];yuvBytes[dstIndex++] = vBytes[i];}break;case NV21:for (int i = 0; i < vBytes.length; i++) {yuvBytes[dstIndex++] = vBytes[i];yuvBytes[dstIndex++] = uBytes[i];}break;}return yuvBytes;} catch (final Exception e) {if (image != null) {image.close();}Log.i(TAG, e.toString());}return null;}
}

3、activity_main.xml文件下

<?xml version="1.0" encoding="utf-8"?>
<RelativeLayout xmlns:android="http://schemas.android.com/apk/res/android"android:layout_width="match_parent"android:layout_height="match_parent"><TextureViewandroid:id="@+id/tv"android:layout_above="@+id/ll_bottom"android:layout_width="match_parent"android:layout_height="match_parent" /><RelativeLayoutandroid:id="@+id/ll_bottom"android:layout_width="match_parent"android:layout_height="80dp"android:layout_alignParentBottom="true"><ImageViewandroid:id="@+id/iv"android:layout_width="wrap_content"android:layout_height="70dp"android:layout_centerVertical="true"android:layout_marginLeft="10dp"android:src="@mipmap/ic_launcher"/><Buttonandroid:id="@+id/btn"android:layout_width="wrap_content"android:layout_height="wrap_content"android:layout_alignParentRight="true"android:layout_centerVertical="true"android:layout_marginRight="10dp"android:text="拍照"/></RelativeLayout>
</RelativeLayout>

3、设置权限:

    <uses-permission android:name="android.permission.CAMERA" /><uses-permission android:name="android.permission.WRITE_EXTERNAL_STORAGE"/>

 

 

这篇关于Android下使用camera2和Surfaceview预览图像并取得YUV420p数据回调的文章就介绍到这儿,希望我们推荐的文章对编程师们有所帮助!



http://www.chinasem.cn/article/910044

相关文章

使用Python删除Excel中的行列和单元格示例详解

《使用Python删除Excel中的行列和单元格示例详解》在处理Excel数据时,删除不需要的行、列或单元格是一项常见且必要的操作,本文将使用Python脚本实现对Excel表格的高效自动化处理,感兴... 目录开发环境准备使用 python 删除 Excphpel 表格中的行删除特定行删除空白行删除含指定

深入理解Go语言中二维切片的使用

《深入理解Go语言中二维切片的使用》本文深入讲解了Go语言中二维切片的概念与应用,用于表示矩阵、表格等二维数据结构,文中通过示例代码介绍的非常详细,需要的朋友们下面随着小编来一起学习学习吧... 目录引言二维切片的基本概念定义创建二维切片二维切片的操作访问元素修改元素遍历二维切片二维切片的动态调整追加行动态

prometheus如何使用pushgateway监控网路丢包

《prometheus如何使用pushgateway监控网路丢包》:本文主要介绍prometheus如何使用pushgateway监控网路丢包问题,具有很好的参考价值,希望对大家有所帮助,如有错误... 目录监控网路丢包脚本数据图表总结监控网路丢包脚本[root@gtcq-gt-monitor-prome

Python通用唯一标识符模块uuid使用案例详解

《Python通用唯一标识符模块uuid使用案例详解》Pythonuuid模块用于生成128位全局唯一标识符,支持UUID1-5版本,适用于分布式系统、数据库主键等场景,需注意隐私、碰撞概率及存储优... 目录简介核心功能1. UUID版本2. UUID属性3. 命名空间使用场景1. 生成唯一标识符2. 数

SpringBoot中如何使用Assert进行断言校验

《SpringBoot中如何使用Assert进行断言校验》Java提供了内置的assert机制,而Spring框架也提供了更强大的Assert工具类来帮助开发者进行参数校验和状态检查,下... 目录前言一、Java 原生assert简介1.1 使用方式1.2 示例代码1.3 优缺点分析二、Spring Fr

Android kotlin中 Channel 和 Flow 的区别和选择使用场景分析

《Androidkotlin中Channel和Flow的区别和选择使用场景分析》Kotlin协程中,Flow是冷数据流,按需触发,适合响应式数据处理;Channel是热数据流,持续发送,支持... 目录一、基本概念界定FlowChannel二、核心特性对比数据生产触发条件生产与消费的关系背压处理机制生命周期

java使用protobuf-maven-plugin的插件编译proto文件详解

《java使用protobuf-maven-plugin的插件编译proto文件详解》:本文主要介绍java使用protobuf-maven-plugin的插件编译proto文件,具有很好的参考价... 目录protobuf文件作为数据传输和存储的协议主要介绍在Java使用maven编译proto文件的插件

Android ClassLoader加载机制详解

《AndroidClassLoader加载机制详解》Android的ClassLoader负责加载.dex文件,基于双亲委派模型,支持热修复和插件化,需注意类冲突、内存泄漏和兼容性问题,本文给大家介... 目录一、ClassLoader概述1.1 类加载的基本概念1.2 android与Java Class

SpringBoot线程池配置使用示例详解

《SpringBoot线程池配置使用示例详解》SpringBoot集成@Async注解,支持线程池参数配置(核心数、队列容量、拒绝策略等)及生命周期管理,结合监控与任务装饰器,提升异步处理效率与系统... 目录一、核心特性二、添加依赖三、参数详解四、配置线程池五、应用实践代码说明拒绝策略(Rejected

C++ Log4cpp跨平台日志库的使用小结

《C++Log4cpp跨平台日志库的使用小结》Log4cpp是c++类库,本文详细介绍了C++日志库log4cpp的使用方法,及设置日志输出格式和优先级,具有一定的参考价值,感兴趣的可以了解一下... 目录一、介绍1. log4cpp的日志方式2.设置日志输出的格式3. 设置日志的输出优先级二、Window