Camera and I2S audio simultaneously use

[takurot]

I could not find the solution in any where, so please let me ask here.

I use ESP32-WROOVER-DEV board and I want to implement both I2S audio and Camera function. But audio does not play at all when I start esp_camera_fb_get().

I use the library for audio as bellow, and I2S amp MAX98357A is attached to the board.
https://github.com/schreibfaul1/ESP32-a ... e285f16d6f

I confirmed that the single function for camera and audio separately, and they works fine as independent. But not in simultaneously.

I'd like to know that this is even possible.

Code: Untitled.c Select all

#include "esp_camera.h"

#include <HTTPClient.h>

#include <Preferences.h>

#include <WiFi.h>

#include "Audio.h"



#define I2S_DOUT     15

#define I2S_BCLK      12

#define I2S_LRC        33



void setup() {

  Serial.begin(115200);

  Serial.setDebugOutput(true);



  camera_config_t config;

  config.ledc_channel = LEDC_CHANNEL_0;

  config.ledc_timer = LEDC_TIMER_0;

  config.pin_d0 = Y2_GPIO_NUM;

  config.pin_d1 = Y3_GPIO_NUM;

  config.pin_d2 = Y4_GPIO_NUM;

  config.pin_d3 = Y5_GPIO_NUM;

  config.pin_d4 = Y6_GPIO_NUM;

  config.pin_d5 = Y7_GPIO_NUM;

  config.pin_d6 = Y8_GPIO_NUM;

  config.pin_d7 = Y9_GPIO_NUM;

  config.pin_xclk = XCLK_GPIO_NUM;

  config.pin_pclk = PCLK_GPIO_NUM;

  config.pin_vsync = VSYNC_GPIO_NUM;

  config.pin_href = HREF_GPIO_NUM;

  config.pin_sscb_sda = SIOD_GPIO_NUM;

  config.pin_sscb_scl = SIOC_GPIO_NUM;

  config.pin_pwdn = PWDN_GPIO_NUM;

  config.pin_reset = RESET_GPIO_NUM;

  config.xclk_freq_hz = 20000000;

//  config.frame_size = FRAMESIZE_UXGA;

  config.frame_size = FRAMESIZE_VGA;

  config.pixel_format = PIXFORMAT_JPEG; // for streaming

  //config.pixel_format = PIXFORMAT_RGB565; // for face detection/recognition

  config.grab_mode = CAMERA_GRAB_WHEN_EMPTY;

  config.fb_location = CAMERA_FB_IN_PSRAM;

  config.jpeg_quality = 10;

  config.fb_count = 1;

  

 }



  // camera init

  esp_err_t err = esp_camera_init(&config);

  if (err != ESP_OK) {

    Serial.printf("Camera init failed with error 0x%x", err);

    return;

  }



  sensor_t * s = esp_camera_sensor_get();

  // initial sensors are flipped vertically and colors are a bit saturated

  if (s->id.PID == OV3660_PID) {

    s->set_vflip(s, 1); // flip it back

    s->set_brightness(s, 1); // up the brightness just a bit

    s->set_saturation(s, -2); // lower the saturation

  }



  WiFi.begin(ssid, password);

  WiFi.setSleep(false);



  while (WiFi.status() != WL_CONNECTED) {

    delay(500);

    Serial.print(".");

  }

  Serial.println("");

  Serial.println("WiFi connected");



  delay(1500);



  audio.setPinout(I2S_BCLK, I2S_LRC, I2S_DOUT);

  audio.setVolume(10);

  audio.connecttohost("http://mp3.ffh.de/radioffh/hqlivestream.mp3");

  Serial.println("Audio Set");



}



void loop() {

  audio.loop(); //NOT WORKING



// ---- get camera capture

  camera_fb_t *fb = NULL;

  fb = esp_camera_fb_get(); //Camera can get an image

  

  if (!fb) {

    Serial.println("failure: Camera capture");

    return;

  }else{

    Serial.println("Success: Camera capture");

  }

  esp_camera_fb_return(fb);

}

[BotondColop]

Can you share also the defined pin number what are you using to the camera setup?

[takurot]

Thanks for your reply. Camera Pin assigns are as bellow

Code: Untitled.c Select all

#define PWDN_GPIO_NUM    -1

#define RESET_GPIO_NUM   -1

#define XCLK_GPIO_NUM    21

#define SIOD_GPIO_NUM    26

#define SIOC_GPIO_NUM    27



#define Y9_GPIO_NUM      35

#define Y8_GPIO_NUM      34

#define Y7_GPIO_NUM      39

#define Y6_GPIO_NUM      36

#define Y5_GPIO_NUM      19

#define Y4_GPIO_NUM      18

#define Y3_GPIO_NUM       5

#define Y2_GPIO_NUM       4

#define VSYNC_GPIO_NUM   25

#define HREF_GPIO_NUM    23

#define PCLK_GPIO_NUM    22

[takurot]

I did't include the audio definition on the comment above(There is a definition on actual code)

I tried to change the I2C channel, but it did not work either way.

I2S channel 1

Code: Untitled.c Select all

Audio audio(false, 3, 1);

I2S channel 0

Code: Untitled.c Select all

Audio audio();

[BotondColop]

One problem what i think, both of the function use PSRAM

Code: Select all

 class AudioBuffer {
// AudioBuffer will be allocated in PSRAM, If PSRAM not available or has not enough space AudioBuffer will be
// allocated in FlashRAM with reduced size

Audio:
you can check this funktion

Code: Select all

bool     havePSRAM() { return m_f_psram; };

This can be a problem. Maybe you can test -> AudioBuffer in FlashRAM