how to use speech recognition modules as r listen in background

Question

i am making a GUI chat bot which takes voice input from user but whenever i open the window it does not take the command rather it takes command after the window is closed. i am making the window using pygame. please help i have to make this project before my competition gets amended.

Comments

Hello @ Shaurya Thapliyal,

Can you please provide you snippet or provide more information about the error you're getting?

---

yes here have it,

---

this is the gameloop() 

---

this is the full code-

import pyttsx3
import os
import datetime
import speech_recognition as sr
import wikipedia
import webbrowser
import random
import wolframalpha
import mysql.connector as con
import ezgmail
import pyautogui
import pygame
from nltk.chat.util import Chat, reflections
from PIL import ImageTk,Image
from tkinter import *

engine = pyttsx3.init("sapi5")
voices = engine.getProperty("voices")
engine.setProperty('voice',voices[1].id)

def speak(audio):
    engine.say(audio)
    engine.runAndWait()

def wishme():
    hr = int(datetime.datetime.now().hour)
    if hr >= 0 and hr < 12:
        speak("good morning")
    elif hr >= 12 and hr < 18:
        speak("good afternoon")
    else:
        speak("good evening")
    speak("hi my name is pandora i am your digital assistant")

def takecommand():
    r = sr.Recognizer()
    with sr.Microphone() as source:
        print("listening...")
        r.pause_threshold = 1
        r.adjust_for_ambient_noise(source)
        audio = r.listen(source)
    try:
        print("recognizing...")
        query = r.recognize_google(audio,language = "en-in")
        print(f"user said:{query}\n")
    except Exception as e:
        speak("sorry sir i did not got that")
        print(e)
        query = pyautogui.prompt("commmand:")
    return query

def database():
    mycon = con.connect(host="localhost",user="root",passwd="123",database="test")
    if mycon.is_connected():
        speak("body connected to brain")
        print("BODY connected to BRAIN")
    cur = mycon.cursor()
    query = "select name from student"
    cur.execute(query)
    y = tuple()
    for x in cur:
        y = y + (x,)
    a = list(y)

def gameloop():
    speak("sir please give your command:")
    command = takecommand().lower()
    if "introduce" in command:
        txt = font.render("python automated newly developed and organised requisite assistant",True, blue)
        txt.get_rect()
        gameWindow.blit(txt,(0,0))
        pygame.display.update()
        speak("python automated newly developed and organised requisite assistant")

if __name__ == "__main__":
    speak("passwd please:")
    print("passwd please:")
    query = takecommand().lower()
    if "shaurya" in query:
        speak("initialising")
        speak("opening interface")
        x = pygame.init()
        blue = (0,0,225,225)
        white = (225,225,225,225)
        gameWindow = pygame.display.set_mode((1920,1020))
        pygame.display.set_caption("PANDORA")
        exit_game = False
        game_over = False
        arc = pygame.image.load(r"C:\Users\SHAURYA\Downloads\os personalize\IMG-20200622-WA0004.JPG")
        font = pygame.font.Font("freesansbold.ttf", 115)
        text = font.render('P.A.N.D.O.R.A', True, blue)
        text.get_rect()
        gameWindow.blit(text,(0,0))
        pygame.display.update()
        while not exit_game:
            pyautogui.press("space")
            gameWindow.blit(arc,(600,100))
            pygame.display.update()
            for event in pygame.event.get():
                if event.type == pygame.QUIT:
                    exit_game = True
                if event.type == pygame.KEYDOWN:
                    if event.key == pygame.K_SPACE:
                        gameloop()
    else:
        speak("wrong passwd")
        print("wrong passwd")

Answer 1

Hello Shaurya Thapliyal,

Following might be the reason for your error:​

The possible reason could be that the recognizer_instance.energy_threshold property is probably set to a value that is too high to start off with. You should decrease this threshold, or call recognizer_instance.adjust_for_ambient_noise(source, duration = 1).

If it's a continious loop of audio, the stream might never leave audio = r.listen(source) or your identation is wrong. Consider using a non-blocking object such as the select library. If you're on Windows I'd might thread the output some how.

Use this ambient noise suppression/adjustment;

r.adjust_for_ambient_noise(source, duration=1)

Ensure pyaudio.h is installed by running the below command

        sudo apt-get install portaudio19-dev python-pyaudio python3-pyaudio

Hope it helps!!

Thank You!!

Comments

thank you sir i will be in great debt.