Document Type : Research Paper
Authors
1 Ph.D. Candidate, Department of Agricultural Machinery Engineering, Agriculture and Natural Resources Campus, University of Tehran, Tehran, Iran
2 Professor, Department of Agricultural Machinery Engineering, Agriculture and Natural Resources Campus, University of Tehran, Tehran, Iran
3 Associate Professor, Department of Mechanical engineering of biosystems, Razi University, Kermanshah, Iran
Abstract
Keywords
Main Subjects
EXTENDED ABSTRACT
Pollination, achieved by insects, birds and other, is crucial for the sexual reproduction of numerous crops, fruits, and wildest plants. Among pollinators, insect pollination, particularly by solitary and social bees, plays a dominant role. Beyond their contribution to wild plant pollination, managed honey bees (primarily Apis mellifera) constitute the most economically valuable pollinator group in monocrops and fruits globally. The primary objective of this study was to develop a novel method for monitoring beehive health using sound analysis. By leveraging deep learning techniques, we aimed to accurately detect the presence or absence of a queen bee, as well as various diseases and pests within bee colonies.
To achieve this, we initially designed a beehive and the optimal microphone placement within it using SOLIDWORKS 2022. Subsequently, we employed sound analysis to assess the health status of bee colonies. One-minute audio files were recorded from each hive and converted into spectrograms. These spectrograms were then analyzed using a Convolutional Deep Learning Neural Network (CDLNN). The performance of DenseNet121, EfficientNetB0, and InceptionV3 networks was generated and selected the best-performing one. The chosen network was further trained with six different combinations of batch size and epochs. Finally, spectrograms from healthy hives were compared with those from hives affected by various issues such as queen lessness, Varroa mites, tracheal mites, American/European foulbrood, and Nosema. This innovative system continuously records audio from beehives and analyzes the sounds to detect signs of illness. By using advanced techniques like the Fast Fourier Transform and deep learning, the system can identify various bee diseases with high accuracy. The collected audio data is processed on a cloud-based platform, where powerful artificial intelligence models analyze the sound patterns to identify any health issues within the bee colony. This technology provides beekeepers with a valuable tool to proactively monitor the health of their hives and take necessary steps to prevent colony collapse disorder.
GSMT represents the GSM transmitter modules and their associated circuitry, responsible for initiating calls to the GSM receiver. GSMR denotes the GSM receiver modules and their circuitry, designed to record audio transmitted from the beehives and store it. PC refers to the personal computer that serves as an interface between the GSM modules and Google Cloud. LAN signifies the local area network connecting the PC and the GSM receiver modules. Cloud Computing refers to the Google Cloud Platform, used for data storage and processing.
Ultimately, audio data is stored in Google Drive and processed on Google Colab using a deep learning system based on convolutional neural networks. If any of the defined problems occur (such as queen lessness, Varroa mites, tracheal mites, foulbrood, or Nosema disease), a message is sent to the beekeeper via Telegram. This message includes the audio file containing the detected disease, the processed spectrogram with the detection accuracy percentage, and a text message specifying the beehive number and the probability of the problem.
Our findings demonstrated that sound analysis can accurately detect the presence or absence of a queen bee, as well as infestations by mites and diseases like foulbrood and Nosema. Each specific problem within a beehive produced a unique sound pattern that could be identified using neural networks. By analyzing the fast Fourier transform of one-minute audio recordings, spectrograms and extracted frequency features was generated to interpret the beehive's condition. The neural network achieved an accuracy of over 98% in identifying various issues (queen lessness 98.62%, Varroa mites 98.59%, tracheal mites 98.64%, American/European foulbrood 98.71%, and Nosema 98.80%). Moreover, the proposed Internet of Things system significantly improved the quality and quantity of honey produced compared to traditional beekeeping practices.
The neural networks achieved remarkably high accuracies in identifying various hive anomalies. Specifically, accuracies exceeding 98% were obtained for queenlessness (98.62%), Varroa mites (98.59%), tracheal mites (98.64%), American/European foulbrood (98.71%), and Nosema (98.80%).
Healthy hive with queen: Dominant frequencies were observed between 0 and 2000 Hz, indicative of a stable and healthy colony.
Queenless hive: Higher frequencies, ranging from 2000 to 4000 Hz, were detected, suggesting increased agitation and disorganization among the bees.
Varroa mite infestation: The dominant frequency range shifted to 1000-3000 Hz, indicating increased bee activity to combat the infestation.
Acariasis infestation: Lower frequencies, between 500 and 1500 Hz, were observed, suggesting decreased hive activity and a weakened colony.
American or European foulbrood: A significant decrease in the overall frequency range (400-1200 Hz) was noted, indicating a weakened colony and reduced bee activity.
Nosema infestation: Higher frequencies (800-2400 Hz) were observed, suggesting increased bee activity due to digestive system disturbances.
These results were validated through comprehensive evaluation using confusion matrices and receiver operating characteristic (ROC) curves. The InceptionV3 architecture exhibited the most robust performance, achieving an overall accuracy of 98.74%.
To optimize the performance of the InceptionV3 model, hyperparameter tuning was conducted. By systematically varying parameters such as batch size and epochs, the optimal configuration for training was determined. The results indicated that a batch size of 16 and 20 epochs yielded the best performance, balancing accuracy and training time.
A deep learning-based analysis of beehive sounds, using Fast Fourier Transform (FFT), revealed distinct acoustic patterns associated with various hive health conditions. The following are the quantitative and qualitative impacts of the employed research method on honey production:
Enhanced Honey Yield: Hives managed with acoustic monitoring produced significantly higher honey yields (12 kg on average) compared to conventionally managed hives (8-10 kg).
Increased Invertase Activity: The honey from acoustically monitored hives exhibited higher invertase activity, resulting in a greater proportion of simple sugars and a sweeter taste.
Reduced Sucrose Content: Lower sucrose levels indicated more complete conversion of nectar into honey.
Favorable Fructose-to-Glucose Ratio: A lower fructose-to-glucose ratio contributed to a lower glycemic index, making the honey suitable for individuals with diabetes.
Elevated Proline Content: Higher proline levels indicated better quality and a stronger flavor.
Increased Diastase Activity: Greater diastase activity pointed to higher enzymatic activity and improved shelf life.
Lower Moisture Content: Reduced moisture content contributed to better honey quality and longer shelf life.
The CDLNN-based IoT system introduced in this study accurately detected the issues under investigation (with an accuracy of over 98%), reducing manual intervention in beehive management and positively impacting honey quality and quantity. Consequently, this system can be widely recommended for beehive management to enhance honey quality and quantity, as well as provide non-invasive and easy monitoring for beekeepers.
Payam Faramarzi (P.F.); Conceptualization, Methodology, Data collection, Data processing, Software, Validation, Writing—original draft preparation. Reza Alimardani (R.A.); Supervision, Project administration, Technical Supervision, Writing, review and editing. Hekmat Rabbani (H.R.); Review and editing, Formal analysis, Technical Consultation. Hossein Mousazadeh (H.M.); Review and editing, Formal analysis, Technical Consultation.
All authors have read and agreed to the published version of the manuscript.
For data and results access, please contact the corresponding author via the following email address or ResearchGate page:
https://www.researchgate.net/profile/Payam-Faramarzi-2
The authors avoided data fabrication, falsification, plagiarism, and misconduct.
The author declares no conflict of interest.