Deep learning based Real-time GPU-accelerated tracking and counting of cotton bolls under field conditions using a moving camera

Simple item page
dc.contributor.authorFue, Kadeghe G.
dc.contributor.authorPorter, Wesley
dc.contributor.authorRains, Glen
dc.date.accessioned2022-06-14T12:41:36Z
dc.date.available2022-06-14T12:41:36Z
dc.date.issued2018-08
dc.descriptionConference Paperen_US
dc.description.abstractRobotic harvesting involves navigation and environmental perception as first operations before harvesting of the bolls can commence. Navigation is the distance required for a harvester’s arm to reach the cotton boll while perception is the position of the boll relative to surrounding environment. These two operations give a 3D position of the cotton boll for picking and can only be achieved by detection and tracking of the cotton bolls in real-time. It means detection, tracking and counting of cotton bolls using a moving camera allows the robotic machine to harvest easily. GPU-accelerated deep neural networks were used to train the convolution networks for detection of cotton bolls. It was achieved by using pretrained tiny yolo weights and DarkFlow, a framework which translates YOLOv2 darknet neural networks to TensorFlow. A method to connect tracklets using vectors that are predicted using Lucas-Kanade algorithm and optimized using robust L-estimators and homography transformation is proposed. The system was tested in defoliated cotton plants during the spring of 2018. Using three video treatments, the counting performance accuracy was around 93% with standard deviation 6%. The system average processing speed was 21 fps in desktop computer and 3.9 fps in embedded system. Detection of the system achieved an accuracy and sensitivity of 93% while precision was 99.9% and F1 score was 1. The Tukey’s test showed that the system accuracy and sensitivity was the same when the plants were rearranged. This performance is crucial for real-time robot decisions that also measure yield while harvesting.en_US
dc.identifier.urihttps://www.suaire.sua.ac.tz/handle/123456789/4260Deep Learning based Real-time GPU-accelerated Tracking and Counting of Cotton Bolls under Field Conditions using
dc.language.isoenen_US
dc.publisher2018 ASABE Annual International Meetingen_US
dc.relation.ispartofseries;Paper Number: 1800831
dc.subjectBoll countingen_US
dc.subjectCotton Bollsen_US
dc.subjectCotton countingen_US
dc.subjectCotton harvestingen_US
dc.subjectDarkFlowen_US
dc.subjectDarkneten_US
dc.subjectDeep Learningen_US
dc.subjectGPUen_US
dc.subjectmachine visionen_US
dc.subjectTensorFlowen_US
dc.subjectYOLOen_US
dc.titleDeep learning based Real-time GPU-accelerated tracking and counting of cotton bolls under field conditions using a moving cameraen_US
dc.typeConferencce Proceedingsen_US
dc.urlDOI: https://doi.org/10.13031/aim.201800831en_US

Files

Original bundle

Now showing 1 - 1 of 1
Thumbnail Image
Name:
Deep Learning based Real-time GPU-Fue.pdf
Size:
1.02 MB
Format:
Adobe Portable Document Format
Description:
Download

License bundle

Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
1.67 KB
Format:
Item-specific license agreed upon to submission
Description:
Download

Collections

Articles, Conference and Workshop Papers Collection